Jul 15 23:29:37.332541 ip-10-0-142-22 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 23:29:37.772827 ip-10-0-142-22 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 23:29:37.772827 ip-10-0-142-22 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 23:29:37.772827 ip-10-0-142-22 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 23:29:37.772827 ip-10-0-142-22 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 23:29:37.773376 ip-10-0-142-22 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 23:29:37.773935 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.773867    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 23:29:37.781121 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781101    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 23:29:37.781121 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781118    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 23:29:37.781121 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781122    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 23:29:37.781121 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781126    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 23:29:37.781287 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781129    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 23:29:37.781287 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781132    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 23:29:37.781287 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781135    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 23:29:37.781287 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781138    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 23:29:37.781287 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781141    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 23:29:37.781287 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781144    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 23:29:37.781287 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781147    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 23:29:37.781287 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781153    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 23:29:37.781287 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781155    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 23:29:37.781287 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781158    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 23:29:37.781287 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781161    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 23:29:37.781287 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781164    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 23:29:37.781287 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781166    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 23:29:37.781287 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781169    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 23:29:37.781287 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781172    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 23:29:37.781287 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781175    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 23:29:37.781287 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781178    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 23:29:37.781287 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781181    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 23:29:37.781287 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781183    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 23:29:37.781287 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781186    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 23:29:37.781774 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781191    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 23:29:37.781774 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781194    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 23:29:37.781774 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781197    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 23:29:37.781774 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781200    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 23:29:37.781774 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781203    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 23:29:37.781774 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781208    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 23:29:37.781774 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781210    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 23:29:37.781774 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781213    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 23:29:37.781774 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781216    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 23:29:37.781774 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781218    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 23:29:37.781774 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781221    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 23:29:37.781774 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781224    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 23:29:37.781774 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781226    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 23:29:37.781774 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781249    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 23:29:37.781774 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781254    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 23:29:37.781774 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781257    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 23:29:37.781774 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781260    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 23:29:37.781774 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781263    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 23:29:37.781774 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781265    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 23:29:37.781774 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781268    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 23:29:37.782279 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781271    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 23:29:37.782279 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781274    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 23:29:37.782279 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781276    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 23:29:37.782279 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781279    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 23:29:37.782279 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781282    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 23:29:37.782279 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781287    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 23:29:37.782279 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781290    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 23:29:37.782279 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781293    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 23:29:37.782279 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781296    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 23:29:37.782279 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781300    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 23:29:37.782279 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781303    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 23:29:37.782279 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781306    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 23:29:37.782279 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781309    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 23:29:37.782279 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781312    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 23:29:37.782279 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781314    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 23:29:37.782279 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781317    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 23:29:37.782279 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781320    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 23:29:37.782279 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781322    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 23:29:37.782279 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781327    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 23:29:37.782279 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781330    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 23:29:37.782763 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781333    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 23:29:37.782763 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781336    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 23:29:37.782763 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781338    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 23:29:37.782763 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781341    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 23:29:37.782763 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781345    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 23:29:37.782763 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781349    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 23:29:37.782763 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781352    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 23:29:37.782763 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781355    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 23:29:37.782763 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781357    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 23:29:37.782763 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781360    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 23:29:37.782763 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781365    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 23:29:37.782763 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781368    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 23:29:37.782763 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781371    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 23:29:37.782763 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781373    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 23:29:37.782763 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781376    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 23:29:37.782763 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781379    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 23:29:37.782763 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781381    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 23:29:37.782763 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781386    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 23:29:37.782763 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781389    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 23:29:37.783205 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781393    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 23:29:37.783205 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781397    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 23:29:37.783205 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781402    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 23:29:37.783205 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781406    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 23:29:37.783205 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781409    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 23:29:37.783205 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781411    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 23:29:37.783205 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781414    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 23:29:37.783205 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781417    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 23:29:37.783205 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781420    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 23:29:37.783205 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781423    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 23:29:37.783205 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781426    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 23:29:37.783205 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781428    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 23:29:37.783205 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781431    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 23:29:37.783205 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781434    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 23:29:37.783205 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781439    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 23:29:37.783205 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.781441    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 23:29:37.783708 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783474    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 23:29:37.783708 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783482    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 23:29:37.783708 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783485    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 23:29:37.783708 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783491    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 23:29:37.783708 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783496    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 23:29:37.783708 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783499    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 23:29:37.783708 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783505    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 23:29:37.783708 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783508    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 23:29:37.783708 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783513    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 23:29:37.783708 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783516    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 23:29:37.783708 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783520    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 23:29:37.783708 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783523    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 23:29:37.783708 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783526    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 23:29:37.783708 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783528    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 23:29:37.783708 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783531    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 23:29:37.783708 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783535    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 23:29:37.783708 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783538    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 23:29:37.783708 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783540    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 23:29:37.783708 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783546    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 23:29:37.784196 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783548    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 23:29:37.784196 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783551    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 23:29:37.784196 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783554    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 23:29:37.784196 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783557    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 23:29:37.784196 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783559    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 23:29:37.784196 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783562    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 23:29:37.784196 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783565    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 23:29:37.784196 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783567    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 23:29:37.784196 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783570    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 23:29:37.784196 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783573    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 23:29:37.784196 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783575    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 23:29:37.784196 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783578    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 23:29:37.784196 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783583    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 23:29:37.784196 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783585    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 23:29:37.784196 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783589    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 23:29:37.784196 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783592    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 23:29:37.784196 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783594    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 23:29:37.784196 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783597    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 23:29:37.784196 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783600    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 23:29:37.784196 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783603    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 23:29:37.784694 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783606    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 23:29:37.784694 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783609    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 23:29:37.784694 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783612    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 23:29:37.784694 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783614    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 23:29:37.784694 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783619    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 23:29:37.784694 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783622    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 23:29:37.784694 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783626    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 23:29:37.784694 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783630    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 23:29:37.784694 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783632    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 23:29:37.784694 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783635    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 23:29:37.784694 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783638    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 23:29:37.784694 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783641    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 23:29:37.784694 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783644    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 23:29:37.784694 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783646    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 23:29:37.784694 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783650    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 23:29:37.784694 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783652    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 23:29:37.784694 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783655    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 23:29:37.784694 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783660    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 23:29:37.784694 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783663    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 23:29:37.784694 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783666    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 23:29:37.785186 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783668    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 23:29:37.785186 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783671    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 23:29:37.785186 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783674    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 23:29:37.785186 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783676    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 23:29:37.785186 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783679    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 23:29:37.785186 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783682    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 23:29:37.785186 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783685    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 23:29:37.785186 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783688    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 23:29:37.785186 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783690    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 23:29:37.785186 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783697    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 23:29:37.785186 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783700    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 23:29:37.785186 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783703    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 23:29:37.785186 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783705    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 23:29:37.785186 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783708    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 23:29:37.785186 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783711    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 23:29:37.785186 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783714    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 23:29:37.785186 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783717    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 23:29:37.785186 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783720    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 23:29:37.785186 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783722    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 23:29:37.785186 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783725    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 23:29:37.785674 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783727    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 23:29:37.785674 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783733    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 23:29:37.785674 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783735    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 23:29:37.785674 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783738    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 23:29:37.785674 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783740    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 23:29:37.785674 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783743    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 23:29:37.785674 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783745    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 23:29:37.785674 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783748    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 23:29:37.785674 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783751    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 23:29:37.785674 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783754    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 23:29:37.785674 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783757    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 23:29:37.785674 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783759    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 23:29:37.785674 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783762    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 23:29:37.785674 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783767    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 23:29:37.785674 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783770    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 23:29:37.785674 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783773    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 23:29:37.785674 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783775    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 23:29:37.785674 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783778    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 23:29:37.785674 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783781    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 23:29:37.785674 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.783784    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 23:29:37.786146 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784401    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 23:29:37.786146 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784407    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 23:29:37.786146 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784411    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 23:29:37.786146 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784414    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 23:29:37.786146 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784417    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 23:29:37.786146 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784419    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 23:29:37.786146 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784423    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 23:29:37.786146 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784426    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 23:29:37.786146 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784429    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 23:29:37.786146 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784432    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 23:29:37.786146 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784434    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 23:29:37.786146 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784437    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 23:29:37.786146 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784442    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 23:29:37.786146 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784445    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 23:29:37.786146 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784448    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 23:29:37.786146 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784450    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 23:29:37.786146 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784453    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 23:29:37.786146 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784456    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 23:29:37.786146 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784459    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 23:29:37.786146 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784462    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 23:29:37.786643 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784465    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 23:29:37.786643 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784468    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 23:29:37.786643 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784470    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 23:29:37.786643 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784473    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 23:29:37.786643 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784478    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 23:29:37.786643 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784481    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 23:29:37.786643 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784484    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 23:29:37.786643 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784487    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 23:29:37.786643 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784490    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 23:29:37.786643 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784492    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 23:29:37.786643 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784495    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 23:29:37.786643 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784498    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 23:29:37.786643 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784502    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 23:29:37.786643 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784506    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 23:29:37.786643 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784509    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 23:29:37.786643 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784512    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 23:29:37.786643 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784514    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 23:29:37.786643 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784520    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 23:29:37.786643 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784523    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 23:29:37.786643 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784525    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 23:29:37.787118 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784528    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 23:29:37.787118 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784531    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 23:29:37.787118 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784533    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 23:29:37.787118 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784536    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 23:29:37.787118 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784538    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 23:29:37.787118 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784541    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 23:29:37.787118 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784544    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 23:29:37.787118 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784546    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 23:29:37.787118 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784553    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 23:29:37.787118 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784555    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 23:29:37.787118 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784558    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 23:29:37.787118 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784560    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 23:29:37.787118 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784563    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 23:29:37.787118 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784568    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 23:29:37.787118 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784571    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 23:29:37.787118 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784573    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 23:29:37.787118 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784576    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 23:29:37.787118 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784579    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 23:29:37.787118 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784581    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 23:29:37.787118 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784585    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 23:29:37.787619 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784589    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 23:29:37.787619 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784594    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 23:29:37.787619 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784597    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 23:29:37.787619 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784600    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 23:29:37.787619 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784603    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 23:29:37.787619 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784606    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 23:29:37.787619 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784608    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 23:29:37.787619 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784611    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 23:29:37.787619 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784614    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 23:29:37.787619 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784617    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 23:29:37.787619 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784621    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 23:29:37.787619 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784623    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 23:29:37.787619 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784628    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 23:29:37.787619 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784631    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 23:29:37.787619 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784634    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 23:29:37.787619 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784636    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 23:29:37.787619 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784639    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 23:29:37.787619 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784641    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 23:29:37.787619 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784644    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 23:29:37.787619 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784647    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 23:29:37.788110 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784650    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 23:29:37.788110 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784652    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 23:29:37.788110 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784655    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 23:29:37.788110 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784658    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 23:29:37.788110 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784660    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 23:29:37.788110 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784689    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 23:29:37.788110 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784723    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 23:29:37.788110 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784727    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 23:29:37.788110 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784731    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 23:29:37.788110 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784736    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 23:29:37.788110 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784740    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 23:29:37.788110 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784744    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 23:29:37.788110 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784767    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 23:29:37.788110 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784787    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 23:29:37.788110 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784873    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 23:29:37.788110 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784877    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 23:29:37.788110 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784881    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 23:29:37.788110 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784888    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 23:29:37.788110 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.784894    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 23:29:37.788110 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.784986    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.784995    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785005    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785014    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785022    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785028    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785037    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785045    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785051    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785057    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785064    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785071    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785076    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785083    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785099    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785106    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785111    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785117    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785131    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785138    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785142    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785147    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785152    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785157    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 23:29:37.788601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785160    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785163    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785166    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785169    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785172    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785174    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785177    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785180    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785184    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785187    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785190    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785194    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785197    2576 flags.go:64] FLAG: --enable-server="true"
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785200    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785204    2576 flags.go:64] FLAG: --event-burst="100"
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785207    2576 flags.go:64] FLAG: --event-qps="50"
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785210    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785213    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785215    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785224    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785227    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785245    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785250    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785255    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785257    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 23:29:37.789174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785260    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785264    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785267    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785269    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785272    2576 flags.go:64] FLAG: --feature-gates=""
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785276    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785279    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785282    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785284    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785287    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785292    2576 flags.go:64] FLAG: --help="false"
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785295    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-142-22.ec2.internal"
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785298    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785300    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785303    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785307    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785310    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785313    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785315    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785318    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785321    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785324    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785327    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785330    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 15 23:29:37.789835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785333    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785335    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785338    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785341    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785344    2576 flags.go:64] FLAG: --lock-file=""
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785346    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785349    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785352    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785357    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785366    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785369    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785372    2576 flags.go:64] FLAG: --logging-format="text"
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785375    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785378    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785381    2576 flags.go:64] FLAG: --manifest-url=""
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785384    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785388    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785390    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785397    2576 flags.go:64] FLAG: --max-pods="110"
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785400    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785403    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785405    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785408    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785411    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785414    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 23:29:37.790444 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785417    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785424    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785427    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785430    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785433    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785435    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785440    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785443    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785446    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785449    2576 flags.go:64] FLAG: --port="10250"
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785452    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785455    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ff3fb4a425574e5a"
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785458    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785461    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785464    2576 flags.go:64] FLAG: --register-node="true"
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785467    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785470    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785483    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785486    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785489    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785492    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785495    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785498    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785501    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785503    2576 flags.go:64] FLAG: --runonce="false"
Jul 15 23:29:37.791043 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785506    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785510    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785513    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785516    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785519    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785522    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785525    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785528    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785530    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785533    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785536    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785538    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785541    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785544    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785547    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785552    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785555    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785558    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785562    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785564    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785567    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785570    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785573    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785576    2576 flags.go:64] FLAG: --v="2"
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785579    2576 flags.go:64] FLAG: --version="false"
Jul 15 23:29:37.791647 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785589    2576 flags.go:64] FLAG: --vmodule=""
Jul 15 23:29:37.792302 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785592    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 23:29:37.792302 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.785596    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 23:29:37.792302 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785703    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 23:29:37.792302 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785707    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 23:29:37.792302 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785710    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 23:29:37.792302 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785713    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 23:29:37.792302 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785716    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 23:29:37.792302 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785722    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 23:29:37.792302 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785726    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 23:29:37.792302 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785729    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 23:29:37.792302 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785732    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 23:29:37.792302 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785735    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 23:29:37.792302 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785738    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 23:29:37.792302 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785740    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 23:29:37.792302 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785743    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 23:29:37.792302 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785746    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 23:29:37.792302 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785748    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 23:29:37.792302 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785751    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 23:29:37.792302 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785753    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 23:29:37.792766 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785756    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 23:29:37.792766 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785759    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 23:29:37.792766 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785761    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 23:29:37.792766 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785764    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 23:29:37.792766 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785766    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 23:29:37.792766 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785768    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 23:29:37.792766 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785771    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 23:29:37.792766 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785773    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 23:29:37.792766 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785777    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 23:29:37.792766 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785780    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 23:29:37.792766 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785782    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 23:29:37.792766 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785785    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 23:29:37.792766 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785788    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 23:29:37.792766 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785796    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 23:29:37.792766 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785799    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 23:29:37.792766 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785801    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 23:29:37.792766 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785804    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 23:29:37.792766 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785806    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 23:29:37.792766 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785809    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 23:29:37.793271 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785811    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 23:29:37.793271 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785815    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 23:29:37.793271 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785818    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 23:29:37.793271 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785820    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 23:29:37.793271 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785823    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 23:29:37.793271 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785825    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 23:29:37.793271 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785828    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 23:29:37.793271 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785830    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 23:29:37.793271 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785832    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 23:29:37.793271 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785835    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 23:29:37.793271 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785838    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 23:29:37.793271 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785840    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 23:29:37.793271 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785842    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 23:29:37.793271 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785845    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 23:29:37.793271 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785849    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 23:29:37.793271 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785852    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 23:29:37.793271 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785855    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 23:29:37.793271 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785857    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 23:29:37.793271 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785860    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 23:29:37.793721 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785863    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 23:29:37.793721 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785866    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 23:29:37.793721 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785870    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 23:29:37.793721 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785873    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 23:29:37.793721 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785876    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 23:29:37.793721 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785878    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 23:29:37.793721 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785881    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 23:29:37.793721 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785884    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 23:29:37.793721 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785894    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 23:29:37.793721 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785897    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 23:29:37.793721 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785900    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 23:29:37.793721 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785902    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 23:29:37.793721 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785905    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 23:29:37.793721 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785907    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 23:29:37.793721 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785911    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 23:29:37.793721 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785913    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 23:29:37.793721 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785916    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 23:29:37.793721 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785918    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 23:29:37.793721 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785921    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 23:29:37.793721 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785923    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 23:29:37.794208 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785926    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 23:29:37.794208 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785928    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 23:29:37.794208 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785931    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 23:29:37.794208 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785935    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 23:29:37.794208 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785938    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 23:29:37.794208 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785941    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 23:29:37.794208 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785944    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 23:29:37.794208 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785947    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 23:29:37.794208 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785949    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 23:29:37.794208 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785951    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 23:29:37.794208 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785954    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 23:29:37.794208 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785956    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 23:29:37.794208 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785959    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 23:29:37.794208 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785961    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 23:29:37.794208 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785965    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 23:29:37.794208 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785968    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 23:29:37.794208 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785971    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 23:29:37.794208 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785973    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 23:29:37.794208 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785976    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 23:29:37.794208 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785979    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 23:29:37.794691 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785981    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 23:29:37.794691 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785989    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 23:29:37.794691 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785992    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 23:29:37.794691 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.785994    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 23:29:37.794691 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.786775    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 23:29:37.794691 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.793707    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 23:29:37.794691 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.793722    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 23:29:37.794691 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.793738    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 23:29:37.794691 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.793744    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 23:29:37.794691 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793803    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 23:29:37.794691 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793808    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 23:29:37.794691 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793812    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 23:29:37.794691 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793815    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 23:29:37.794691 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793818    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 23:29:37.794691 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793821    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 23:29:37.795060 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793824    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 23:29:37.795060 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793828    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 23:29:37.795060 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793832    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 23:29:37.795060 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793836    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 23:29:37.795060 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793839    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 23:29:37.795060 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793842    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 23:29:37.795060 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793845    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 23:29:37.795060 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793848    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 23:29:37.795060 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793850    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 23:29:37.795060 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793853    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 23:29:37.795060 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793857    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 23:29:37.795060 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793860    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 23:29:37.795060 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793863    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 23:29:37.795060 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793866    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 23:29:37.795060 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793869    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 23:29:37.795060 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793871    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 23:29:37.795060 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793874    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 23:29:37.795060 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793877    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 23:29:37.795060 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793879    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 23:29:37.795560 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793882    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 23:29:37.795560 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793884    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 23:29:37.795560 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793887    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 23:29:37.795560 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793890    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 23:29:37.795560 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793894    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 23:29:37.795560 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793897    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 23:29:37.795560 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793899    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 23:29:37.795560 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793902    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 23:29:37.795560 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793904    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 23:29:37.795560 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793907    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 23:29:37.795560 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793909    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 23:29:37.795560 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793912    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 23:29:37.795560 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793914    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 23:29:37.795560 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793917    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 23:29:37.795560 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793919    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 23:29:37.795560 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793922    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 23:29:37.795560 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793924    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 23:29:37.795560 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793927    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 23:29:37.795560 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793929    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 23:29:37.795560 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793932    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 23:29:37.796025 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793934    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 23:29:37.796025 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793937    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 23:29:37.796025 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793939    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 23:29:37.796025 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793942    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 23:29:37.796025 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793944    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 23:29:37.796025 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793947    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 23:29:37.796025 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793950    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 23:29:37.796025 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793952    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 23:29:37.796025 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793955    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 23:29:37.796025 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793957    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 23:29:37.796025 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793960    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 23:29:37.796025 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793962    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 23:29:37.796025 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793964    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 23:29:37.796025 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793967    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 23:29:37.796025 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793970    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 23:29:37.796025 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793973    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 23:29:37.796025 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793976    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 23:29:37.796025 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793979    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 23:29:37.796025 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793981    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 23:29:37.796025 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793984    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 23:29:37.796514 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793986    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 23:29:37.796514 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793989    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 23:29:37.796514 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793991    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 23:29:37.796514 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793994    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 23:29:37.796514 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793996    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 23:29:37.796514 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.793999    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 23:29:37.796514 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794001    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 23:29:37.796514 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794003    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 23:29:37.796514 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794006    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 23:29:37.796514 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794009    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 23:29:37.796514 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794011    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 23:29:37.796514 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794013    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 23:29:37.796514 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794016    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 23:29:37.796514 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794019    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 23:29:37.796514 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794021    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 23:29:37.796514 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794023    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 23:29:37.796514 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794026    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 23:29:37.796514 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794029    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 23:29:37.796514 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794031    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 23:29:37.796514 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794034    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 23:29:37.797001 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794036    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 23:29:37.797001 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794039    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 23:29:37.797001 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794042    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 23:29:37.797001 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794044    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 23:29:37.797001 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794046    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 23:29:37.797001 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794049    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 23:29:37.797001 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794051    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 23:29:37.797001 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794054    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 23:29:37.797001 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794057    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 23:29:37.797001 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794060    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 23:29:37.797001 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794063    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 23:29:37.797001 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794067    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 23:29:37.797001 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794070    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 23:29:37.797001 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794073    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 23:29:37.797388 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.794078    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 23:29:37.797388 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794190    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 23:29:37.797388 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794195    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 23:29:37.797388 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794198    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 23:29:37.797388 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794201    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 23:29:37.797388 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794204    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 23:29:37.797388 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794207    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 23:29:37.797388 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794210    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 23:29:37.797388 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794213    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 23:29:37.797388 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794216    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 23:29:37.797388 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794219    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 23:29:37.797388 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794221    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 23:29:37.797388 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794224    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 23:29:37.797388 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794227    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 23:29:37.797729 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794245    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 23:29:37.797729 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794249    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 23:29:37.797729 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794251    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 23:29:37.797729 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794254    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 23:29:37.797729 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794256    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 23:29:37.797729 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794259    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 23:29:37.797729 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794261    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 23:29:37.797729 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794264    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 23:29:37.797729 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794266    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 23:29:37.797729 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794269    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 23:29:37.797729 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794271    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 23:29:37.797729 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794275    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 23:29:37.797729 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794277    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 23:29:37.797729 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794279    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 23:29:37.797729 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794282    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 23:29:37.797729 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794285    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 23:29:37.797729 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794288    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 23:29:37.797729 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794290    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 23:29:37.797729 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794293    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 23:29:37.797729 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794296    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 23:29:37.798207 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794298    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 23:29:37.798207 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794301    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 23:29:37.798207 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794303    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 23:29:37.798207 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794306    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 23:29:37.798207 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794308    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 23:29:37.798207 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794310    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 23:29:37.798207 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794314    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 23:29:37.798207 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794318    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 23:29:37.798207 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794321    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 23:29:37.798207 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794324    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 23:29:37.798207 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794327    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 23:29:37.798207 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794329    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 23:29:37.798207 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794332    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 23:29:37.798207 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794334    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 23:29:37.798207 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794337    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 23:29:37.798207 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794339    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 23:29:37.798207 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794342    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 23:29:37.798207 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794344    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 23:29:37.798207 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794347    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 23:29:37.798207 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794349    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 23:29:37.798693 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794351    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 23:29:37.798693 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794354    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 23:29:37.798693 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794356    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 23:29:37.798693 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794359    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 23:29:37.798693 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794362    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 23:29:37.798693 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794364    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 23:29:37.798693 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794367    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 23:29:37.798693 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794369    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 23:29:37.798693 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794372    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 23:29:37.798693 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794374    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 23:29:37.798693 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794377    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 23:29:37.798693 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794380    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 23:29:37.798693 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794382    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 23:29:37.798693 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794385    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 23:29:37.798693 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794387    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 23:29:37.798693 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794390    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 23:29:37.798693 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794392    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 23:29:37.798693 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794395    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 23:29:37.798693 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794398    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 23:29:37.799158 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794402    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 23:29:37.799158 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794404    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 23:29:37.799158 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794407    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 23:29:37.799158 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794410    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 23:29:37.799158 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794412    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 23:29:37.799158 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794415    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 23:29:37.799158 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794417    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 23:29:37.799158 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794420    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 23:29:37.799158 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794422    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 23:29:37.799158 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794424    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 23:29:37.799158 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794427    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 23:29:37.799158 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794429    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 23:29:37.799158 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794432    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 23:29:37.799158 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794434    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 23:29:37.799158 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794436    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 23:29:37.799158 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794439    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 23:29:37.799158 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794441    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 23:29:37.799158 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794444    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 23:29:37.799158 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794446    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 23:29:37.799158 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794449    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 23:29:37.799638 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794451    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 23:29:37.799638 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794453    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 23:29:37.799638 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794457    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 23:29:37.799638 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794460    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 23:29:37.799638 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794462    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 23:29:37.799638 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794464    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 23:29:37.799638 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:37.794467    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 23:29:37.799638 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.794472    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 23:29:37.799638 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.794568    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 23:29:37.799638 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.797011    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 23:29:37.799638 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.798709    2576 server.go:1019] "Starting client certificate rotation"
Jul 15 23:29:37.799638 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.798802    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 23:29:37.799638 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.798834    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 23:29:37.801637 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.801622    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 23:29:37.804020 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.804000    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 23:29:37.814603 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.814581    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 15 23:29:37.817967 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.817953    2576 log.go:25] "Validated CRI v1 image API"
Jul 15 23:29:37.818766 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.818754    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 23:29:37.825975 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.825948    2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7ee33454-d5ef-4f6a-a281-62415e35920b:/dev/nvme0n1p4 e5f23a09-8023-40f6-ac99-393010a6642a:/dev/nvme0n1p3]
Jul 15 23:29:37.826070 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.825974    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 23:29:37.830849 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.830833    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 23:29:37.831648 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.831544    2576 manager.go:216] Machine: {Timestamp:2026-07-15 23:29:37.830016289 +0000 UTC m=+0.373738633 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099931 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec220c2d8455c86c5d6631dc54a0fcc8 SystemUUID:ec220c2d-8455-c86c-5d66-31dc54a0fcc8 BootID:f842bd7d-5b14-415f-9aaf-05f1967995f5 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a9:15:95:ae:33 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a9:15:95:ae:33 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:0b:4c:8f:1f:e6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 23:29:37.831648 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.831644    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 23:29:37.831748 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.831736    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 23:29:37.835263 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.835225    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 23:29:37.835390 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.835267    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-22.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 23:29:37.836101 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.836092    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 23:29:37.836131 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.836105    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 23:29:37.836131 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.836112    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 23:29:37.836922 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.836912    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 23:29:37.838729 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.838719    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 23:29:37.843754 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.843735    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 23:29:37.843863 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.843854    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 23:29:37.843897 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.843882    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 23:29:37.843897 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.843891    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 23:29:37.843972 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.843904    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 23:29:37.843972 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.843914    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 15 23:29:37.843972 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.843921    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 23:29:37.844243 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.844212    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 23:29:37.844243 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.844246    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 23:29:37.846584 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.846564    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 23:29:37.848909 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.848894    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 23:29:37.848960 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.848939    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 23:29:37.849191 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.849181    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 23:29:37.849223 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.849197    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 23:29:37.849223 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.849203    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 23:29:37.849223 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.849208    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 23:29:37.849223 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.849216    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 23:29:37.849223 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.849221    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 23:29:37.849766 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.849752    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 23:29:37.849766 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.849764    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 23:29:37.849862 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.849772    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 23:29:37.849862 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.849777    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 23:29:37.849862 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.849785    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 23:29:37.849862 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.849793    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 23:29:37.849862 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.849815    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 23:29:37.849862 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.849820    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 23:29:37.852888 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.852871    2576 server.go:1268] "Started kubelet"
Jul 15 23:29:37.852997 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.852967    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 23:29:37.853363 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.853104    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 23:29:37.853363 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.853210    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 23:29:37.853698 ip-10-0-142-22 systemd[1]: Started Kubernetes Kubelet.
Jul 15 23:29:37.853853 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:37.853824    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 23:29:37.853950 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:37.853929    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-22.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 23:29:37.854385 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.854371    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 23:29:37.855392 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.855372    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-22.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 23:29:37.855643 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.855494    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 23:29:37.863740 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:37.863703    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 23:29:37.863740 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:37.860404    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-22.ec2.internal.18c29a68ee06d377  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-22.ec2.internal,UID:ip-10-0-142-22.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-22.ec2.internal,},FirstTimestamp:2026-07-15 23:29:37.852838775 +0000 UTC m=+0.396561120,LastTimestamp:2026-07-15 23:29:37.852838775 +0000 UTC m=+0.396561120,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-22.ec2.internal,}"
Jul 15 23:29:37.867434 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.867413    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 23:29:37.867531 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.867420    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 23:29:37.867626 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:37.867606    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Jul 15 23:29:37.868190 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.868172    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 23:29:37.868275 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.868176    2576 factory.go:55] Registering systemd factory
Jul 15 23:29:37.868275 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.868200    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 23:29:37.868275 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.868208    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 15 23:29:37.868275 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.868214    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 23:29:37.868529 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.868320    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 23:29:37.868529 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.868330    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 23:29:37.868529 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.868428    2576 factory.go:153] Registering CRI-O factory
Jul 15 23:29:37.868529 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.868441    2576 factory.go:223] Registration of the crio container factory successfully
Jul 15 23:29:37.868678 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.868542    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 23:29:37.868678 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.868579    2576 factory.go:103] Registering Raw factory
Jul 15 23:29:37.868678 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.868596    2576 manager.go:1196] Started watching for new ooms in manager
Jul 15 23:29:37.869018 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.869005    2576 manager.go:349] Starting recovery of all containers
Jul 15 23:29:37.869516 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:37.869489    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-22.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 23:29:37.869614 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:37.869591    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 23:29:37.875631 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.875607    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lpz7q"
Jul 15 23:29:37.880437 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.880416    2576 manager.go:354] Recovery completed
Jul 15 23:29:37.881902 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.881887    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lpz7q"
Jul 15 23:29:37.884539 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.884527    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 23:29:37.886846 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.886507    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 23:29:37.886846 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.886532    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 23:29:37.886846 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.886742    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientPID"
Jul 15 23:29:37.888584 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.888568    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 23:29:37.888584 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.888583    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 23:29:37.888727 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.888601    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 23:29:37.889363 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.889340    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 23:29:37.889719 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:37.889637    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-22.ec2.internal.18c29a68f008c475  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-22.ec2.internal,UID:ip-10-0-142-22.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-22.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-22.ec2.internal,},FirstTimestamp:2026-07-15 23:29:37.886520437 +0000 UTC m=+0.430242790,LastTimestamp:2026-07-15 23:29:37.886520437 +0000 UTC m=+0.430242790,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-22.ec2.internal,}"
Jul 15 23:29:37.890161 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.890143    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 23:29:37.890222 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.890171    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 23:29:37.890222 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.890186    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientPID"
Jul 15 23:29:37.890953 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.890935    2576 policy_none.go:49] "None policy: Start"
Jul 15 23:29:37.891016 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.890972    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 23:29:37.891016 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.890993    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 23:29:37.892928 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.892914    2576 policy_none.go:47] "Start"
Jul 15 23:29:37.963039 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.963017    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 23:29:37.965182 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.964056    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 23:29:37.965182 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.964093    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 23:29:37.965182 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.964115    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 23:29:37.965182 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:37.964157    2576 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 15 23:29:37.966814 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:37.966796    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 23:29:37.967667 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:37.967652    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Jul 15 23:29:38.054764 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.054747    2576 manager.go:337] "Starting Device Plugin manager"
Jul 15 23:29:38.054842 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:38.054776    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 23:29:38.054842 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.054785    2576 server.go:87] "Starting device plugin registration server"
Jul 15 23:29:38.054989 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.054964    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 23:29:38.054989 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.054972    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 23:29:38.055068 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.055033    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 23:29:38.055112 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.055099    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 23:29:38.055112 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.055106    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 23:29:38.055626 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:38.055607    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 23:29:38.055709 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:38.055661    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-22.ec2.internal\" not found"
Jul 15 23:29:38.064907 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.064891    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-22.ec2.internal"]
Jul 15 23:29:38.064967 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.064946    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 23:29:38.066517 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.066504    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 23:29:38.066565 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.066530    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 23:29:38.066565 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.066540    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientPID"
Jul 15 23:29:38.068821 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.068805    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 23:29:38.068916 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.068825    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6cfd89dbca2154f100ae43766bc3db3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal\" (UID: \"d6cfd89dbca2154f100ae43766bc3db3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal"
Jul 15 23:29:38.068916 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.068849    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6cfd89dbca2154f100ae43766bc3db3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal\" (UID: \"d6cfd89dbca2154f100ae43766bc3db3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal"
Jul 15 23:29:38.069011 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.068925    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal"
Jul 15 23:29:38.069011 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.068949    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 23:29:38.069476 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.069459    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 23:29:38.069567 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.069483    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 23:29:38.069567 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.069494    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientPID"
Jul 15 23:29:38.069567 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.069511    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 23:29:38.069567 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.069534    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 23:29:38.069567 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.069549    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientPID"
Jul 15 23:29:38.071885 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.071866    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-22.ec2.internal"
Jul 15 23:29:38.071961 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.071900    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 23:29:38.072496 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.072480    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 23:29:38.072574 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.072504    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 23:29:38.072574 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.072519    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientPID"
Jul 15 23:29:38.075087 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:38.075071    2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-22.ec2.internal\" not found" node="ip-10-0-142-22.ec2.internal"
Jul 15 23:29:38.095778 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:38.095757    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-22.ec2.internal\" not found" node="ip-10-0-142-22.ec2.internal"
Jul 15 23:29:38.100056 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:38.100040    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-22.ec2.internal\" not found" node="ip-10-0-142-22.ec2.internal"
Jul 15 23:29:38.155276 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.155250    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 23:29:38.155955 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.155932    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 23:29:38.155955 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.155955    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 23:29:38.156093 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.155969    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientPID"
Jul 15 23:29:38.156093 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.155992    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-22.ec2.internal"
Jul 15 23:29:38.164812 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.164795    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-22.ec2.internal"
Jul 15 23:29:38.164869 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:38.164813    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-22.ec2.internal\": node \"ip-10-0-142-22.ec2.internal\" not found"
Jul 15 23:29:38.169379 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.169348    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6cfd89dbca2154f100ae43766bc3db3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal\" (UID: \"d6cfd89dbca2154f100ae43766bc3db3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal"
Jul 15 23:29:38.169443 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.169389    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6cfd89dbca2154f100ae43766bc3db3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal\" (UID: \"d6cfd89dbca2154f100ae43766bc3db3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal"
Jul 15 23:29:38.169443 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.169389    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6cfd89dbca2154f100ae43766bc3db3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal\" (UID: \"d6cfd89dbca2154f100ae43766bc3db3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal"
Jul 15 23:29:38.169443 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.169419    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a5413ecf371cffe8dd9dab2a6b7557f0-config\") pod \"kube-apiserver-proxy-ip-10-0-142-22.ec2.internal\" (UID: \"a5413ecf371cffe8dd9dab2a6b7557f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-22.ec2.internal"
Jul 15 23:29:38.169443 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.169431    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6cfd89dbca2154f100ae43766bc3db3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal\" (UID: \"d6cfd89dbca2154f100ae43766bc3db3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal"
Jul 15 23:29:38.187020 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:38.187000    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Jul 15 23:29:38.270312 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.270290    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a5413ecf371cffe8dd9dab2a6b7557f0-config\") pod \"kube-apiserver-proxy-ip-10-0-142-22.ec2.internal\" (UID: \"a5413ecf371cffe8dd9dab2a6b7557f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-22.ec2.internal"
Jul 15 23:29:38.270386 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.270334    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a5413ecf371cffe8dd9dab2a6b7557f0-config\") pod \"kube-apiserver-proxy-ip-10-0-142-22.ec2.internal\" (UID: \"a5413ecf371cffe8dd9dab2a6b7557f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-22.ec2.internal"
Jul 15 23:29:38.287449 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:38.287404    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Jul 15 23:29:38.388191 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:38.388164    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Jul 15 23:29:38.397300 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.397270    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal"
Jul 15 23:29:38.403298 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.403285    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-22.ec2.internal"
Jul 15 23:29:38.488995 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:38.488969    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Jul 15 23:29:38.589989 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:38.589916    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Jul 15 23:29:38.690922 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:38.690885    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Jul 15 23:29:38.792004 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:38.791966    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Jul 15 23:29:38.798356 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.798337    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 23:29:38.798504 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.798485    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 23:29:38.887297 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.887216    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 23:24:38 +0000 UTC" deadline="2027-12-30 19:27:34.995711609 +0000 UTC"
Jul 15 23:29:38.887297 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:38.887278    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12787h57m56.108455464s"
Jul 15 23:29:38.892791 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:38.892775    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Jul 15 23:29:38.993903 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:38.993878    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Jul 15 23:29:39.094992 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:39.094956    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Jul 15 23:29:39.122164 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.122141    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 23:29:39.131612 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.131595    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 23:29:39.152433 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:39.152253    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5413ecf371cffe8dd9dab2a6b7557f0.slice/crio-64df40f470be18f0ec32b3ceb2e762389a9439e6530219381c51f183afcb90d8 WatchSource:0}: Error finding container 64df40f470be18f0ec32b3ceb2e762389a9439e6530219381c51f183afcb90d8: Status 404 returned error can't find the container with id 64df40f470be18f0ec32b3ceb2e762389a9439e6530219381c51f183afcb90d8
Jul 15 23:29:39.152742 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:39.152726    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6cfd89dbca2154f100ae43766bc3db3.slice/crio-f179b0cf7ace314397e2bcfa37615b47123d10be992a3f643dbd4ae2b19619b9 WatchSource:0}: Error finding container f179b0cf7ace314397e2bcfa37615b47123d10be992a3f643dbd4ae2b19619b9: Status 404 returned error can't find the container with id f179b0cf7ace314397e2bcfa37615b47123d10be992a3f643dbd4ae2b19619b9
Jul 15 23:29:39.157628 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.157612    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 23:29:39.195491 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:39.195464    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Jul 15 23:29:39.290469 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.290452    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 23:29:39.368549 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.368525    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal"
Jul 15 23:29:39.382598 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.382577    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 23:29:39.383657 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.383644    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-22.ec2.internal"
Jul 15 23:29:39.391764 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.391648    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 23:29:39.845977 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.845946    2576 apiserver.go:52] "Watching apiserver"
Jul 15 23:29:39.851720 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.851694    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 23:29:39.852073 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.852052    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-22.ec2.internal","openshift-cluster-node-tuning-operator/tuned-9lbbs","openshift-dns/node-resolver-h4fg7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal","openshift-multus/multus-additional-cni-plugins-xn8nk","openshift-multus/network-metrics-daemon-v68p6","openshift-network-operator/iptables-alerter-gxbgz","kube-system/konnectivity-agent-wg4tf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7","openshift-image-registry/node-ca-t8kxt","openshift-multus/multus-jbldt","openshift-network-diagnostics/network-check-target-9lphg","openshift-ovn-kubernetes/ovnkube-node-2wsc4","kube-system/global-pull-secret-syncer-s9w89"]
Jul 15 23:29:39.856066 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.856048    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t8kxt"
Jul 15 23:29:39.858282 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.858263    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 23:29:39.858402 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.858387    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:29:39.858453 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.858424    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 23:29:39.858488 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.858385    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tm886\""
Jul 15 23:29:39.858525 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:39.858476    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v68p6" podUID="469dc602-e468-466b-84e4-3504671a58c2"
Jul 15 23:29:39.858525 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.858490    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 23:29:39.860770 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.860743    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.862698 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.862678    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 23:29:39.862790 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.862769    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 23:29:39.862790 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.862770    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 23:29:39.863095 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.862958    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 23:29:39.863095 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.862972    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tqbvf\""
Jul 15 23:29:39.863217 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.863207    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.865049 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.865037    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 23:29:39.865143 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.865068    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q4c4g\""
Jul 15 23:29:39.865143 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.865094    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 23:29:39.865424 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.865404    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gxbgz"
Jul 15 23:29:39.867324 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.867301    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wd2ks\""
Jul 15 23:29:39.867324 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.867307    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 23:29:39.867324 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.867321    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 23:29:39.867509 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.867310    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 23:29:39.867849 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.867830    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.868654 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.868636    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 23:29:39.869660 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.869642    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 23:29:39.869750 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.869677    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kdj9b\""
Jul 15 23:29:39.869750 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.869650    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 23:29:39.870203 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.870136    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7"
Jul 15 23:29:39.871916 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.871896    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 23:29:39.872114 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.872096    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 23:29:39.872205 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.872143    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 23:29:39.872482 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.872462    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8wxgm\""
Jul 15 23:29:39.872658 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.872641    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:39.876687 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.876380    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h4fg7"
Jul 15 23:29:39.876687 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.876496    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 23:29:39.876687 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.876611    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 23:29:39.876687 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.876638    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 23:29:39.876955 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.876815    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cw9lb\""
Jul 15 23:29:39.876955 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.876879    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 23:29:39.877070 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.876950    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 23:29:39.877070 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.876988    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 23:29:39.878979 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.878963    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:29:39.879058 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:39.879026    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lphg" podUID="a35cfa6e-c492-4a49-9002-5e2ba013c744"
Jul 15 23:29:39.880156 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.880136    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 23:29:39.880832 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.880807    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 23:29:39.880922 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.880830    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hwkg6\""
Jul 15 23:29:39.881060 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.881041    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 23:29:39.881567 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.881551    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wg4tf"
Jul 15 23:29:39.882865 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.882847    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-etc-sysctl-d\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.882942 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.882871    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/359c98c1-dd84-40d6-8870-8527096cf0bf-socket-dir\") pod \"aws-ebs-csi-driver-node-n98g7\" (UID: \"359c98c1-dd84-40d6-8870-8527096cf0bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7"
Jul 15 23:29:39.882942 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.882889    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-host-run-netns\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.882942 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.882904    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-lib-modules\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.882942 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.882924    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/359c98c1-dd84-40d6-8870-8527096cf0bf-sys-fs\") pod \"aws-ebs-csi-driver-node-n98g7\" (UID: \"359c98c1-dd84-40d6-8870-8527096cf0bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7"
Jul 15 23:29:39.883105 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.882965    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-os-release\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.883105 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.882991    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be523a77-0668-4774-9cdb-e16840e092db-multus-daemon-config\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.883105 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883017    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/625740e0-2602-472b-9a17-fd616cddb5fc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.883105 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883043    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-etc-sysctl-conf\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.883105 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883065    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-system-cni-dir\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.883105 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883086    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-multus-socket-dir-parent\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.883105 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883103    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/625740e0-2602-472b-9a17-fd616cddb5fc-system-cni-dir\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.883352 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883131    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-sys\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.883352 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883146    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2bg8\" (UniqueName: \"kubernetes.io/projected/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-kube-api-access-x2bg8\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.883352 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883163    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-cnibin\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.883352 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883181    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be523a77-0668-4774-9cdb-e16840e092db-cni-binary-copy\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.883352 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883218    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-multus-conf-dir\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.883352 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883237    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-etc-sysconfig\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.883352 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883270    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/359c98c1-dd84-40d6-8870-8527096cf0bf-etc-selinux\") pod \"aws-ebs-csi-driver-node-n98g7\" (UID: \"359c98c1-dd84-40d6-8870-8527096cf0bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7"
Jul 15 23:29:39.883352 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883294    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/49685317-16b6-4fc9-be9d-30b2f82d1967-serviceca\") pod \"node-ca-t8kxt\" (UID: \"49685317-16b6-4fc9-be9d-30b2f82d1967\") " pod="openshift-image-registry/node-ca-t8kxt"
Jul 15 23:29:39.883352 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883317    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-host-run-k8s-cni-cncf-io\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.883352 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883342    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-host-var-lib-kubelet\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.883807 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883371    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/625740e0-2602-472b-9a17-fd616cddb5fc-cni-binary-copy\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.883807 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883406    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/625740e0-2602-472b-9a17-fd616cddb5fc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.883807 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883430    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-run\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.883807 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883453    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-hostroot\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.883807 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883503    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlq52\" (UniqueName: \"kubernetes.io/projected/625740e0-2602-472b-9a17-fd616cddb5fc-kube-api-access-tlq52\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.883807 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883532    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rptgb\""
Jul 15 23:29:39.883807 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883544    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 23:29:39.883807 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883565    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 23:29:39.883807 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883544    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-host-run-multus-certs\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.883807 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883604    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/625740e0-2602-472b-9a17-fd616cddb5fc-os-release\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.883807 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883628    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-etc-modprobe-d\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.883807 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883667    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-host\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.883807 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883704    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpmcx\" (UniqueName: \"kubernetes.io/projected/359c98c1-dd84-40d6-8870-8527096cf0bf-kube-api-access-mpmcx\") pod \"aws-ebs-csi-driver-node-n98g7\" (UID: \"359c98c1-dd84-40d6-8870-8527096cf0bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7"
Jul 15 23:29:39.883807 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883729    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd52k\" (UniqueName: \"kubernetes.io/projected/469dc602-e468-466b-84e4-3504671a58c2-kube-api-access-zd52k\") pod \"network-metrics-daemon-v68p6\" (UID: \"469dc602-e468-466b-84e4-3504671a58c2\") " pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:29:39.883807 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883771    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-multus-cni-dir\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.883807 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883799    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-etc-systemd\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.884856 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883833    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-host-var-lib-cni-bin\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.884856 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883859    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a55589e7-52fd-489d-8f5f-528d0e99b6df-host-slash\") pod \"iptables-alerter-gxbgz\" (UID: \"a55589e7-52fd-489d-8f5f-528d0e99b6df\") " pod="openshift-network-operator/iptables-alerter-gxbgz"
Jul 15 23:29:39.884856 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883899    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs\") pod \"network-metrics-daemon-v68p6\" (UID: \"469dc602-e468-466b-84e4-3504671a58c2\") " pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:29:39.884856 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883943    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a55589e7-52fd-489d-8f5f-528d0e99b6df-iptables-alerter-script\") pod \"iptables-alerter-gxbgz\" (UID: \"a55589e7-52fd-489d-8f5f-528d0e99b6df\") " pod="openshift-network-operator/iptables-alerter-gxbgz"
Jul 15 23:29:39.884856 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.883970    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-etc-kubernetes\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.884856 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.884010    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r954\" (UniqueName: \"kubernetes.io/projected/a55589e7-52fd-489d-8f5f-528d0e99b6df-kube-api-access-8r954\") pod \"iptables-alerter-gxbgz\" (UID: \"a55589e7-52fd-489d-8f5f-528d0e99b6df\") " pod="openshift-network-operator/iptables-alerter-gxbgz"
Jul 15 23:29:39.884856 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.884044    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-etc-kubernetes\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.884856 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.884071    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcjv6\" (UniqueName: \"kubernetes.io/projected/be523a77-0668-4774-9cdb-e16840e092db-kube-api-access-xcjv6\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.884856 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.884096    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zccfn\" (UniqueName: \"kubernetes.io/projected/49685317-16b6-4fc9-be9d-30b2f82d1967-kube-api-access-zccfn\") pod \"node-ca-t8kxt\" (UID: \"49685317-16b6-4fc9-be9d-30b2f82d1967\") " pod="openshift-image-registry/node-ca-t8kxt"
Jul 15 23:29:39.884856 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.884120    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-var-lib-kubelet\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.884856 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.884155    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-etc-tuned\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.884856 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.884201    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/359c98c1-dd84-40d6-8870-8527096cf0bf-registration-dir\") pod \"aws-ebs-csi-driver-node-n98g7\" (UID: \"359c98c1-dd84-40d6-8870-8527096cf0bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7"
Jul 15 23:29:39.884856 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.884229    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/625740e0-2602-472b-9a17-fd616cddb5fc-cnibin\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.884856 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.884293    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/625740e0-2602-472b-9a17-fd616cddb5fc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.884856 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.884336    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49685317-16b6-4fc9-be9d-30b2f82d1967-host\") pod \"node-ca-t8kxt\" (UID: \"49685317-16b6-4fc9-be9d-30b2f82d1967\") " pod="openshift-image-registry/node-ca-t8kxt"
Jul 15 23:29:39.884856 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.884387    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-tmp\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.885862 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.884432    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/359c98c1-dd84-40d6-8870-8527096cf0bf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n98g7\" (UID: \"359c98c1-dd84-40d6-8870-8527096cf0bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7"
Jul 15 23:29:39.885862 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.884459    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/359c98c1-dd84-40d6-8870-8527096cf0bf-device-dir\") pod \"aws-ebs-csi-driver-node-n98g7\" (UID: \"359c98c1-dd84-40d6-8870-8527096cf0bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7"
Jul 15 23:29:39.885862 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.884502    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-host-var-lib-cni-multus\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.885862 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.884506    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:39.885862 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:39.884590    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9w89" podUID="943763e4-c636-494b-ac1f-b63c8e43a744"
Jul 15 23:29:39.900702 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.900683    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ws2sp"
Jul 15 23:29:39.909072 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.909051    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ws2sp"
Jul 15 23:29:39.969245 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.969224    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 23:29:39.970146 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.970080    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-22.ec2.internal" event={"ID":"a5413ecf371cffe8dd9dab2a6b7557f0","Type":"ContainerStarted","Data":"64df40f470be18f0ec32b3ceb2e762389a9439e6530219381c51f183afcb90d8"}
Jul 15 23:29:39.971531 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.971506    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal" event={"ID":"d6cfd89dbca2154f100ae43766bc3db3","Type":"ContainerStarted","Data":"f179b0cf7ace314397e2bcfa37615b47123d10be992a3f643dbd4ae2b19619b9"}
Jul 15 23:29:39.984982 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.984954    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/49685317-16b6-4fc9-be9d-30b2f82d1967-serviceca\") pod \"node-ca-t8kxt\" (UID: \"49685317-16b6-4fc9-be9d-30b2f82d1967\") " pod="openshift-image-registry/node-ca-t8kxt"
Jul 15 23:29:39.985088 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.984995    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-host-run-k8s-cni-cncf-io\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.985088 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985025    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-host-var-lib-kubelet\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.985275 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985091    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-host-var-lib-kubelet\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.985275 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985096    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-host-run-k8s-cni-cncf-io\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.985275 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985126    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/625740e0-2602-472b-9a17-fd616cddb5fc-cni-binary-copy\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.985275 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985153    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/625740e0-2602-472b-9a17-fd616cddb5fc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.985275 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985183    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlf7v\" (UniqueName: \"kubernetes.io/projected/9c1eb0ec-907d-4e1b-9397-0336edac638d-kube-api-access-mlf7v\") pod \"node-resolver-h4fg7\" (UID: \"9c1eb0ec-907d-4e1b-9397-0336edac638d\") " pod="openshift-dns/node-resolver-h4fg7"
Jul 15 23:29:39.985275 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985207    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/943763e4-c636-494b-ac1f-b63c8e43a744-kubelet-config\") pod \"global-pull-secret-syncer-s9w89\" (UID: \"943763e4-c636-494b-ac1f-b63c8e43a744\") " pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:39.985275 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985231    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-run\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.985275 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985253    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-hostroot\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.985699 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985294    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlq52\" (UniqueName: \"kubernetes.io/projected/625740e0-2602-472b-9a17-fd616cddb5fc-kube-api-access-tlq52\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.985699 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985318    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-run-systemd\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:39.985699 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985343    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2678ca67-7c8a-42d0-a4fc-99b257a177a5-ovnkube-script-lib\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:39.985699 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-host-run-multus-certs\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.985699 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985400    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/625740e0-2602-472b-9a17-fd616cddb5fc-os-release\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.985699 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985444    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-node-log\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:39.985699 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985469    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-etc-modprobe-d\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.985699 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985492    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-host\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.985699 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985516    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpmcx\" (UniqueName: \"kubernetes.io/projected/359c98c1-dd84-40d6-8870-8527096cf0bf-kube-api-access-mpmcx\") pod \"aws-ebs-csi-driver-node-n98g7\" (UID: \"359c98c1-dd84-40d6-8870-8527096cf0bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7"
Jul 15 23:29:39.985699 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985536    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-hostroot\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.985699 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985540    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd52k\" (UniqueName: \"kubernetes.io/projected/469dc602-e468-466b-84e4-3504671a58c2-kube-api-access-zd52k\") pod \"network-metrics-daemon-v68p6\" (UID: \"469dc602-e468-466b-84e4-3504671a58c2\") " pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:29:39.985699 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985583    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-multus-cni-dir\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.985699 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985601    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/49685317-16b6-4fc9-be9d-30b2f82d1967-serviceca\") pod \"node-ca-t8kxt\" (UID: \"49685317-16b6-4fc9-be9d-30b2f82d1967\") " pod="openshift-image-registry/node-ca-t8kxt"
Jul 15 23:29:39.985699 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985614    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-run-ovn\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:39.985699 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985644    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-host-cni-netd\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:39.985699 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985683    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-etc-systemd\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.986483 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985707    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-multus-cni-dir\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.986483 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985738    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/625740e0-2602-472b-9a17-fd616cddb5fc-cni-binary-copy\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.986483 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985755    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-host-var-lib-cni-bin\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.986483 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985764    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-host-run-multus-certs\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.986483 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985809    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/625740e0-2602-472b-9a17-fd616cddb5fc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.986483 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985816    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-etc-systemd\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.986483 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985845    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-host-kubelet\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:39.986483 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985871    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-host\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.986483 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985889    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-etc-modprobe-d\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.986483 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985896    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-host-run-ovn-kubernetes\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:39.986483 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985909    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-host-var-lib-cni-bin\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.986483 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985923    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/625740e0-2602-472b-9a17-fd616cddb5fc-os-release\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.986483 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.985942    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2678ca67-7c8a-42d0-a4fc-99b257a177a5-env-overrides\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:39.986483 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.986169    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a55589e7-52fd-489d-8f5f-528d0e99b6df-host-slash\") pod \"iptables-alerter-gxbgz\" (UID: \"a55589e7-52fd-489d-8f5f-528d0e99b6df\") " pod="openshift-network-operator/iptables-alerter-gxbgz"
Jul 15 23:29:39.987166 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.986607    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-run\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.987166 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.986688    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a55589e7-52fd-489d-8f5f-528d0e99b6df-host-slash\") pod \"iptables-alerter-gxbgz\" (UID: \"a55589e7-52fd-489d-8f5f-528d0e99b6df\") " pod="openshift-network-operator/iptables-alerter-gxbgz"
Jul 15 23:29:39.987166 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.986720    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs\") pod \"network-metrics-daemon-v68p6\" (UID: \"469dc602-e468-466b-84e4-3504671a58c2\") " pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:29:39.987166 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.986758    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-run-openvswitch\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:39.987166 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.986783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-log-socket\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:39.987166 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.986816    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9c1eb0ec-907d-4e1b-9397-0336edac638d-hosts-file\") pod \"node-resolver-h4fg7\" (UID: \"9c1eb0ec-907d-4e1b-9397-0336edac638d\") " pod="openshift-dns/node-resolver-h4fg7"
Jul 15 23:29:39.987166 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.986844    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a55589e7-52fd-489d-8f5f-528d0e99b6df-iptables-alerter-script\") pod \"iptables-alerter-gxbgz\" (UID: \"a55589e7-52fd-489d-8f5f-528d0e99b6df\") " pod="openshift-network-operator/iptables-alerter-gxbgz"
Jul 15 23:29:39.987166 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.986876    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-host-run-netns\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:39.987166 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:39.986893    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:29:39.987166 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.986901    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c1eb0ec-907d-4e1b-9397-0336edac638d-tmp-dir\") pod \"node-resolver-h4fg7\" (UID: \"9c1eb0ec-907d-4e1b-9397-0336edac638d\") " pod="openshift-dns/node-resolver-h4fg7"
Jul 15 23:29:39.987166 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.986927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-etc-kubernetes\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.987166 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:39.986958    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs podName:469dc602-e468-466b-84e4-3504671a58c2 nodeName:}" failed. No retries permitted until 2026-07-15 23:29:40.486936447 +0000 UTC m=+3.030658783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs") pod "network-metrics-daemon-v68p6" (UID: "469dc602-e468-466b-84e4-3504671a58c2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:29:39.987166 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.986985    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-etc-kubernetes\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.987166 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.986989    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r954\" (UniqueName: \"kubernetes.io/projected/a55589e7-52fd-489d-8f5f-528d0e99b6df-kube-api-access-8r954\") pod \"iptables-alerter-gxbgz\" (UID: \"a55589e7-52fd-489d-8f5f-528d0e99b6df\") " pod="openshift-network-operator/iptables-alerter-gxbgz"
Jul 15 23:29:39.987166 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.987023    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-etc-kubernetes\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.987166 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.987053    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcjv6\" (UniqueName: \"kubernetes.io/projected/be523a77-0668-4774-9cdb-e16840e092db-kube-api-access-xcjv6\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.987166 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.987081    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzhhr\" (UniqueName: \"kubernetes.io/projected/2678ca67-7c8a-42d0-a4fc-99b257a177a5-kube-api-access-xzhhr\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:39.987996 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.987107    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zccfn\" (UniqueName: \"kubernetes.io/projected/49685317-16b6-4fc9-be9d-30b2f82d1967-kube-api-access-zccfn\") pod \"node-ca-t8kxt\" (UID: \"49685317-16b6-4fc9-be9d-30b2f82d1967\") " pod="openshift-image-registry/node-ca-t8kxt"
Jul 15 23:29:39.987996 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.987133    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-var-lib-kubelet\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.987996 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.987157    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-etc-tuned\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.987996 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.987192    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/359c98c1-dd84-40d6-8870-8527096cf0bf-registration-dir\") pod \"aws-ebs-csi-driver-node-n98g7\" (UID: \"359c98c1-dd84-40d6-8870-8527096cf0bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7"
Jul 15 23:29:39.987996 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.987216    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/625740e0-2602-472b-9a17-fd616cddb5fc-cnibin\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.987996 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.987272    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/625740e0-2602-472b-9a17-fd616cddb5fc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.987996 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.987298    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-systemd-units\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:39.987996 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.987398    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-var-lib-kubelet\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.987996 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.987408    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a55589e7-52fd-489d-8f5f-528d0e99b6df-iptables-alerter-script\") pod \"iptables-alerter-gxbgz\" (UID: \"a55589e7-52fd-489d-8f5f-528d0e99b6df\") " pod="openshift-network-operator/iptables-alerter-gxbgz"
Jul 15 23:29:39.988440 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.988417    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-etc-kubernetes\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.988662 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.988635    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49685317-16b6-4fc9-be9d-30b2f82d1967-host\") pod \"node-ca-t8kxt\" (UID: \"49685317-16b6-4fc9-be9d-30b2f82d1967\") " pod="openshift-image-registry/node-ca-t8kxt"
Jul 15 23:29:39.988743 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.988682    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-tmp\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.988743 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.988714    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/359c98c1-dd84-40d6-8870-8527096cf0bf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n98g7\" (UID: \"359c98c1-dd84-40d6-8870-8527096cf0bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7"
Jul 15 23:29:39.988831 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.988742    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/359c98c1-dd84-40d6-8870-8527096cf0bf-device-dir\") pod \"aws-ebs-csi-driver-node-n98g7\" (UID: \"359c98c1-dd84-40d6-8870-8527096cf0bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7"
Jul 15 23:29:39.988831 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.988772    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-host-var-lib-cni-multus\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.988831 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.988806    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1664a246-dfb4-41f9-b051-19dbbd5a4781-agent-certs\") pod \"konnectivity-agent-wg4tf\" (UID: \"1664a246-dfb4-41f9-b051-19dbbd5a4781\") " pod="kube-system/konnectivity-agent-wg4tf"
Jul 15 23:29:39.988939 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.988837    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-host-cni-bin\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:39.988939 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.988862    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-etc-sysctl-d\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.988939 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.988893    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/359c98c1-dd84-40d6-8870-8527096cf0bf-socket-dir\") pod \"aws-ebs-csi-driver-node-n98g7\" (UID: \"359c98c1-dd84-40d6-8870-8527096cf0bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7"
Jul 15 23:29:39.988939 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.988923    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-host-run-netns\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.989084 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.988955    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-host-slash\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:39.989084 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.988938    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 23:29:39.989084 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.988988    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-var-lib-openvswitch\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:39.989203 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.989087    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:39.989203 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.989121    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-lib-modules\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.989203 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.989152    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/359c98c1-dd84-40d6-8870-8527096cf0bf-sys-fs\") pod \"aws-ebs-csi-driver-node-n98g7\" (UID: \"359c98c1-dd84-40d6-8870-8527096cf0bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7"
Jul 15 23:29:39.989203 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.989182    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-os-release\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.989433 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.989218    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be523a77-0668-4774-9cdb-e16840e092db-multus-daemon-config\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.989433 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.989343    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/625740e0-2602-472b-9a17-fd616cddb5fc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.989433 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.989377    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1664a246-dfb4-41f9-b051-19dbbd5a4781-konnectivity-ca\") pod \"konnectivity-agent-wg4tf\" (UID: \"1664a246-dfb4-41f9-b051-19dbbd5a4781\") " pod="kube-system/konnectivity-agent-wg4tf"
Jul 15 23:29:39.989433 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.989422    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/943763e4-c636-494b-ac1f-b63c8e43a744-dbus\") pod \"global-pull-secret-syncer-s9w89\" (UID: \"943763e4-c636-494b-ac1f-b63c8e43a744\") " pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:39.989664 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.989455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-etc-sysctl-conf\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.989664 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.989544    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-system-cni-dir\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.989664 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.989574    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-multus-socket-dir-parent\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.989664 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.989590    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/625740e0-2602-472b-9a17-fd616cddb5fc-cnibin\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.989664 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.989652    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/625740e0-2602-472b-9a17-fd616cddb5fc-system-cni-dir\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.989875 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.989719    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-etc-openvswitch\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:39.989875 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.989807    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2678ca67-7c8a-42d0-a4fc-99b257a177a5-ovnkube-config\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:39.989875 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.989835    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2678ca67-7c8a-42d0-a4fc-99b257a177a5-ovn-node-metrics-cert\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:39.990031 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.989922    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-sys\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.990031 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.989951    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2bg8\" (UniqueName: \"kubernetes.io/projected/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-kube-api-access-x2bg8\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.990031 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.990005    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-cnibin\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.990190 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.990034    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be523a77-0668-4774-9cdb-e16840e092db-cni-binary-copy\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.990190 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.990063    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-multus-conf-dir\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.990190 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.990086    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/625740e0-2602-472b-9a17-fd616cddb5fc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.990190 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.990111    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-etc-sysconfig\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.990190 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.990136    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/359c98c1-dd84-40d6-8870-8527096cf0bf-etc-selinux\") pod \"aws-ebs-csi-driver-node-n98g7\" (UID: \"359c98c1-dd84-40d6-8870-8527096cf0bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7"
Jul 15 23:29:39.990440 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.990197    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret\") pod \"global-pull-secret-syncer-s9w89\" (UID: \"943763e4-c636-494b-ac1f-b63c8e43a744\") " pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:39.990440 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.990227    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5x75\" (UniqueName: \"kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75\") pod \"network-check-target-9lphg\" (UID: \"a35cfa6e-c492-4a49-9002-5e2ba013c744\") " pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:29:39.990440 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.990436    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49685317-16b6-4fc9-be9d-30b2f82d1967-host\") pod \"node-ca-t8kxt\" (UID: \"49685317-16b6-4fc9-be9d-30b2f82d1967\") " pod="openshift-image-registry/node-ca-t8kxt"
Jul 15 23:29:39.991297 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.991273    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/359c98c1-dd84-40d6-8870-8527096cf0bf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n98g7\" (UID: \"359c98c1-dd84-40d6-8870-8527096cf0bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7"
Jul 15 23:29:39.991395 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.991366    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/359c98c1-dd84-40d6-8870-8527096cf0bf-device-dir\") pod \"aws-ebs-csi-driver-node-n98g7\" (UID: \"359c98c1-dd84-40d6-8870-8527096cf0bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7"
Jul 15 23:29:39.991462 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.991406    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-host-var-lib-cni-multus\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.991547 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.991531    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-etc-sysctl-d\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.991652 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.991635    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/359c98c1-dd84-40d6-8870-8527096cf0bf-socket-dir\") pod \"aws-ebs-csi-driver-node-n98g7\" (UID: \"359c98c1-dd84-40d6-8870-8527096cf0bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7"
Jul 15 23:29:39.991716 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.991691    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-host-run-netns\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.991885 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.991869    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-lib-modules\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.991950 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.991917    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/359c98c1-dd84-40d6-8870-8527096cf0bf-sys-fs\") pod \"aws-ebs-csi-driver-node-n98g7\" (UID: \"359c98c1-dd84-40d6-8870-8527096cf0bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7"
Jul 15 23:29:39.992005 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.991993    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-os-release\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.992545 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.992523    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-system-cni-dir\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.992714 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.992666    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be523a77-0668-4774-9cdb-e16840e092db-multus-daemon-config\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.992808 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.992791    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-multus-socket-dir-parent\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.992886 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.992870    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-sys\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.992946 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.992878    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/625740e0-2602-472b-9a17-fd616cddb5fc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.993062 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.993045    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-cnibin\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.993284 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.993262    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/359c98c1-dd84-40d6-8870-8527096cf0bf-etc-selinux\") pod \"aws-ebs-csi-driver-node-n98g7\" (UID: \"359c98c1-dd84-40d6-8870-8527096cf0bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7"
Jul 15 23:29:39.993407 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.993388    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-etc-sysconfig\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.993469 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.992697    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-etc-sysctl-conf\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.993537 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.993475    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/625740e0-2602-472b-9a17-fd616cddb5fc-system-cni-dir\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:39.995175 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.989494    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/359c98c1-dd84-40d6-8870-8527096cf0bf-registration-dir\") pod \"aws-ebs-csi-driver-node-n98g7\" (UID: \"359c98c1-dd84-40d6-8870-8527096cf0bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7"
Jul 15 23:29:39.995175 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.993554    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be523a77-0668-4774-9cdb-e16840e092db-multus-conf-dir\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.995175 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.993648    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be523a77-0668-4774-9cdb-e16840e092db-cni-binary-copy\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:39.995175 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.994019    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-tmp\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:39.995175 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:39.994667    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-etc-tuned\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:40.001027 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.000962    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpmcx\" (UniqueName: \"kubernetes.io/projected/359c98c1-dd84-40d6-8870-8527096cf0bf-kube-api-access-mpmcx\") pod \"aws-ebs-csi-driver-node-n98g7\" (UID: \"359c98c1-dd84-40d6-8870-8527096cf0bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7"
Jul 15 23:29:40.001243 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.001199    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlq52\" (UniqueName: \"kubernetes.io/projected/625740e0-2602-472b-9a17-fd616cddb5fc-kube-api-access-tlq52\") pod \"multus-additional-cni-plugins-xn8nk\" (UID: \"625740e0-2602-472b-9a17-fd616cddb5fc\") " pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:40.001681 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.001657    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r954\" (UniqueName: \"kubernetes.io/projected/a55589e7-52fd-489d-8f5f-528d0e99b6df-kube-api-access-8r954\") pod \"iptables-alerter-gxbgz\" (UID: \"a55589e7-52fd-489d-8f5f-528d0e99b6df\") " pod="openshift-network-operator/iptables-alerter-gxbgz"
Jul 15 23:29:40.002739 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.002670    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd52k\" (UniqueName: \"kubernetes.io/projected/469dc602-e468-466b-84e4-3504671a58c2-kube-api-access-zd52k\") pod \"network-metrics-daemon-v68p6\" (UID: \"469dc602-e468-466b-84e4-3504671a58c2\") " pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:29:40.003986 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.003965    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zccfn\" (UniqueName: \"kubernetes.io/projected/49685317-16b6-4fc9-be9d-30b2f82d1967-kube-api-access-zccfn\") pod \"node-ca-t8kxt\" (UID: \"49685317-16b6-4fc9-be9d-30b2f82d1967\") " pod="openshift-image-registry/node-ca-t8kxt"
Jul 15 23:29:40.010214 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.010170    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2bg8\" (UniqueName: \"kubernetes.io/projected/f8f1efea-c69f-418a-a3ce-37b94ec82e7e-kube-api-access-x2bg8\") pod \"tuned-9lbbs\" (UID: \"f8f1efea-c69f-418a-a3ce-37b94ec82e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:40.010725 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.010702    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcjv6\" (UniqueName: \"kubernetes.io/projected/be523a77-0668-4774-9cdb-e16840e092db-kube-api-access-xcjv6\") pod \"multus-jbldt\" (UID: \"be523a77-0668-4774-9cdb-e16840e092db\") " pod="openshift-multus/multus-jbldt"
Jul 15 23:29:40.092304 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091256    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-host-slash\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092304 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091300    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-var-lib-openvswitch\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092304 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091330    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092304 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091359    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1664a246-dfb4-41f9-b051-19dbbd5a4781-konnectivity-ca\") pod \"konnectivity-agent-wg4tf\" (UID: \"1664a246-dfb4-41f9-b051-19dbbd5a4781\") " pod="kube-system/konnectivity-agent-wg4tf"
Jul 15 23:29:40.092304 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091383    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/943763e4-c636-494b-ac1f-b63c8e43a744-dbus\") pod \"global-pull-secret-syncer-s9w89\" (UID: \"943763e4-c636-494b-ac1f-b63c8e43a744\") " pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:40.092304 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091410    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-etc-openvswitch\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092304 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091434    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2678ca67-7c8a-42d0-a4fc-99b257a177a5-ovnkube-config\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092304 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091468    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2678ca67-7c8a-42d0-a4fc-99b257a177a5-ovn-node-metrics-cert\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092304 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091491    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret\") pod \"global-pull-secret-syncer-s9w89\" (UID: \"943763e4-c636-494b-ac1f-b63c8e43a744\") " pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:40.092304 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091506    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5x75\" (UniqueName: \"kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75\") pod \"network-check-target-9lphg\" (UID: \"a35cfa6e-c492-4a49-9002-5e2ba013c744\") " pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:29:40.092304 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091530    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlf7v\" (UniqueName: \"kubernetes.io/projected/9c1eb0ec-907d-4e1b-9397-0336edac638d-kube-api-access-mlf7v\") pod \"node-resolver-h4fg7\" (UID: \"9c1eb0ec-907d-4e1b-9397-0336edac638d\") " pod="openshift-dns/node-resolver-h4fg7"
Jul 15 23:29:40.092304 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091546    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/943763e4-c636-494b-ac1f-b63c8e43a744-kubelet-config\") pod \"global-pull-secret-syncer-s9w89\" (UID: \"943763e4-c636-494b-ac1f-b63c8e43a744\") " pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:40.092304 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091564    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-run-systemd\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092304 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091580    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2678ca67-7c8a-42d0-a4fc-99b257a177a5-ovnkube-script-lib\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092304 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091597    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-node-log\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092304 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091693    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-run-ovn\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092304 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091695    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092986 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091725    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-host-cni-netd\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092986 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091772    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-host-kubelet\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092986 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091777    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/943763e4-c636-494b-ac1f-b63c8e43a744-dbus\") pod \"global-pull-secret-syncer-s9w89\" (UID: \"943763e4-c636-494b-ac1f-b63c8e43a744\") " pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:40.092986 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091797    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-host-run-ovn-kubernetes\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092986 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091821    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2678ca67-7c8a-42d0-a4fc-99b257a177a5-env-overrides\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092986 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091834    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-etc-openvswitch\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092986 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091869    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-run-openvswitch\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092986 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091887    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-node-log\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092986 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091893    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-log-socket\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092986 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091913    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9c1eb0ec-907d-4e1b-9397-0336edac638d-hosts-file\") pod \"node-resolver-h4fg7\" (UID: \"9c1eb0ec-907d-4e1b-9397-0336edac638d\") " pod="openshift-dns/node-resolver-h4fg7"
Jul 15 23:29:40.092986 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091930    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-host-run-netns\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092986 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c1eb0ec-907d-4e1b-9397-0336edac638d-tmp-dir\") pod \"node-resolver-h4fg7\" (UID: \"9c1eb0ec-907d-4e1b-9397-0336edac638d\") " pod="openshift-dns/node-resolver-h4fg7"
Jul 15 23:29:40.092986 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091977    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzhhr\" (UniqueName: \"kubernetes.io/projected/2678ca67-7c8a-42d0-a4fc-99b257a177a5-kube-api-access-xzhhr\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092986 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091996    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-systemd-units\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092986 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.092016    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1664a246-dfb4-41f9-b051-19dbbd5a4781-agent-certs\") pod \"konnectivity-agent-wg4tf\" (UID: \"1664a246-dfb4-41f9-b051-19dbbd5a4781\") " pod="kube-system/konnectivity-agent-wg4tf"
Jul 15 23:29:40.092986 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.092032    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-host-cni-bin\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092986 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.092089    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-host-cni-bin\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.092986 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.092123    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-run-ovn\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.093904 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091689    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-var-lib-openvswitch\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.093904 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.092162    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-host-cni-netd\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.093904 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.091725    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-host-slash\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.093904 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.092200    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-host-kubelet\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.093904 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.092255    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-host-run-ovn-kubernetes\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.093904 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.092313    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2678ca67-7c8a-42d0-a4fc-99b257a177a5-ovnkube-config\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.093904 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.092375    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-run-systemd\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.093904 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.092372    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/943763e4-c636-494b-ac1f-b63c8e43a744-kubelet-config\") pod \"global-pull-secret-syncer-s9w89\" (UID: \"943763e4-c636-494b-ac1f-b63c8e43a744\") " pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:40.093904 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.092314    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1664a246-dfb4-41f9-b051-19dbbd5a4781-konnectivity-ca\") pod \"konnectivity-agent-wg4tf\" (UID: \"1664a246-dfb4-41f9-b051-19dbbd5a4781\") " pod="kube-system/konnectivity-agent-wg4tf"
Jul 15 23:29:40.093904 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.092438    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-log-socket\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.093904 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.092442    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-host-run-netns\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.093904 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.092486    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-run-openvswitch\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.093904 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.092501    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9c1eb0ec-907d-4e1b-9397-0336edac638d-hosts-file\") pod \"node-resolver-h4fg7\" (UID: \"9c1eb0ec-907d-4e1b-9397-0336edac638d\") " pod="openshift-dns/node-resolver-h4fg7"
Jul 15 23:29:40.093904 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:40.092508    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 23:29:40.093904 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:40.092571    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret podName:943763e4-c636-494b-ac1f-b63c8e43a744 nodeName:}" failed. No retries permitted until 2026-07-15 23:29:40.592553163 +0000 UTC m=+3.136275499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret") pod "global-pull-secret-syncer-s9w89" (UID: "943763e4-c636-494b-ac1f-b63c8e43a744") : object "kube-system"/"original-pull-secret" not registered
Jul 15 23:29:40.093904 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.092601    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2678ca67-7c8a-42d0-a4fc-99b257a177a5-systemd-units\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.093904 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.092646    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2678ca67-7c8a-42d0-a4fc-99b257a177a5-env-overrides\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.094797 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.093087    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c1eb0ec-907d-4e1b-9397-0336edac638d-tmp-dir\") pod \"node-resolver-h4fg7\" (UID: \"9c1eb0ec-907d-4e1b-9397-0336edac638d\") " pod="openshift-dns/node-resolver-h4fg7"
Jul 15 23:29:40.094797 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.093088    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2678ca67-7c8a-42d0-a4fc-99b257a177a5-ovnkube-script-lib\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.095050 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.095028    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2678ca67-7c8a-42d0-a4fc-99b257a177a5-ovn-node-metrics-cert\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.095488 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.095465    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1664a246-dfb4-41f9-b051-19dbbd5a4781-agent-certs\") pod \"konnectivity-agent-wg4tf\" (UID: \"1664a246-dfb4-41f9-b051-19dbbd5a4781\") " pod="kube-system/konnectivity-agent-wg4tf"
Jul 15 23:29:40.102546 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:40.102469    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 23:29:40.102546 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:40.102495    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 23:29:40.102546 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:40.102510    2576 projected.go:196] Error preparing data for projected volume kube-api-access-r5x75 for pod openshift-network-diagnostics/network-check-target-9lphg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:29:40.102742 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:40.102574    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75 podName:a35cfa6e-c492-4a49-9002-5e2ba013c744 nodeName:}" failed. No retries permitted until 2026-07-15 23:29:40.60255721 +0000 UTC m=+3.146279551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r5x75" (UniqueName: "kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75") pod "network-check-target-9lphg" (UID: "a35cfa6e-c492-4a49-9002-5e2ba013c744") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:29:40.106298 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.106247    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzhhr\" (UniqueName: \"kubernetes.io/projected/2678ca67-7c8a-42d0-a4fc-99b257a177a5-kube-api-access-xzhhr\") pod \"ovnkube-node-2wsc4\" (UID: \"2678ca67-7c8a-42d0-a4fc-99b257a177a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.106570 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.106550    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlf7v\" (UniqueName: \"kubernetes.io/projected/9c1eb0ec-907d-4e1b-9397-0336edac638d-kube-api-access-mlf7v\") pod \"node-resolver-h4fg7\" (UID: \"9c1eb0ec-907d-4e1b-9397-0336edac638d\") " pod="openshift-dns/node-resolver-h4fg7"
Jul 15 23:29:40.166663 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.166641    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t8kxt"
Jul 15 23:29:40.173420 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.173397    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jbldt"
Jul 15 23:29:40.179346 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:40.179319    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49685317_16b6_4fc9_be9d_30b2f82d1967.slice/crio-a7462521abb891f0cbcb6cdfad75c0548e1ee32071c0a66a1237061dd9592650 WatchSource:0}: Error finding container a7462521abb891f0cbcb6cdfad75c0548e1ee32071c0a66a1237061dd9592650: Status 404 returned error can't find the container with id a7462521abb891f0cbcb6cdfad75c0548e1ee32071c0a66a1237061dd9592650
Jul 15 23:29:40.183334 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.183133    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9lbbs"
Jul 15 23:29:40.186585 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:40.186128    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe523a77_0668_4774_9cdb_e16840e092db.slice/crio-a76f69aea8a48a0cbf19e44e732e45228afbd990113be19e41c6716f632ecf5c WatchSource:0}: Error finding container a76f69aea8a48a0cbf19e44e732e45228afbd990113be19e41c6716f632ecf5c: Status 404 returned error can't find the container with id a76f69aea8a48a0cbf19e44e732e45228afbd990113be19e41c6716f632ecf5c
Jul 15 23:29:40.189147 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.189127    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gxbgz"
Jul 15 23:29:40.195934 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:40.195910    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f1efea_c69f_418a_a3ce_37b94ec82e7e.slice/crio-f1535455472f31a34ebbe54277fa5ebe39b818b460902677fac7e99eae48a4e9 WatchSource:0}: Error finding container f1535455472f31a34ebbe54277fa5ebe39b818b460902677fac7e99eae48a4e9: Status 404 returned error can't find the container with id f1535455472f31a34ebbe54277fa5ebe39b818b460902677fac7e99eae48a4e9
Jul 15 23:29:40.197128 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.197106    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xn8nk"
Jul 15 23:29:40.206232 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.206208    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7"
Jul 15 23:29:40.208339 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:40.208292    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda55589e7_52fd_489d_8f5f_528d0e99b6df.slice/crio-813353bf65725cf17bb216004d987fb67a664947936519fb41f5b8dcf2670cf9 WatchSource:0}: Error finding container 813353bf65725cf17bb216004d987fb67a664947936519fb41f5b8dcf2670cf9: Status 404 returned error can't find the container with id 813353bf65725cf17bb216004d987fb67a664947936519fb41f5b8dcf2670cf9
Jul 15 23:29:40.213538 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.213514    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:29:40.218450 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:40.218418    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod359c98c1_dd84_40d6_8870_8527096cf0bf.slice/crio-c6e64c5c8c4fb258bb11085b83fb01671bdf023a50228f67cbc95be59de794d5 WatchSource:0}: Error finding container c6e64c5c8c4fb258bb11085b83fb01671bdf023a50228f67cbc95be59de794d5: Status 404 returned error can't find the container with id c6e64c5c8c4fb258bb11085b83fb01671bdf023a50228f67cbc95be59de794d5
Jul 15 23:29:40.221409 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.221388    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h4fg7"
Jul 15 23:29:40.223748 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:40.223725    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625740e0_2602_472b_9a17_fd616cddb5fc.slice/crio-9e737b42433e8c0a3053e8b02f8a468c5842a723a9cb15c3d59b892b72f3672d WatchSource:0}: Error finding container 9e737b42433e8c0a3053e8b02f8a468c5842a723a9cb15c3d59b892b72f3672d: Status 404 returned error can't find the container with id 9e737b42433e8c0a3053e8b02f8a468c5842a723a9cb15c3d59b892b72f3672d
Jul 15 23:29:40.226381 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:40.226347    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2678ca67_7c8a_42d0_a4fc_99b257a177a5.slice/crio-da24fbc8d2fecf4644f2d47cca3f3cd1e899f8d8a70caf74cf9c13250f31f318 WatchSource:0}: Error finding container da24fbc8d2fecf4644f2d47cca3f3cd1e899f8d8a70caf74cf9c13250f31f318: Status 404 returned error can't find the container with id da24fbc8d2fecf4644f2d47cca3f3cd1e899f8d8a70caf74cf9c13250f31f318
Jul 15 23:29:40.227392 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.227373    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wg4tf"
Jul 15 23:29:40.236029 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:40.236002    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c1eb0ec_907d_4e1b_9397_0336edac638d.slice/crio-9f149a40732a6c8ffe3944b045406d465ddc687fb68abbd0827bb80c8e1e0d51 WatchSource:0}: Error finding container 9f149a40732a6c8ffe3944b045406d465ddc687fb68abbd0827bb80c8e1e0d51: Status 404 returned error can't find the container with id 9f149a40732a6c8ffe3944b045406d465ddc687fb68abbd0827bb80c8e1e0d51
Jul 15 23:29:40.238917 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:29:40.238837    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1664a246_dfb4_41f9_b051_19dbbd5a4781.slice/crio-354d14095a735616563477a3c889f664d36109bd7c284628c3366d488521125d WatchSource:0}: Error finding container 354d14095a735616563477a3c889f664d36109bd7c284628c3366d488521125d: Status 404 returned error can't find the container with id 354d14095a735616563477a3c889f664d36109bd7c284628c3366d488521125d
Jul 15 23:29:40.269366 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.269346    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 23:29:40.495668 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.495630    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs\") pod \"network-metrics-daemon-v68p6\" (UID: \"469dc602-e468-466b-84e4-3504671a58c2\") " pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:29:40.495889 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:40.495800    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:29:40.495889 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:40.495887    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs podName:469dc602-e468-466b-84e4-3504671a58c2 nodeName:}" failed. No retries permitted until 2026-07-15 23:29:41.495864103 +0000 UTC m=+4.039586440 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs") pod "network-metrics-daemon-v68p6" (UID: "469dc602-e468-466b-84e4-3504671a58c2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:29:40.596373 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.596339    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret\") pod \"global-pull-secret-syncer-s9w89\" (UID: \"943763e4-c636-494b-ac1f-b63c8e43a744\") " pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:40.596556 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:40.596531    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 23:29:40.596627 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:40.596617    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret podName:943763e4-c636-494b-ac1f-b63c8e43a744 nodeName:}" failed. No retries permitted until 2026-07-15 23:29:41.596595196 +0000 UTC m=+4.140317536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret") pod "global-pull-secret-syncer-s9w89" (UID: "943763e4-c636-494b-ac1f-b63c8e43a744") : object "kube-system"/"original-pull-secret" not registered
Jul 15 23:29:40.697215 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.697187    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5x75\" (UniqueName: \"kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75\") pod \"network-check-target-9lphg\" (UID: \"a35cfa6e-c492-4a49-9002-5e2ba013c744\") " pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:29:40.697380 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:40.697361    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 23:29:40.697449 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:40.697385    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 23:29:40.697449 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:40.697395    2576 projected.go:196] Error preparing data for projected volume kube-api-access-r5x75 for pod openshift-network-diagnostics/network-check-target-9lphg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:29:40.697515 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:40.697450    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75 podName:a35cfa6e-c492-4a49-9002-5e2ba013c744 nodeName:}" failed. No retries permitted until 2026-07-15 23:29:41.697433663 +0000 UTC m=+4.241156015 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r5x75" (UniqueName: "kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75") pod "network-check-target-9lphg" (UID: "a35cfa6e-c492-4a49-9002-5e2ba013c744") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:29:40.912941 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.912856    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 23:24:40 +0000 UTC" deadline="2028-02-09 23:52:51.786409536 +0000 UTC"
Jul 15 23:29:40.912941 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.912898    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13776h23m10.873516911s"
Jul 15 23:29:40.964877 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.964842    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:40.965032 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:40.964990    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9w89" podUID="943763e4-c636-494b-ac1f-b63c8e43a744"
Jul 15 23:29:40.975935 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.975906    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jbldt" event={"ID":"be523a77-0668-4774-9cdb-e16840e092db","Type":"ContainerStarted","Data":"a76f69aea8a48a0cbf19e44e732e45228afbd990113be19e41c6716f632ecf5c"}
Jul 15 23:29:40.978355 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.978324    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wg4tf" event={"ID":"1664a246-dfb4-41f9-b051-19dbbd5a4781","Type":"ContainerStarted","Data":"354d14095a735616563477a3c889f664d36109bd7c284628c3366d488521125d"}
Jul 15 23:29:40.980403 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.980372    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xn8nk" event={"ID":"625740e0-2602-472b-9a17-fd616cddb5fc","Type":"ContainerStarted","Data":"9e737b42433e8c0a3053e8b02f8a468c5842a723a9cb15c3d59b892b72f3672d"}
Jul 15 23:29:40.981822 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.981768    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7" event={"ID":"359c98c1-dd84-40d6-8870-8527096cf0bf","Type":"ContainerStarted","Data":"c6e64c5c8c4fb258bb11085b83fb01671bdf023a50228f67cbc95be59de794d5"}
Jul 15 23:29:40.984123 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.984098    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9lbbs" event={"ID":"f8f1efea-c69f-418a-a3ce-37b94ec82e7e","Type":"ContainerStarted","Data":"f1535455472f31a34ebbe54277fa5ebe39b818b460902677fac7e99eae48a4e9"}
Jul 15 23:29:40.986547 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.986521    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t8kxt" event={"ID":"49685317-16b6-4fc9-be9d-30b2f82d1967","Type":"ContainerStarted","Data":"a7462521abb891f0cbcb6cdfad75c0548e1ee32071c0a66a1237061dd9592650"}
Jul 15 23:29:40.988641 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.988614    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h4fg7" event={"ID":"9c1eb0ec-907d-4e1b-9397-0336edac638d","Type":"ContainerStarted","Data":"9f149a40732a6c8ffe3944b045406d465ddc687fb68abbd0827bb80c8e1e0d51"}
Jul 15 23:29:40.990847 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.990820    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4" event={"ID":"2678ca67-7c8a-42d0-a4fc-99b257a177a5","Type":"ContainerStarted","Data":"da24fbc8d2fecf4644f2d47cca3f3cd1e899f8d8a70caf74cf9c13250f31f318"}
Jul 15 23:29:40.996855 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:40.996827    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gxbgz" event={"ID":"a55589e7-52fd-489d-8f5f-528d0e99b6df","Type":"ContainerStarted","Data":"813353bf65725cf17bb216004d987fb67a664947936519fb41f5b8dcf2670cf9"}
Jul 15 23:29:41.503895 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:41.503783    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs\") pod \"network-metrics-daemon-v68p6\" (UID: \"469dc602-e468-466b-84e4-3504671a58c2\") " pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:29:41.504099 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:41.503986    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:29:41.504099 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:41.504062    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs podName:469dc602-e468-466b-84e4-3504671a58c2 nodeName:}" failed. No retries permitted until 2026-07-15 23:29:43.504041709 +0000 UTC m=+6.047764048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs") pod "network-metrics-daemon-v68p6" (UID: "469dc602-e468-466b-84e4-3504671a58c2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:29:41.604636 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:41.604600    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret\") pod \"global-pull-secret-syncer-s9w89\" (UID: \"943763e4-c636-494b-ac1f-b63c8e43a744\") " pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:41.604821 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:41.604782    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 23:29:41.604898 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:41.604869    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret podName:943763e4-c636-494b-ac1f-b63c8e43a744 nodeName:}" failed. No retries permitted until 2026-07-15 23:29:43.60484634 +0000 UTC m=+6.148568696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret") pod "global-pull-secret-syncer-s9w89" (UID: "943763e4-c636-494b-ac1f-b63c8e43a744") : object "kube-system"/"original-pull-secret" not registered
Jul 15 23:29:41.705768 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:41.705729    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5x75\" (UniqueName: \"kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75\") pod \"network-check-target-9lphg\" (UID: \"a35cfa6e-c492-4a49-9002-5e2ba013c744\") " pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:29:41.705987 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:41.705964    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 23:29:41.706061 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:41.705997    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 23:29:41.706061 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:41.706011    2576 projected.go:196] Error preparing data for projected volume kube-api-access-r5x75 for pod openshift-network-diagnostics/network-check-target-9lphg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:29:41.706159 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:41.706073    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75 podName:a35cfa6e-c492-4a49-9002-5e2ba013c744 nodeName:}" failed. No retries permitted until 2026-07-15 23:29:43.70605226 +0000 UTC m=+6.249774597 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r5x75" (UniqueName: "kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75") pod "network-check-target-9lphg" (UID: "a35cfa6e-c492-4a49-9002-5e2ba013c744") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:29:41.913413 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:41.913339    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 23:24:40 +0000 UTC" deadline="2028-01-19 13:52:30.145617307 +0000 UTC"
Jul 15 23:29:41.913413 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:41.913380    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13262h22m48.232242369s"
Jul 15 23:29:41.971335 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:41.970696    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:29:41.971335 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:41.970875    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lphg" podUID="a35cfa6e-c492-4a49-9002-5e2ba013c744"
Jul 15 23:29:41.971943 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:41.970696    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:29:41.971943 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:41.971847    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v68p6" podUID="469dc602-e468-466b-84e4-3504671a58c2"
Jul 15 23:29:42.965100 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:42.964527    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:42.965100 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:42.964667    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9w89" podUID="943763e4-c636-494b-ac1f-b63c8e43a744"
Jul 15 23:29:43.523146 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:43.523109    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs\") pod \"network-metrics-daemon-v68p6\" (UID: \"469dc602-e468-466b-84e4-3504671a58c2\") " pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:29:43.523370 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:43.523257    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:29:43.523370 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:43.523344    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs podName:469dc602-e468-466b-84e4-3504671a58c2 nodeName:}" failed. No retries permitted until 2026-07-15 23:29:47.523323594 +0000 UTC m=+10.067045946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs") pod "network-metrics-daemon-v68p6" (UID: "469dc602-e468-466b-84e4-3504671a58c2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:29:43.624332 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:43.624268    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret\") pod \"global-pull-secret-syncer-s9w89\" (UID: \"943763e4-c636-494b-ac1f-b63c8e43a744\") " pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:43.624531 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:43.624508    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 23:29:43.624609 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:43.624579    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret podName:943763e4-c636-494b-ac1f-b63c8e43a744 nodeName:}" failed. No retries permitted until 2026-07-15 23:29:47.624560338 +0000 UTC m=+10.168282679 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret") pod "global-pull-secret-syncer-s9w89" (UID: "943763e4-c636-494b-ac1f-b63c8e43a744") : object "kube-system"/"original-pull-secret" not registered
Jul 15 23:29:43.725019 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:43.724977    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5x75\" (UniqueName: \"kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75\") pod \"network-check-target-9lphg\" (UID: \"a35cfa6e-c492-4a49-9002-5e2ba013c744\") " pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:29:43.725203 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:43.725184    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 23:29:43.725265 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:43.725205    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 23:29:43.725265 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:43.725219    2576 projected.go:196] Error preparing data for projected volume kube-api-access-r5x75 for pod openshift-network-diagnostics/network-check-target-9lphg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:29:43.725402 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:43.725296    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75 podName:a35cfa6e-c492-4a49-9002-5e2ba013c744 nodeName:}" failed. No retries permitted until 2026-07-15 23:29:47.725259907 +0000 UTC m=+10.268982255 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r5x75" (UniqueName: "kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75") pod "network-check-target-9lphg" (UID: "a35cfa6e-c492-4a49-9002-5e2ba013c744") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:29:43.967116 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:43.967034    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:29:43.967606 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:43.967177    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lphg" podUID="a35cfa6e-c492-4a49-9002-5e2ba013c744"
Jul 15 23:29:43.967719 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:43.967618    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:29:43.967790 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:43.967740    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v68p6" podUID="469dc602-e468-466b-84e4-3504671a58c2"
Jul 15 23:29:44.964766 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:44.964687    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:44.964932 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:44.964795    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9w89" podUID="943763e4-c636-494b-ac1f-b63c8e43a744"
Jul 15 23:29:45.964632 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:45.964591    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:29:45.965120 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:45.964726    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lphg" podUID="a35cfa6e-c492-4a49-9002-5e2ba013c744"
Jul 15 23:29:45.965183 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:45.965139    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:29:45.965277 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:45.965250    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v68p6" podUID="469dc602-e468-466b-84e4-3504671a58c2"
Jul 15 23:29:46.965783 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:46.965316    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:46.965783 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:46.965439    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9w89" podUID="943763e4-c636-494b-ac1f-b63c8e43a744"
Jul 15 23:29:47.559455 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:47.559423    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs\") pod \"network-metrics-daemon-v68p6\" (UID: \"469dc602-e468-466b-84e4-3504671a58c2\") " pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:29:47.559645 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:47.559552    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:29:47.559645 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:47.559612    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs podName:469dc602-e468-466b-84e4-3504671a58c2 nodeName:}" failed. No retries permitted until 2026-07-15 23:29:55.55959288 +0000 UTC m=+18.103315224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs") pod "network-metrics-daemon-v68p6" (UID: "469dc602-e468-466b-84e4-3504671a58c2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:29:47.660179 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:47.659970    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret\") pod \"global-pull-secret-syncer-s9w89\" (UID: \"943763e4-c636-494b-ac1f-b63c8e43a744\") " pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:47.660179 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:47.660101    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 23:29:47.660179 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:47.660161    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret podName:943763e4-c636-494b-ac1f-b63c8e43a744 nodeName:}" failed. No retries permitted until 2026-07-15 23:29:55.66014308 +0000 UTC m=+18.203865414 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret") pod "global-pull-secret-syncer-s9w89" (UID: "943763e4-c636-494b-ac1f-b63c8e43a744") : object "kube-system"/"original-pull-secret" not registered
Jul 15 23:29:47.761371 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:47.761334    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5x75\" (UniqueName: \"kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75\") pod \"network-check-target-9lphg\" (UID: \"a35cfa6e-c492-4a49-9002-5e2ba013c744\") " pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:29:47.761533 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:47.761518    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 23:29:47.761608 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:47.761544    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 23:29:47.761608 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:47.761558    2576 projected.go:196] Error preparing data for projected volume kube-api-access-r5x75 for pod openshift-network-diagnostics/network-check-target-9lphg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:29:47.761708 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:47.761620    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75 podName:a35cfa6e-c492-4a49-9002-5e2ba013c744 nodeName:}" failed. No retries permitted until 2026-07-15 23:29:55.761600014 +0000 UTC m=+18.305322349 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r5x75" (UniqueName: "kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75") pod "network-check-target-9lphg" (UID: "a35cfa6e-c492-4a49-9002-5e2ba013c744") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:29:47.967985 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:47.967227    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:29:47.967985 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:47.967224    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:29:47.967985 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:47.967391    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lphg" podUID="a35cfa6e-c492-4a49-9002-5e2ba013c744"
Jul 15 23:29:47.967985 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:47.967908    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v68p6" podUID="469dc602-e468-466b-84e4-3504671a58c2"
Jul 15 23:29:48.964680 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:48.964645    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:48.964860 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:48.964763    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9w89" podUID="943763e4-c636-494b-ac1f-b63c8e43a744"
Jul 15 23:29:49.965047 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:49.965012    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:29:49.965462 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:49.965054    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:29:49.965462 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:49.965137    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v68p6" podUID="469dc602-e468-466b-84e4-3504671a58c2"
Jul 15 23:29:49.965462 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:49.965304    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lphg" podUID="a35cfa6e-c492-4a49-9002-5e2ba013c744"
Jul 15 23:29:50.964803 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:50.964731    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:50.964996 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:50.964856    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9w89" podUID="943763e4-c636-494b-ac1f-b63c8e43a744"
Jul 15 23:29:51.965341 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:51.965312    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:29:51.965841 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:51.965451    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v68p6" podUID="469dc602-e468-466b-84e4-3504671a58c2"
Jul 15 23:29:51.965841 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:51.965505    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:29:51.965841 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:51.965605    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lphg" podUID="a35cfa6e-c492-4a49-9002-5e2ba013c744"
Jul 15 23:29:52.964771 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:52.964743    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:52.964939 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:52.964863    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9w89" podUID="943763e4-c636-494b-ac1f-b63c8e43a744"
Jul 15 23:29:53.964848 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:53.964813    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:29:53.965324 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:53.964932    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lphg" podUID="a35cfa6e-c492-4a49-9002-5e2ba013c744"
Jul 15 23:29:53.965324 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:53.964989    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:29:53.965324 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:53.965106    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v68p6" podUID="469dc602-e468-466b-84e4-3504671a58c2"
Jul 15 23:29:54.964624 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:54.964596    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:54.964889 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:54.964694    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9w89" podUID="943763e4-c636-494b-ac1f-b63c8e43a744"
Jul 15 23:29:55.624308 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:55.624273    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs\") pod \"network-metrics-daemon-v68p6\" (UID: \"469dc602-e468-466b-84e4-3504671a58c2\") " pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:29:55.624472 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:55.624421    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:29:55.624522 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:55.624492    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs podName:469dc602-e468-466b-84e4-3504671a58c2 nodeName:}" failed. No retries permitted until 2026-07-15 23:30:11.624468398 +0000 UTC m=+34.168190769 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs") pod "network-metrics-daemon-v68p6" (UID: "469dc602-e468-466b-84e4-3504671a58c2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:29:55.725049 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:55.724982    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret\") pod \"global-pull-secret-syncer-s9w89\" (UID: \"943763e4-c636-494b-ac1f-b63c8e43a744\") " pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:55.725176 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:55.725125    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 23:29:55.725214 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:55.725182    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret podName:943763e4-c636-494b-ac1f-b63c8e43a744 nodeName:}" failed. No retries permitted until 2026-07-15 23:30:11.72516659 +0000 UTC m=+34.268888922 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret") pod "global-pull-secret-syncer-s9w89" (UID: "943763e4-c636-494b-ac1f-b63c8e43a744") : object "kube-system"/"original-pull-secret" not registered
Jul 15 23:29:55.826223 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:55.826191    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5x75\" (UniqueName: \"kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75\") pod \"network-check-target-9lphg\" (UID: \"a35cfa6e-c492-4a49-9002-5e2ba013c744\") " pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:29:55.826396 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:55.826372    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 23:29:55.826396 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:55.826396    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 23:29:55.826491 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:55.826406    2576 projected.go:196] Error preparing data for projected volume kube-api-access-r5x75 for pod openshift-network-diagnostics/network-check-target-9lphg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:29:55.826491 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:55.826466    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75 podName:a35cfa6e-c492-4a49-9002-5e2ba013c744 nodeName:}" failed. No retries permitted until 2026-07-15 23:30:11.826452573 +0000 UTC m=+34.370174908 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r5x75" (UniqueName: "kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75") pod "network-check-target-9lphg" (UID: "a35cfa6e-c492-4a49-9002-5e2ba013c744") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:29:55.964539 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:55.964503    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:29:55.964698 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:55.964638    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lphg" podUID="a35cfa6e-c492-4a49-9002-5e2ba013c744"
Jul 15 23:29:55.964698 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:55.964690    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:29:55.964814 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:55.964786    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v68p6" podUID="469dc602-e468-466b-84e4-3504671a58c2"
Jul 15 23:29:56.964362 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:56.964333    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:56.964758 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:56.964438    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9w89" podUID="943763e4-c636-494b-ac1f-b63c8e43a744"
Jul 15 23:29:57.965197 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:57.965109    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:29:57.965670 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:57.965222    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v68p6" podUID="469dc602-e468-466b-84e4-3504671a58c2"
Jul 15 23:29:57.965670 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:57.965637    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:29:57.965789 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:57.965737    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lphg" podUID="a35cfa6e-c492-4a49-9002-5e2ba013c744"
Jul 15 23:29:58.964934 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:58.964886    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:29:58.965111 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:58.965010    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9w89" podUID="943763e4-c636-494b-ac1f-b63c8e43a744"
Jul 15 23:29:59.964979 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:59.964607    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:29:59.964979 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:29:59.964733    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:29:59.964979 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:59.964825    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lphg" podUID="a35cfa6e-c492-4a49-9002-5e2ba013c744"
Jul 15 23:29:59.964979 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:29:59.964915    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v68p6" podUID="469dc602-e468-466b-84e4-3504671a58c2"
Jul 15 23:30:00.050519 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:00.050496    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4" event={"ID":"2678ca67-7c8a-42d0-a4fc-99b257a177a5","Type":"ContainerStarted","Data":"5c6822ea7920ff66734a22f5b6e6751e1e421d1acb5f23e4baf3549224d37347"}
Jul 15 23:30:00.051872 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:00.051848    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-22.ec2.internal" event={"ID":"a5413ecf371cffe8dd9dab2a6b7557f0","Type":"ContainerStarted","Data":"a6ed77dc6ed4af7d70841effa4b87491d60664f1e1e8e0e6bb1d695adf0dc1a9"}
Jul 15 23:30:00.053085 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:00.053066    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9lbbs" event={"ID":"f8f1efea-c69f-418a-a3ce-37b94ec82e7e","Type":"ContainerStarted","Data":"99c8b717a37f01ba1f5e43059212e952e3af01a0e9c9d772c7d458987fa4c938"}
Jul 15 23:30:00.066074 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:00.066035    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-22.ec2.internal" podStartSLOduration=21.06602066 podStartE2EDuration="21.06602066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:29:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:30:00.065653077 +0000 UTC m=+22.609375432" watchObservedRunningTime="2026-07-15 23:30:00.06602066 +0000 UTC m=+22.609743013"
Jul 15 23:30:00.080026 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:00.079993    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9lbbs" podStartSLOduration=2.455432601 podStartE2EDuration="22.079979767s" totalImagesPullingTime="19.624547166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:30:00.079928673 +0000 UTC m=+22.623651028" watchObservedRunningTime="2026-07-15 23:30:00.079979767 +0000 UTC m=+22.623702121"
Jul 15 23:30:00.964976 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:00.964731    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:30:00.965105 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:00.965038    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9w89" podUID="943763e4-c636-494b-ac1f-b63c8e43a744"
Jul 15 23:30:01.057206 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.057177    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7" event={"ID":"359c98c1-dd84-40d6-8870-8527096cf0bf","Type":"ContainerStarted","Data":"810b0ff82a93b0015ab752ca0dd0f41ac831dd707b6981390a83886ceec28bf4"}
Jul 15 23:30:01.058680 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.058643    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t8kxt" event={"ID":"49685317-16b6-4fc9-be9d-30b2f82d1967","Type":"ContainerStarted","Data":"1473cf62109f9d93ed56e80375a4b07601e7dd31d447f365b0a586ea0fd5264b"}
Jul 15 23:30:01.060359 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.060336    2576 generic.go:356] "Generic (PLEG): container finished" podID="d6cfd89dbca2154f100ae43766bc3db3" containerID="719365790ca47c802f6dea4a2fa22df7c694584cc25077dc6aa46880a69f05a7" exitCode=0
Jul 15 23:30:01.060454 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.060418    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal" event={"ID":"d6cfd89dbca2154f100ae43766bc3db3","Type":"ContainerDied","Data":"719365790ca47c802f6dea4a2fa22df7c694584cc25077dc6aa46880a69f05a7"}
Jul 15 23:30:01.062107 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.062083    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h4fg7" event={"ID":"9c1eb0ec-907d-4e1b-9397-0336edac638d","Type":"ContainerStarted","Data":"761e0511f925234e82a69d9c3bd63f70220d0b6c8e6c11f1c79aeab2e40c2233"}
Jul 15 23:30:01.065571 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.065554    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2wsc4_2678ca67-7c8a-42d0-a4fc-99b257a177a5/ovn-acl-logging/0.log"
Jul 15 23:30:01.065963 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.065937    2576 generic.go:356] "Generic (PLEG): container finished" podID="2678ca67-7c8a-42d0-a4fc-99b257a177a5" containerID="5b3fbf5a36372205fda7f92ea5458440a127799830c2ef33aef8344cd1eee8dd" exitCode=1
Jul 15 23:30:01.066097 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.065999    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4" event={"ID":"2678ca67-7c8a-42d0-a4fc-99b257a177a5","Type":"ContainerStarted","Data":"2fd003a5d4652cba70dd0be8ae8895588a81297c21ae0a3c70e767150b381a1f"}
Jul 15 23:30:01.066097 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.066066    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4" event={"ID":"2678ca67-7c8a-42d0-a4fc-99b257a177a5","Type":"ContainerStarted","Data":"f8f94f3e03114e0182a143a0bc2ef993e2de22a5266ce4a14e95180e4083fe3c"}
Jul 15 23:30:01.066217 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.066115    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4" event={"ID":"2678ca67-7c8a-42d0-a4fc-99b257a177a5","Type":"ContainerStarted","Data":"747a5d422626802518b39b07ae38b69abce5d2c30deabfb95ee930029b92da71"}
Jul 15 23:30:01.066217 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.066163    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4" event={"ID":"2678ca67-7c8a-42d0-a4fc-99b257a177a5","Type":"ContainerStarted","Data":"06f299b027a33853887ed510f9528e538f82a31a35a1c5735051f0ca2df01972"}
Jul 15 23:30:01.066217 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.066207    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4" event={"ID":"2678ca67-7c8a-42d0-a4fc-99b257a177a5","Type":"ContainerDied","Data":"5b3fbf5a36372205fda7f92ea5458440a127799830c2ef33aef8344cd1eee8dd"}
Jul 15 23:30:01.067467 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.067444    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gxbgz" event={"ID":"a55589e7-52fd-489d-8f5f-528d0e99b6df","Type":"ContainerStarted","Data":"2406abb37bbb90340d30853211568b0be6f562c0635749ffd9a871c49d0c7c79"}
Jul 15 23:30:01.068869 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.068840    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jbldt" event={"ID":"be523a77-0668-4774-9cdb-e16840e092db","Type":"ContainerStarted","Data":"9e0ee521e9606243a4fc79f4cdbc570ee1fbb1d129923a240af86ce9ca5dbb3c"}
Jul 15 23:30:01.070363 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.070336    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wg4tf" event={"ID":"1664a246-dfb4-41f9-b051-19dbbd5a4781","Type":"ContainerStarted","Data":"4786e5b57697b8a71d6105eae915b26c774d2a40e78a25b500d288f3ce728c36"}
Jul 15 23:30:01.071811 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.071765    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t8kxt" podStartSLOduration=3.49254704 podStartE2EDuration="23.071751862s" totalImagesPullingTime="19.579204822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:30:01.070956273 +0000 UTC m=+23.614678628" watchObservedRunningTime="2026-07-15 23:30:01.071751862 +0000 UTC m=+23.615474216"
Jul 15 23:30:01.071965 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.071945    2576 generic.go:356] "Generic (PLEG): container finished" podID="625740e0-2602-472b-9a17-fd616cddb5fc" containerID="b5f777a2e79c85dc47651063c2ad7f999116044c3824fe50638d028867ce9417" exitCode=0
Jul 15 23:30:01.072028 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.071980    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xn8nk" event={"ID":"625740e0-2602-472b-9a17-fd616cddb5fc","Type":"ContainerDied","Data":"b5f777a2e79c85dc47651063c2ad7f999116044c3824fe50638d028867ce9417"}
Jul 15 23:30:01.084781 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.084748    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-h4fg7" podStartSLOduration=2.49907507 podStartE2EDuration="22.084736401s" totalImagesPullingTime="19.585661331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:30:01.084334951 +0000 UTC m=+23.628057304" watchObservedRunningTime="2026-07-15 23:30:01.084736401 +0000 UTC m=+23.628458755"
Jul 15 23:30:01.099185 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.099145    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jbldt" podStartSLOduration=2.998044573 podStartE2EDuration="23.099131562s" totalImagesPullingTime="20.101086989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:30:01.099065128 +0000 UTC m=+23.642787482" watchObservedRunningTime="2026-07-15 23:30:01.099131562 +0000 UTC m=+23.642853922"
Jul 15 23:30:01.116212 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.116162    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gxbgz" podStartSLOduration=3.489568732 podStartE2EDuration="23.116144809s" totalImagesPullingTime="19.626576077s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:30:01.115556556 +0000 UTC m=+23.659278923" watchObservedRunningTime="2026-07-15 23:30:01.116144809 +0000 UTC m=+23.659867164"
Jul 15 23:30:01.130808 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.130769    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wg4tf" podStartSLOduration=2.747713611 podStartE2EDuration="22.130755698s" totalImagesPullingTime="19.383042087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:30:01.130548156 +0000 UTC m=+23.674270509" watchObservedRunningTime="2026-07-15 23:30:01.130755698 +0000 UTC m=+23.674478051"
Jul 15 23:30:01.492962 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.492826    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 23:30:01.964691 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.964663    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:30:01.964887 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:01.964672    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:30:01.964887 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:01.964797    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v68p6" podUID="469dc602-e468-466b-84e4-3504671a58c2"
Jul 15 23:30:01.964887 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:01.964855    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lphg" podUID="a35cfa6e-c492-4a49-9002-5e2ba013c744"
Jul 15 23:30:02.070784 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:02.070711    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T23:30:01.492958448Z","UUID":"f3a8eabf-8024-46c7-af6f-ce26cf0bc717","Handler":null,"Name":"","Endpoint":""}
Jul 15 23:30:02.072443 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:02.072409    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 23:30:02.072586 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:02.072478    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 23:30:02.076068 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:02.076044    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7" event={"ID":"359c98c1-dd84-40d6-8870-8527096cf0bf","Type":"ContainerStarted","Data":"39bcbad04119a7e98201296025fa4f1e9fb8689f985dafe9808bdb65e7b2596e"}
Jul 15 23:30:02.077996 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:02.077965    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal" event={"ID":"d6cfd89dbca2154f100ae43766bc3db3","Type":"ContainerStarted","Data":"345990c3f0ed9853d1c5bf2723117df8b1d6beb82557241edd79444215e54ec1"}
Jul 15 23:30:02.092267 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:02.092213    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal" podStartSLOduration=23.092201684 podStartE2EDuration="23.092201684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:29:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:30:02.091682545 +0000 UTC m=+24.635404902" watchObservedRunningTime="2026-07-15 23:30:02.092201684 +0000 UTC m=+24.635924037"
Jul 15 23:30:02.964468 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:02.964440    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:30:02.964622 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:02.964561    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9w89" podUID="943763e4-c636-494b-ac1f-b63c8e43a744"
Jul 15 23:30:03.083625 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:03.083558    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2wsc4_2678ca67-7c8a-42d0-a4fc-99b257a177a5/ovn-acl-logging/0.log"
Jul 15 23:30:03.084203 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:03.083992    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4" event={"ID":"2678ca67-7c8a-42d0-a4fc-99b257a177a5","Type":"ContainerStarted","Data":"8203f486bc1c3570a1b297a03642001a0024d12cec467e6c93f795786fade12d"}
Jul 15 23:30:03.171073 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:03.171049    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wg4tf"
Jul 15 23:30:03.171796 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:03.171775    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wg4tf"
Jul 15 23:30:03.965389 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:03.965359    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:30:03.965545 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:03.965368    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:30:03.965545 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:03.965455    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lphg" podUID="a35cfa6e-c492-4a49-9002-5e2ba013c744"
Jul 15 23:30:03.965636 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:03.965565    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v68p6" podUID="469dc602-e468-466b-84e4-3504671a58c2"
Jul 15 23:30:04.088324 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:04.088275    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7" event={"ID":"359c98c1-dd84-40d6-8870-8527096cf0bf","Type":"ContainerStarted","Data":"a9711d96303c3a637a2582a908c98af914b02b2e1b3be270119b7e0065272505"}
Jul 15 23:30:04.088894 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:04.088541    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wg4tf"
Jul 15 23:30:04.089066 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:04.089045    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wg4tf"
Jul 15 23:30:04.103105 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:04.103062    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n98g7" podStartSLOduration=7.332171658 podStartE2EDuration="25.10304713s" totalImagesPullingTime="17.770875472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:29:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:30:04.103020281 +0000 UTC m=+26.646742638" watchObservedRunningTime="2026-07-15 23:30:04.10304713 +0000 UTC m=+26.646769485"
Jul 15 23:30:04.964463 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:04.964436    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:30:04.964610 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:04.964534    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9w89" podUID="943763e4-c636-494b-ac1f-b63c8e43a744"
Jul 15 23:30:05.964644 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:05.964624    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:30:05.964903 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:05.964782    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lphg" podUID="a35cfa6e-c492-4a49-9002-5e2ba013c744"
Jul 15 23:30:05.964903 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:05.964820    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:30:05.964974 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:05.964903    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v68p6" podUID="469dc602-e468-466b-84e4-3504671a58c2"
Jul 15 23:30:06.094205 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:06.094159    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xn8nk" event={"ID":"625740e0-2602-472b-9a17-fd616cddb5fc","Type":"ContainerStarted","Data":"f4122fe9a59f95d9cb07d1b98678cb2703ac8fd4b451cf49815c40349b2a0a40"}
Jul 15 23:30:06.097670 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:06.097650    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2wsc4_2678ca67-7c8a-42d0-a4fc-99b257a177a5/ovn-acl-logging/0.log"
Jul 15 23:30:06.098098 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:06.098076    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4" event={"ID":"2678ca67-7c8a-42d0-a4fc-99b257a177a5","Type":"ContainerStarted","Data":"1d4e1c480fe60b0058185c30d73457e931c0cb7259bdb18d98685c43c2488e7e"}
Jul 15 23:30:06.101063 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:06.101038    2576 scope.go:117] "RemoveContainer" containerID="5b3fbf5a36372205fda7f92ea5458440a127799830c2ef33aef8344cd1eee8dd"
Jul 15 23:30:06.964953 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:06.964920    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:30:06.965372 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:06.965021    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9w89" podUID="943763e4-c636-494b-ac1f-b63c8e43a744"
Jul 15 23:30:07.104320 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:07.104294    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2wsc4_2678ca67-7c8a-42d0-a4fc-99b257a177a5/ovn-acl-logging/0.log"
Jul 15 23:30:07.104684 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:07.104655    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4" event={"ID":"2678ca67-7c8a-42d0-a4fc-99b257a177a5","Type":"ContainerStarted","Data":"013ce16ba939b250496bc8a77879fbd1289212817afcfa2ded9d9a6755324a19"}
Jul 15 23:30:07.104852 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:07.104830    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:30:07.104989 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:07.104903    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:30:07.104989 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:07.104965    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:30:07.106847 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:07.106680    2576 generic.go:356] "Generic (PLEG): container finished" podID="625740e0-2602-472b-9a17-fd616cddb5fc" containerID="f4122fe9a59f95d9cb07d1b98678cb2703ac8fd4b451cf49815c40349b2a0a40" exitCode=0
Jul 15 23:30:07.106971 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:07.106749    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xn8nk" event={"ID":"625740e0-2602-472b-9a17-fd616cddb5fc","Type":"ContainerDied","Data":"f4122fe9a59f95d9cb07d1b98678cb2703ac8fd4b451cf49815c40349b2a0a40"}
Jul 15 23:30:07.120283 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:07.120266    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:30:07.120800 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:07.120781    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:30:07.132335 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:07.132296    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4" podStartSLOduration=8.471788111 podStartE2EDuration="28.132283844s" totalImagesPullingTime="19.660495733s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:30:07.131579059 +0000 UTC m=+29.675301425" watchObservedRunningTime="2026-07-15 23:30:07.132283844 +0000 UTC m=+29.676006224"
Jul 15 23:30:07.581461 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:07.581432    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9lphg"]
Jul 15 23:30:07.581627 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:07.581534    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:30:07.581627 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:07.581613    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lphg" podUID="a35cfa6e-c492-4a49-9002-5e2ba013c744"
Jul 15 23:30:07.584567 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:07.584534    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v68p6"]
Jul 15 23:30:07.584686 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:07.584631    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:30:07.584734 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:07.584718    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v68p6" podUID="469dc602-e468-466b-84e4-3504671a58c2"
Jul 15 23:30:07.585170 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:07.585146    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s9w89"]
Jul 15 23:30:07.585282 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:07.585244    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:30:07.585339 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:07.585311    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9w89" podUID="943763e4-c636-494b-ac1f-b63c8e43a744"
Jul 15 23:30:08.964443 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:08.964419    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:30:08.965089 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:08.964458    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:30:08.965089 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:08.964458    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:30:08.965089 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:08.964568    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v68p6" podUID="469dc602-e468-466b-84e4-3504671a58c2"
Jul 15 23:30:08.965089 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:08.964692    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9w89" podUID="943763e4-c636-494b-ac1f-b63c8e43a744"
Jul 15 23:30:08.965089 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:08.964770    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lphg" podUID="a35cfa6e-c492-4a49-9002-5e2ba013c744"
Jul 15 23:30:09.113194 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:09.113167    2576 generic.go:356] "Generic (PLEG): container finished" podID="625740e0-2602-472b-9a17-fd616cddb5fc" containerID="3acf4ab10db79e5adee36492feb21507980bebfd7f7a9897b330a1ab8a95b6d5" exitCode=0
Jul 15 23:30:09.113340 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:09.113253    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xn8nk" event={"ID":"625740e0-2602-472b-9a17-fd616cddb5fc","Type":"ContainerDied","Data":"3acf4ab10db79e5adee36492feb21507980bebfd7f7a9897b330a1ab8a95b6d5"}
Jul 15 23:30:10.117624 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:10.117595    2576 generic.go:356] "Generic (PLEG): container finished" podID="625740e0-2602-472b-9a17-fd616cddb5fc" containerID="6bf461b35828af2180c92351c99662fd88d682f0ee41ee1b96990875306503e0" exitCode=0
Jul 15 23:30:10.118083 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:10.117630    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xn8nk" event={"ID":"625740e0-2602-472b-9a17-fd616cddb5fc","Type":"ContainerDied","Data":"6bf461b35828af2180c92351c99662fd88d682f0ee41ee1b96990875306503e0"}
Jul 15 23:30:10.964762 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:10.964580    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:30:10.964929 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:10.964584    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:30:10.964929 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:10.964836    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lphg" podUID="a35cfa6e-c492-4a49-9002-5e2ba013c744"
Jul 15 23:30:10.965041 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:10.964953    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v68p6" podUID="469dc602-e468-466b-84e4-3504671a58c2"
Jul 15 23:30:10.965041 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:10.964586    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:30:10.965144 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:10.965081    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9w89" podUID="943763e4-c636-494b-ac1f-b63c8e43a744"
Jul 15 23:30:11.648526 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:11.648499    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs\") pod \"network-metrics-daemon-v68p6\" (UID: \"469dc602-e468-466b-84e4-3504671a58c2\") " pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:30:11.648940 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:11.648629    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:30:11.648940 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:11.648698    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs podName:469dc602-e468-466b-84e4-3504671a58c2 nodeName:}" failed. No retries permitted until 2026-07-15 23:30:43.648678394 +0000 UTC m=+66.192400727 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs") pod "network-metrics-daemon-v68p6" (UID: "469dc602-e468-466b-84e4-3504671a58c2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 23:30:11.749334 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:11.749303    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret\") pod \"global-pull-secret-syncer-s9w89\" (UID: \"943763e4-c636-494b-ac1f-b63c8e43a744\") " pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:30:11.749491 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:11.749467    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 23:30:11.749550 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:11.749536    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret podName:943763e4-c636-494b-ac1f-b63c8e43a744 nodeName:}" failed. No retries permitted until 2026-07-15 23:30:43.749518594 +0000 UTC m=+66.293240927 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret") pod "global-pull-secret-syncer-s9w89" (UID: "943763e4-c636-494b-ac1f-b63c8e43a744") : object "kube-system"/"original-pull-secret" not registered
Jul 15 23:30:11.850310 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:11.850279    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5x75\" (UniqueName: \"kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75\") pod \"network-check-target-9lphg\" (UID: \"a35cfa6e-c492-4a49-9002-5e2ba013c744\") " pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:30:11.850442 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:11.850413    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 23:30:11.850442 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:11.850433    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 23:30:11.850566 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:11.850446    2576 projected.go:196] Error preparing data for projected volume kube-api-access-r5x75 for pod openshift-network-diagnostics/network-check-target-9lphg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:30:11.850566 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:11.850495    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75 podName:a35cfa6e-c492-4a49-9002-5e2ba013c744 nodeName:}" failed. No retries permitted until 2026-07-15 23:30:43.850481906 +0000 UTC m=+66.394204240 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r5x75" (UniqueName: "kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75") pod "network-check-target-9lphg" (UID: "a35cfa6e-c492-4a49-9002-5e2ba013c744") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 23:30:12.965326 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:12.965291    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:30:12.965326 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:12.965312    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:30:12.965326 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:12.965310    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:30:12.965845 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:12.965422    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9w89" podUID="943763e4-c636-494b-ac1f-b63c8e43a744"
Jul 15 23:30:12.965845 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:12.965574    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v68p6" podUID="469dc602-e468-466b-84e4-3504671a58c2"
Jul 15 23:30:12.965845 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:12.965648    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lphg" podUID="a35cfa6e-c492-4a49-9002-5e2ba013c744"
Jul 15 23:30:13.310747 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.310713    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeReady"
Jul 15 23:30:13.310914 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.310848    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 23:30:13.343335 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.343301    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66fb4fddbc-jcp7c"]
Jul 15 23:30:13.348283 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.348262    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.350767 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.350740    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 23:30:13.351067 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.351032    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 23:30:13.352880 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.351201    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 23:30:13.352880 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.351293    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mj9fx\""
Jul 15 23:30:13.354658 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.354635    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-chmd4"]
Jul 15 23:30:13.358125 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.358095    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n2bfn"]
Jul 15 23:30:13.358293 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.358270    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-chmd4"
Jul 15 23:30:13.358428 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.358413    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 23:30:13.360634 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.360598    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 23:30:13.361723 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.360854    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hnnk9\""
Jul 15 23:30:13.361723 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.360997    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 23:30:13.361902 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.361489    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n2bfn"
Jul 15 23:30:13.361902 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.361513    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66fb4fddbc-jcp7c"]
Jul 15 23:30:13.362051 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.362021    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wg4tf_1664a246-dfb4-41f9-b051-19dbbd5a4781/konnectivity-agent/0.log" limit=1024
Jul 15 23:30:13.363715 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.363695    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 23:30:13.363909 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.363877    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8tb2c\""
Jul 15 23:30:13.364002 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.363950    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 23:30:13.364185 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.364167    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 23:30:13.367021 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.366998    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-chmd4"]
Jul 15 23:30:13.375643 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.375619    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n2bfn"]
Jul 15 23:30:13.463619 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.463588    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzknz\" (UniqueName: \"kubernetes.io/projected/a82e22d2-37b0-47c0-bf61-e97be360aea0-kube-api-access-rzknz\") pod \"ingress-canary-n2bfn\" (UID: \"a82e22d2-37b0-47c0-bf61-e97be360aea0\") " pod="openshift-ingress-canary/ingress-canary-n2bfn"
Jul 15 23:30:13.463756 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.463652    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.463756 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.463687    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-installation-pull-secrets\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.463756 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.463708    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-image-registry-private-configuration\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.463756 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.463735    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-bound-sa-token\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.463942 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.463763    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jprqp\" (UniqueName: \"kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-kube-api-access-jprqp\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.463942 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.463793    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls\") pod \"dns-default-chmd4\" (UID: \"4a5e7446-d01c-4487-8450-b853f451b6f0\") " pod="openshift-dns/dns-default-chmd4"
Jul 15 23:30:13.463942 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.463819    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a5e7446-d01c-4487-8450-b853f451b6f0-config-volume\") pod \"dns-default-chmd4\" (UID: \"4a5e7446-d01c-4487-8450-b853f451b6f0\") " pod="openshift-dns/dns-default-chmd4"
Jul 15 23:30:13.463942 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.463880    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a82e22d2-37b0-47c0-bf61-e97be360aea0-cert\") pod \"ingress-canary-n2bfn\" (UID: \"a82e22d2-37b0-47c0-bf61-e97be360aea0\") " pod="openshift-ingress-canary/ingress-canary-n2bfn"
Jul 15 23:30:13.463942 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.463919    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-ca-trust-extracted\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.463942 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.463938    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a5e7446-d01c-4487-8450-b853f451b6f0-tmp-dir\") pod \"dns-default-chmd4\" (UID: \"4a5e7446-d01c-4487-8450-b853f451b6f0\") " pod="openshift-dns/dns-default-chmd4"
Jul 15 23:30:13.464180 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.463954    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-certificates\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.464180 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.463989    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-trusted-ca\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.464180 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.464027    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkpl4\" (UniqueName: \"kubernetes.io/projected/4a5e7446-d01c-4487-8450-b853f451b6f0-kube-api-access-kkpl4\") pod \"dns-default-chmd4\" (UID: \"4a5e7446-d01c-4487-8450-b853f451b6f0\") " pod="openshift-dns/dns-default-chmd4"
Jul 15 23:30:13.541703 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.541668    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wg4tf_1664a246-dfb4-41f9-b051-19dbbd5a4781/konnectivity-agent/0.log" limit=1024
Jul 15 23:30:13.564677 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.564614    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-bound-sa-token\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.564677 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.564651    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jprqp\" (UniqueName: \"kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-kube-api-access-jprqp\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.564862 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.564696    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls\") pod \"dns-default-chmd4\" (UID: \"4a5e7446-d01c-4487-8450-b853f451b6f0\") " pod="openshift-dns/dns-default-chmd4"
Jul 15 23:30:13.564862 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.564721    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a5e7446-d01c-4487-8450-b853f451b6f0-config-volume\") pod \"dns-default-chmd4\" (UID: \"4a5e7446-d01c-4487-8450-b853f451b6f0\") " pod="openshift-dns/dns-default-chmd4"
Jul 15 23:30:13.564862 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:13.564796    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 23:30:13.564862 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.564820    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a82e22d2-37b0-47c0-bf61-e97be360aea0-cert\") pod \"ingress-canary-n2bfn\" (UID: \"a82e22d2-37b0-47c0-bf61-e97be360aea0\") " pod="openshift-ingress-canary/ingress-canary-n2bfn"
Jul 15 23:30:13.564862 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:13.564860    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls podName:4a5e7446-d01c-4487-8450-b853f451b6f0 nodeName:}" failed. No retries permitted until 2026-07-15 23:30:14.064836343 +0000 UTC m=+36.608558680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls") pod "dns-default-chmd4" (UID: "4a5e7446-d01c-4487-8450-b853f451b6f0") : secret "dns-default-metrics-tls" not found
Jul 15 23:30:13.565135 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.564894    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-ca-trust-extracted\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.565135 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.564925    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a5e7446-d01c-4487-8450-b853f451b6f0-tmp-dir\") pod \"dns-default-chmd4\" (UID: \"4a5e7446-d01c-4487-8450-b853f451b6f0\") " pod="openshift-dns/dns-default-chmd4"
Jul 15 23:30:13.565135 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.564953    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-certificates\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.565135 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.564977    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-trusted-ca\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.565135 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.565001    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkpl4\" (UniqueName: \"kubernetes.io/projected/4a5e7446-d01c-4487-8450-b853f451b6f0-kube-api-access-kkpl4\") pod \"dns-default-chmd4\" (UID: \"4a5e7446-d01c-4487-8450-b853f451b6f0\") " pod="openshift-dns/dns-default-chmd4"
Jul 15 23:30:13.565135 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.565036    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzknz\" (UniqueName: \"kubernetes.io/projected/a82e22d2-37b0-47c0-bf61-e97be360aea0-kube-api-access-rzknz\") pod \"ingress-canary-n2bfn\" (UID: \"a82e22d2-37b0-47c0-bf61-e97be360aea0\") " pod="openshift-ingress-canary/ingress-canary-n2bfn"
Jul 15 23:30:13.565463 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.565338    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.565463 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.565350    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-ca-trust-extracted\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.565463 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.565390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-installation-pull-secrets\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.565463 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.565438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-image-registry-private-configuration\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.565677 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.565469    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a5e7446-d01c-4487-8450-b853f451b6f0-tmp-dir\") pod \"dns-default-chmd4\" (UID: \"4a5e7446-d01c-4487-8450-b853f451b6f0\") " pod="openshift-dns/dns-default-chmd4"
Jul 15 23:30:13.565677 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:13.565578    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 23:30:13.565677 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:13.565599    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66fb4fddbc-jcp7c: secret "image-registry-tls" not found
Jul 15 23:30:13.565677 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:13.565665    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls podName:68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd nodeName:}" failed. No retries permitted until 2026-07-15 23:30:14.065643399 +0000 UTC m=+36.609365748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls") pod "image-registry-66fb4fddbc-jcp7c" (UID: "68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd") : secret "image-registry-tls" not found
Jul 15 23:30:13.565875 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.565796    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-certificates\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.566241 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.566186    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a5e7446-d01c-4487-8450-b853f451b6f0-config-volume\") pod \"dns-default-chmd4\" (UID: \"4a5e7446-d01c-4487-8450-b853f451b6f0\") " pod="openshift-dns/dns-default-chmd4"
Jul 15 23:30:13.566639 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.566617    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-trusted-ca\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.569631 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.569610    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a82e22d2-37b0-47c0-bf61-e97be360aea0-cert\") pod \"ingress-canary-n2bfn\" (UID: \"a82e22d2-37b0-47c0-bf61-e97be360aea0\") " pod="openshift-ingress-canary/ingress-canary-n2bfn"
Jul 15 23:30:13.569725 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.569635    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-installation-pull-secrets\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.569725 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.569640    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-image-registry-private-configuration\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.574545 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.574519    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jprqp\" (UniqueName: \"kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-kube-api-access-jprqp\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.574780 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.574751    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkpl4\" (UniqueName: \"kubernetes.io/projected/4a5e7446-d01c-4487-8450-b853f451b6f0-kube-api-access-kkpl4\") pod \"dns-default-chmd4\" (UID: \"4a5e7446-d01c-4487-8450-b853f451b6f0\") " pod="openshift-dns/dns-default-chmd4"
Jul 15 23:30:13.575592 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.575570    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-bound-sa-token\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:13.575960 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.575943    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzknz\" (UniqueName: \"kubernetes.io/projected/a82e22d2-37b0-47c0-bf61-e97be360aea0-kube-api-access-rzknz\") pod \"ingress-canary-n2bfn\" (UID: \"a82e22d2-37b0-47c0-bf61-e97be360aea0\") " pod="openshift-ingress-canary/ingress-canary-n2bfn"
Jul 15 23:30:13.678381 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:13.678353    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n2bfn"
Jul 15 23:30:14.068493 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:14.068455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls\") pod \"dns-default-chmd4\" (UID: \"4a5e7446-d01c-4487-8450-b853f451b6f0\") " pod="openshift-dns/dns-default-chmd4"
Jul 15 23:30:14.068937 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:14.068571    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:14.068937 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:14.068631    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 23:30:14.068937 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:14.068680    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 23:30:14.068937 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:14.068697    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66fb4fddbc-jcp7c: secret "image-registry-tls" not found
Jul 15 23:30:14.068937 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:14.068703    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls podName:4a5e7446-d01c-4487-8450-b853f451b6f0 nodeName:}" failed. No retries permitted until 2026-07-15 23:30:15.068682959 +0000 UTC m=+37.612405294 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls") pod "dns-default-chmd4" (UID: "4a5e7446-d01c-4487-8450-b853f451b6f0") : secret "dns-default-metrics-tls" not found
Jul 15 23:30:14.068937 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:14.068766    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls podName:68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd nodeName:}" failed. No retries permitted until 2026-07-15 23:30:15.068748717 +0000 UTC m=+37.612471074 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls") pod "image-registry-66fb4fddbc-jcp7c" (UID: "68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd") : secret "image-registry-tls" not found
Jul 15 23:30:14.450887 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:14.450860    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n2bfn"]
Jul 15 23:30:14.455417 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:30:14.455381    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda82e22d2_37b0_47c0_bf61_e97be360aea0.slice/crio-0cc9bc39aafdd094817f5b29cd484b6c5bf0573ef39d6a9e203a8a250623b240 WatchSource:0}: Error finding container 0cc9bc39aafdd094817f5b29cd484b6c5bf0573ef39d6a9e203a8a250623b240: Status 404 returned error can't find the container with id 0cc9bc39aafdd094817f5b29cd484b6c5bf0573ef39d6a9e203a8a250623b240
Jul 15 23:30:14.964690 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:14.964473    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:30:14.964814 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:14.964539    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:30:14.964814 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:14.964543    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:30:14.967462 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:14.967429    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 23:30:14.967462 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:14.967439    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ctqbg\""
Jul 15 23:30:14.967462 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:14.967455    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wjrwg\""
Jul 15 23:30:14.967784 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:14.967493    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 23:30:14.967784 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:14.967504    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 23:30:14.967784 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:14.967462    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 23:30:15.076910 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:15.076891    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:15.077306 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:15.076943    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls\") pod \"dns-default-chmd4\" (UID: \"4a5e7446-d01c-4487-8450-b853f451b6f0\") " pod="openshift-dns/dns-default-chmd4"
Jul 15 23:30:15.077306 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:15.077026    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 23:30:15.077306 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:15.077037    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 23:30:15.077306 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:15.077079    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls podName:4a5e7446-d01c-4487-8450-b853f451b6f0 nodeName:}" failed. No retries permitted until 2026-07-15 23:30:17.077067395 +0000 UTC m=+39.620789728 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls") pod "dns-default-chmd4" (UID: "4a5e7446-d01c-4487-8450-b853f451b6f0") : secret "dns-default-metrics-tls" not found
Jul 15 23:30:15.077306 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:15.077041    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66fb4fddbc-jcp7c: secret "image-registry-tls" not found
Jul 15 23:30:15.077306 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:15.077162    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls podName:68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd nodeName:}" failed. No retries permitted until 2026-07-15 23:30:17.077149808 +0000 UTC m=+39.620872140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls") pod "image-registry-66fb4fddbc-jcp7c" (UID: "68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd") : secret "image-registry-tls" not found
Jul 15 23:30:15.132582 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:15.132557    2576 generic.go:356] "Generic (PLEG): container finished" podID="625740e0-2602-472b-9a17-fd616cddb5fc" containerID="f25fdded88e0017b4c40896df2ed8d3e9cb39fc1e69c286170777cf2cc4c0cb8" exitCode=0
Jul 15 23:30:15.132691 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:15.132608    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xn8nk" event={"ID":"625740e0-2602-472b-9a17-fd616cddb5fc","Type":"ContainerDied","Data":"f25fdded88e0017b4c40896df2ed8d3e9cb39fc1e69c286170777cf2cc4c0cb8"}
Jul 15 23:30:15.134221 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:15.134195    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n2bfn" event={"ID":"a82e22d2-37b0-47c0-bf61-e97be360aea0","Type":"ContainerStarted","Data":"0cc9bc39aafdd094817f5b29cd484b6c5bf0573ef39d6a9e203a8a250623b240"}
Jul 15 23:30:15.947006 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:15.946971    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wg4tf_1664a246-dfb4-41f9-b051-19dbbd5a4781/konnectivity-agent/0.log" limit=1024
Jul 15 23:30:15.995715 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:15.995692    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wg4tf_1664a246-dfb4-41f9-b051-19dbbd5a4781/konnectivity-agent/0.log" limit=1024
Jul 15 23:30:16.140828 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:16.140797    2576 generic.go:356] "Generic (PLEG): container finished" podID="625740e0-2602-472b-9a17-fd616cddb5fc" containerID="93a05d505bbf5f3e90cd9c8f989e807e7de9ba2c4514851f9a122109ef46e7b4" exitCode=0
Jul 15 23:30:16.141176 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:16.140865    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xn8nk" event={"ID":"625740e0-2602-472b-9a17-fd616cddb5fc","Type":"ContainerDied","Data":"93a05d505bbf5f3e90cd9c8f989e807e7de9ba2c4514851f9a122109ef46e7b4"}
Jul 15 23:30:17.092840 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:17.092812    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:17.092983 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:17.092858    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls\") pod \"dns-default-chmd4\" (UID: \"4a5e7446-d01c-4487-8450-b853f451b6f0\") " pod="openshift-dns/dns-default-chmd4"
Jul 15 23:30:17.092983 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:17.092973    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 23:30:17.093062 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:17.093022    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls podName:4a5e7446-d01c-4487-8450-b853f451b6f0 nodeName:}" failed. No retries permitted until 2026-07-15 23:30:21.093008706 +0000 UTC m=+43.636731039 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls") pod "dns-default-chmd4" (UID: "4a5e7446-d01c-4487-8450-b853f451b6f0") : secret "dns-default-metrics-tls" not found
Jul 15 23:30:17.093062 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:17.092976    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 23:30:17.093062 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:17.093041    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66fb4fddbc-jcp7c: secret "image-registry-tls" not found
Jul 15 23:30:17.093154 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:17.093070    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls podName:68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd nodeName:}" failed. No retries permitted until 2026-07-15 23:30:21.09305966 +0000 UTC m=+43.636782005 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls") pod "image-registry-66fb4fddbc-jcp7c" (UID: "68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd") : secret "image-registry-tls" not found
Jul 15 23:30:17.146412 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:17.146376    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xn8nk" event={"ID":"625740e0-2602-472b-9a17-fd616cddb5fc","Type":"ContainerStarted","Data":"139f434c2f745498d558cabf5872949079288a139969026e24ca689ada6c2536"}
Jul 15 23:30:17.165776 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:17.165730    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xn8nk" podStartSLOduration=7.593137626 podStartE2EDuration="38.165714972s" totalImagesPullingTime="30.572577346s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:29:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:30:17.164865215 +0000 UTC m=+39.708587566" watchObservedRunningTime="2026-07-15 23:30:17.165714972 +0000 UTC m=+39.709437328"
Jul 15 23:30:17.286062 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:17.286034    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wg4tf_1664a246-dfb4-41f9-b051-19dbbd5a4781/konnectivity-agent/0.log" limit=1024
Jul 15 23:30:17.389778 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:17.389701    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-wg4tf_1664a246-dfb4-41f9-b051-19dbbd5a4781/konnectivity-agent/0.log" limit=1024
Jul 15 23:30:18.149975 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:18.149940    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n2bfn" event={"ID":"a82e22d2-37b0-47c0-bf61-e97be360aea0","Type":"ContainerStarted","Data":"ea5da1d342ac9b1a444b3beaeac4ac33b3e9a8f1a983ab6beadca223b4598273"}
Jul 15 23:30:18.164665 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:18.164619    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n2bfn" podStartSLOduration=2.273187995 podStartE2EDuration="5.164605116s" totalImagesPullingTime="2.891417121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:30:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:30:18.163991916 +0000 UTC m=+40.707714266" watchObservedRunningTime="2026-07-15 23:30:18.164605116 +0000 UTC m=+40.708327470"
Jul 15 23:30:21.122034 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:21.122003    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:21.122439 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:21.122051    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls\") pod \"dns-default-chmd4\" (UID: \"4a5e7446-d01c-4487-8450-b853f451b6f0\") " pod="openshift-dns/dns-default-chmd4"
Jul 15 23:30:21.122439 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:21.122139    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 23:30:21.122439 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:21.122143    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 23:30:21.122439 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:21.122162    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66fb4fddbc-jcp7c: secret "image-registry-tls" not found
Jul 15 23:30:21.122439 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:21.122190    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls podName:4a5e7446-d01c-4487-8450-b853f451b6f0 nodeName:}" failed. No retries permitted until 2026-07-15 23:30:29.122176944 +0000 UTC m=+51.665899276 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls") pod "dns-default-chmd4" (UID: "4a5e7446-d01c-4487-8450-b853f451b6f0") : secret "dns-default-metrics-tls" not found
Jul 15 23:30:21.122439 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:21.122212    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls podName:68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd nodeName:}" failed. No retries permitted until 2026-07-15 23:30:29.122200042 +0000 UTC m=+51.665922400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls") pod "image-registry-66fb4fddbc-jcp7c" (UID: "68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd") : secret "image-registry-tls" not found
Jul 15 23:30:29.176621 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:29.176588    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls\") pod \"dns-default-chmd4\" (UID: \"4a5e7446-d01c-4487-8450-b853f451b6f0\") " pod="openshift-dns/dns-default-chmd4"
Jul 15 23:30:29.177036 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:29.176651    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:29.177036 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:29.176729    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 23:30:29.177036 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:29.176739    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 23:30:29.177036 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:29.176750    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66fb4fddbc-jcp7c: secret "image-registry-tls" not found
Jul 15 23:30:29.177036 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:29.176787    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls podName:4a5e7446-d01c-4487-8450-b853f451b6f0 nodeName:}" failed. No retries permitted until 2026-07-15 23:30:45.176769987 +0000 UTC m=+67.720492320 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls") pod "dns-default-chmd4" (UID: "4a5e7446-d01c-4487-8450-b853f451b6f0") : secret "dns-default-metrics-tls" not found
Jul 15 23:30:29.177036 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:29.176800    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls podName:68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd nodeName:}" failed. No retries permitted until 2026-07-15 23:30:45.17679477 +0000 UTC m=+67.720517102 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls") pod "image-registry-66fb4fddbc-jcp7c" (UID: "68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd") : secret "image-registry-tls" not found
Jul 15 23:30:39.131313 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:39.131286    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2wsc4"
Jul 15 23:30:41.427722 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.427684    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-r9gdz"]
Jul 15 23:30:41.430497 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.430480    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-r9gdz"
Jul 15 23:30:41.432542 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.432518    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 15 23:30:41.432656 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.432571    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 23:30:41.432656 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.432569    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 23:30:41.434108 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.434077    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5fv72\""
Jul 15 23:30:41.434361 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.434342    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 15 23:30:41.442067 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.442043    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-r9gdz"]
Jul 15 23:30:41.463750 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.463727    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/63e974da-1418-40b8-a9f2-8b07406a824b-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-r9gdz\" (UID: \"63e974da-1418-40b8-a9f2-8b07406a824b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-r9gdz"
Jul 15 23:30:41.463842 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.463752    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63e974da-1418-40b8-a9f2-8b07406a824b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-r9gdz\" (UID: \"63e974da-1418-40b8-a9f2-8b07406a824b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-r9gdz"
Jul 15 23:30:41.463842 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.463789    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksk2m\" (UniqueName: \"kubernetes.io/projected/63e974da-1418-40b8-a9f2-8b07406a824b-kube-api-access-ksk2m\") pod \"cluster-monitoring-operator-5f7f494dd4-r9gdz\" (UID: \"63e974da-1418-40b8-a9f2-8b07406a824b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-r9gdz"
Jul 15 23:30:41.564100 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.564077    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/63e974da-1418-40b8-a9f2-8b07406a824b-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-r9gdz\" (UID: \"63e974da-1418-40b8-a9f2-8b07406a824b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-r9gdz"
Jul 15 23:30:41.564185 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.564104    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63e974da-1418-40b8-a9f2-8b07406a824b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-r9gdz\" (UID: \"63e974da-1418-40b8-a9f2-8b07406a824b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-r9gdz"
Jul 15 23:30:41.564185 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.564135    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksk2m\" (UniqueName: \"kubernetes.io/projected/63e974da-1418-40b8-a9f2-8b07406a824b-kube-api-access-ksk2m\") pod \"cluster-monitoring-operator-5f7f494dd4-r9gdz\" (UID: \"63e974da-1418-40b8-a9f2-8b07406a824b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-r9gdz"
Jul 15 23:30:41.564296 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:41.564247    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 23:30:41.564336 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:41.564322    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63e974da-1418-40b8-a9f2-8b07406a824b-cluster-monitoring-operator-tls podName:63e974da-1418-40b8-a9f2-8b07406a824b nodeName:}" failed. No retries permitted until 2026-07-15 23:30:42.064301125 +0000 UTC m=+64.608023473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/63e974da-1418-40b8-a9f2-8b07406a824b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-r9gdz" (UID: "63e974da-1418-40b8-a9f2-8b07406a824b") : secret "cluster-monitoring-operator-tls" not found
Jul 15 23:30:41.564805 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.564790    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/63e974da-1418-40b8-a9f2-8b07406a824b-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-r9gdz\" (UID: \"63e974da-1418-40b8-a9f2-8b07406a824b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-r9gdz"
Jul 15 23:30:41.585168 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.585148    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksk2m\" (UniqueName: \"kubernetes.io/projected/63e974da-1418-40b8-a9f2-8b07406a824b-kube-api-access-ksk2m\") pod \"cluster-monitoring-operator-5f7f494dd4-r9gdz\" (UID: \"63e974da-1418-40b8-a9f2-8b07406a824b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-r9gdz"
Jul 15 23:30:41.641342 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.641316    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rnn4g"]
Jul 15 23:30:41.645392 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.645373    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rnn4g"
Jul 15 23:30:41.648208 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.648182    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 15 23:30:41.648314 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.648182    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 15 23:30:41.648314 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.648221    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 15 23:30:41.648468 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.648453    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bp89k\""
Jul 15 23:30:41.648535 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.648479    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 15 23:30:41.666946 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.666921    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rnn4g"]
Jul 15 23:30:41.765460 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.765439    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c2a6d23f-5460-4848-b18e-071cfe3c240d-serving-cert\") pod \"service-ca-operator-7695fc6c8c-rnn4g\" (UID: \"c2a6d23f-5460-4848-b18e-071cfe3c240d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rnn4g"
Jul 15 23:30:41.765553 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.765474    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c2a6d23f-5460-4848-b18e-071cfe3c240d-config\") pod \"service-ca-operator-7695fc6c8c-rnn4g\" (UID: \"c2a6d23f-5460-4848-b18e-071cfe3c240d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rnn4g"
Jul 15 23:30:41.765553 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.765493    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4crd\" (UniqueName: \"kubernetes.io/projected/c2a6d23f-5460-4848-b18e-071cfe3c240d-kube-api-access-q4crd\") pod \"service-ca-operator-7695fc6c8c-rnn4g\" (UID: \"c2a6d23f-5460-4848-b18e-071cfe3c240d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rnn4g"
Jul 15 23:30:41.866094 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.866073    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c2a6d23f-5460-4848-b18e-071cfe3c240d-serving-cert\") pod \"service-ca-operator-7695fc6c8c-rnn4g\" (UID: \"c2a6d23f-5460-4848-b18e-071cfe3c240d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rnn4g"
Jul 15 23:30:41.866185 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.866108    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c2a6d23f-5460-4848-b18e-071cfe3c240d-config\") pod \"service-ca-operator-7695fc6c8c-rnn4g\" (UID: \"c2a6d23f-5460-4848-b18e-071cfe3c240d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rnn4g"
Jul 15 23:30:41.866185 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.866127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4crd\" (UniqueName: \"kubernetes.io/projected/c2a6d23f-5460-4848-b18e-071cfe3c240d-kube-api-access-q4crd\") pod \"service-ca-operator-7695fc6c8c-rnn4g\" (UID: \"c2a6d23f-5460-4848-b18e-071cfe3c240d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rnn4g"
Jul 15 23:30:41.866659 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.866637    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c2a6d23f-5460-4848-b18e-071cfe3c240d-config\") pod \"service-ca-operator-7695fc6c8c-rnn4g\" (UID: \"c2a6d23f-5460-4848-b18e-071cfe3c240d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rnn4g"
Jul 15 23:30:41.868210 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.868191    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c2a6d23f-5460-4848-b18e-071cfe3c240d-serving-cert\") pod \"service-ca-operator-7695fc6c8c-rnn4g\" (UID: \"c2a6d23f-5460-4848-b18e-071cfe3c240d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rnn4g"
Jul 15 23:30:41.873617 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.873597    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4crd\" (UniqueName: \"kubernetes.io/projected/c2a6d23f-5460-4848-b18e-071cfe3c240d-kube-api-access-q4crd\") pod \"service-ca-operator-7695fc6c8c-rnn4g\" (UID: \"c2a6d23f-5460-4848-b18e-071cfe3c240d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rnn4g"
Jul 15 23:30:41.953312 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:41.953294    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rnn4g"
Jul 15 23:30:42.068092 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:42.068066    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63e974da-1418-40b8-a9f2-8b07406a824b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-r9gdz\" (UID: \"63e974da-1418-40b8-a9f2-8b07406a824b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-r9gdz"
Jul 15 23:30:42.068298 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:42.068194    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 23:30:42.068298 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:42.068291    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63e974da-1418-40b8-a9f2-8b07406a824b-cluster-monitoring-operator-tls podName:63e974da-1418-40b8-a9f2-8b07406a824b nodeName:}" failed. No retries permitted until 2026-07-15 23:30:43.06827312 +0000 UTC m=+65.611995456 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/63e974da-1418-40b8-a9f2-8b07406a824b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-r9gdz" (UID: "63e974da-1418-40b8-a9f2-8b07406a824b") : secret "cluster-monitoring-operator-tls" not found
Jul 15 23:30:42.085659 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:42.085635    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rnn4g"]
Jul 15 23:30:42.088830 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:30:42.088810    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2a6d23f_5460_4848_b18e_071cfe3c240d.slice/crio-a13f940d555a4036f657fd83435c53eb60a8c9505984d255111194c69d146d18 WatchSource:0}: Error finding container a13f940d555a4036f657fd83435c53eb60a8c9505984d255111194c69d146d18: Status 404 returned error can't find the container with id a13f940d555a4036f657fd83435c53eb60a8c9505984d255111194c69d146d18
Jul 15 23:30:42.203616 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:42.203587    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rnn4g" event={"ID":"c2a6d23f-5460-4848-b18e-071cfe3c240d","Type":"ContainerStarted","Data":"a13f940d555a4036f657fd83435c53eb60a8c9505984d255111194c69d146d18"}
Jul 15 23:30:43.077619 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:43.077586    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63e974da-1418-40b8-a9f2-8b07406a824b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-r9gdz\" (UID: \"63e974da-1418-40b8-a9f2-8b07406a824b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-r9gdz"
Jul 15 23:30:43.078015 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:43.077727    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 23:30:43.078015 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:43.077796    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63e974da-1418-40b8-a9f2-8b07406a824b-cluster-monitoring-operator-tls podName:63e974da-1418-40b8-a9f2-8b07406a824b nodeName:}" failed. No retries permitted until 2026-07-15 23:30:45.077777017 +0000 UTC m=+67.621499363 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/63e974da-1418-40b8-a9f2-8b07406a824b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-r9gdz" (UID: "63e974da-1418-40b8-a9f2-8b07406a824b") : secret "cluster-monitoring-operator-tls" not found
Jul 15 23:30:43.682024 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:43.681990    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs\") pod \"network-metrics-daemon-v68p6\" (UID: \"469dc602-e468-466b-84e4-3504671a58c2\") " pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:30:43.683904 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:43.683884    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 23:30:43.692298 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:43.692276    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 15 23:30:43.692419 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:43.692355    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs podName:469dc602-e468-466b-84e4-3504671a58c2 nodeName:}" failed. No retries permitted until 2026-07-15 23:31:47.692334444 +0000 UTC m=+130.236056796 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs") pod "network-metrics-daemon-v68p6" (UID: "469dc602-e468-466b-84e4-3504671a58c2") : secret "metrics-daemon-secret" not found
Jul 15 23:30:43.783277 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:43.783249    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret\") pod \"global-pull-secret-syncer-s9w89\" (UID: \"943763e4-c636-494b-ac1f-b63c8e43a744\") " pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:30:43.785975 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:43.785955    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 23:30:43.795864 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:43.795842    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/943763e4-c636-494b-ac1f-b63c8e43a744-original-pull-secret\") pod \"global-pull-secret-syncer-s9w89\" (UID: \"943763e4-c636-494b-ac1f-b63c8e43a744\") " pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:30:43.884559 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:43.884526    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5x75\" (UniqueName: \"kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75\") pod \"network-check-target-9lphg\" (UID: \"a35cfa6e-c492-4a49-9002-5e2ba013c744\") " pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:30:43.886877 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:43.886843    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 23:30:43.896819 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:43.896801    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 23:30:43.908386 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:43.908360    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5x75\" (UniqueName: \"kubernetes.io/projected/a35cfa6e-c492-4a49-9002-5e2ba013c744-kube-api-access-r5x75\") pod \"network-check-target-9lphg\" (UID: \"a35cfa6e-c492-4a49-9002-5e2ba013c744\") " pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:30:44.074478 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:44.074455    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9w89"
Jul 15 23:30:44.086352 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:44.086333    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ctqbg\""
Jul 15 23:30:44.095029 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:44.095013    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:30:44.202151 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:44.202121    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s9w89"]
Jul 15 23:30:44.205642 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:30:44.205617    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod943763e4_c636_494b_ac1f_b63c8e43a744.slice/crio-d58c24e0a44d6a3c380c1362b0ee61280c8ae1a8264a46e4eb963400a0f9c305 WatchSource:0}: Error finding container d58c24e0a44d6a3c380c1362b0ee61280c8ae1a8264a46e4eb963400a0f9c305: Status 404 returned error can't find the container with id d58c24e0a44d6a3c380c1362b0ee61280c8ae1a8264a46e4eb963400a0f9c305
Jul 15 23:30:44.209383 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:44.209359    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s9w89" event={"ID":"943763e4-c636-494b-ac1f-b63c8e43a744","Type":"ContainerStarted","Data":"d58c24e0a44d6a3c380c1362b0ee61280c8ae1a8264a46e4eb963400a0f9c305"}
Jul 15 23:30:44.210885 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:44.210858    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rnn4g" event={"ID":"c2a6d23f-5460-4848-b18e-071cfe3c240d","Type":"ContainerStarted","Data":"5c8a61a41e0afc8d0da696c89c0bb997ae978e119872a5ca336de2c710640779"}
Jul 15 23:30:44.218342 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:44.218321    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9lphg"]
Jul 15 23:30:44.221284 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:30:44.221264    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda35cfa6e_c492_4a49_9002_5e2ba013c744.slice/crio-84a7176b9c7b7983538f508b41eec7e7f728ae9424f86552c013f06e95efa222 WatchSource:0}: Error finding container 84a7176b9c7b7983538f508b41eec7e7f728ae9424f86552c013f06e95efa222: Status 404 returned error can't find the container with id 84a7176b9c7b7983538f508b41eec7e7f728ae9424f86552c013f06e95efa222
Jul 15 23:30:44.225644 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:44.225599    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rnn4g" podStartSLOduration=1.313852529 podStartE2EDuration="3.225582099s" totalImagesPullingTime="1.91172957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:30:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:30:44.224979795 +0000 UTC m=+66.768702148" watchObservedRunningTime="2026-07-15 23:30:44.225582099 +0000 UTC m=+66.769304454"
Jul 15 23:30:45.093406 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:45.093371    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63e974da-1418-40b8-a9f2-8b07406a824b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-r9gdz\" (UID: \"63e974da-1418-40b8-a9f2-8b07406a824b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-r9gdz"
Jul 15 23:30:45.093960 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:45.093495    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 23:30:45.093960 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:45.093573    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63e974da-1418-40b8-a9f2-8b07406a824b-cluster-monitoring-operator-tls podName:63e974da-1418-40b8-a9f2-8b07406a824b nodeName:}" failed. No retries permitted until 2026-07-15 23:30:49.093553233 +0000 UTC m=+71.637275568 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/63e974da-1418-40b8-a9f2-8b07406a824b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-r9gdz" (UID: "63e974da-1418-40b8-a9f2-8b07406a824b") : secret "cluster-monitoring-operator-tls" not found
Jul 15 23:30:45.194697 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:45.194467    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls\") pod \"dns-default-chmd4\" (UID: \"4a5e7446-d01c-4487-8450-b853f451b6f0\") " pod="openshift-dns/dns-default-chmd4"
Jul 15 23:30:45.194697 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:45.194544    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:30:45.194697 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:45.194627    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 23:30:45.194697 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:45.194659    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 23:30:45.194697 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:45.194700    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls podName:4a5e7446-d01c-4487-8450-b853f451b6f0 nodeName:}" failed. No retries permitted until 2026-07-15 23:31:17.194678847 +0000 UTC m=+99.738401199 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls") pod "dns-default-chmd4" (UID: "4a5e7446-d01c-4487-8450-b853f451b6f0") : secret "dns-default-metrics-tls" not found
Jul 15 23:30:45.195098 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:45.194734    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66fb4fddbc-jcp7c: secret "image-registry-tls" not found
Jul 15 23:30:45.195098 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:45.194794    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls podName:68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd nodeName:}" failed. No retries permitted until 2026-07-15 23:31:17.194779322 +0000 UTC m=+99.738501670 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls") pod "image-registry-66fb4fddbc-jcp7c" (UID: "68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd") : secret "image-registry-tls" not found
Jul 15 23:30:45.215820 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:45.215782    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9lphg" event={"ID":"a35cfa6e-c492-4a49-9002-5e2ba013c744","Type":"ContainerStarted","Data":"84a7176b9c7b7983538f508b41eec7e7f728ae9424f86552c013f06e95efa222"}
Jul 15 23:30:48.224862 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:48.224827    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9lphg" event={"ID":"a35cfa6e-c492-4a49-9002-5e2ba013c744","Type":"ContainerStarted","Data":"04fbcbe464b7f3c64101c41a012ee8741af766b4825117251c703b516ffbed29"}
Jul 15 23:30:48.225325 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:48.224981    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:30:48.239009 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:48.238970    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9lphg" podStartSLOduration=65.839691154 podStartE2EDuration="1m9.238957568s" totalImagesPullingTime="3.399266414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:30:48.238371891 +0000 UTC m=+70.782094245" watchObservedRunningTime="2026-07-15 23:30:48.238957568 +0000 UTC m=+70.782679945"
Jul 15 23:30:49.128752 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:49.128713    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63e974da-1418-40b8-a9f2-8b07406a824b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-r9gdz\" (UID: \"63e974da-1418-40b8-a9f2-8b07406a824b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-r9gdz"
Jul 15 23:30:49.128937 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:49.128871    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 23:30:49.129013 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:49.128947    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63e974da-1418-40b8-a9f2-8b07406a824b-cluster-monitoring-operator-tls podName:63e974da-1418-40b8-a9f2-8b07406a824b nodeName:}" failed. No retries permitted until 2026-07-15 23:30:57.128927287 +0000 UTC m=+79.672649632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/63e974da-1418-40b8-a9f2-8b07406a824b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-r9gdz" (UID: "63e974da-1418-40b8-a9f2-8b07406a824b") : secret "cluster-monitoring-operator-tls" not found
Jul 15 23:30:50.231566 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:50.231529    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s9w89" event={"ID":"943763e4-c636-494b-ac1f-b63c8e43a744","Type":"ContainerStarted","Data":"5bfadc30e66c45bedd2ac397c48f1e916d5dd0c115889272148a16c72ba424ba"}
Jul 15 23:30:50.837952 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:50.837928    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h4fg7_9c1eb0ec-907d-4e1b-9397-0336edac638d/dns-node-resolver/0.log"
Jul 15 23:30:52.038795 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:52.038769    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t8kxt_49685317-16b6-4fc9-be9d-30b2f82d1967/node-ca/0.log"
Jul 15 23:30:52.640223 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:52.640197    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n2bfn_a82e22d2-37b0-47c0-bf61-e97be360aea0/serve-healthcheck-canary/0.log"
Jul 15 23:30:57.185276 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:30:57.185224    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63e974da-1418-40b8-a9f2-8b07406a824b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-r9gdz\" (UID: \"63e974da-1418-40b8-a9f2-8b07406a824b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-r9gdz"
Jul 15 23:30:57.185662 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:57.185348    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 23:30:57.185662 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:30:57.185412    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63e974da-1418-40b8-a9f2-8b07406a824b-cluster-monitoring-operator-tls podName:63e974da-1418-40b8-a9f2-8b07406a824b nodeName:}" failed. No retries permitted until 2026-07-15 23:31:13.185396481 +0000 UTC m=+95.729118812 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/63e974da-1418-40b8-a9f2-8b07406a824b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-r9gdz" (UID: "63e974da-1418-40b8-a9f2-8b07406a824b") : secret "cluster-monitoring-operator-tls" not found
Jul 15 23:31:07.443804 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.443662    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s9w89" podStartSLOduration=83.200352007 podStartE2EDuration="1m28.443647253s" totalImagesPullingTime="5.243295246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:30:50.247622236 +0000 UTC m=+72.791344591" watchObservedRunningTime="2026-07-15 23:31:07.443647253 +0000 UTC m=+89.987369607"
Jul 15 23:31:07.444491 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.444474    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-q7p4w"]
Jul 15 23:31:07.449006 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.448991    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q7p4w"
Jul 15 23:31:07.455266 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.455200    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 23:31:07.455385 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.455280    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xzgrt\""
Jul 15 23:31:07.455385 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.455371    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 23:31:07.455984 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.455965    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 23:31:07.457506 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.457489    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 23:31:07.463154 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.463132    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q7p4w"]
Jul 15 23:31:07.500864 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.500841    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84c8d974b8-2zl8s"]
Jul 15 23:31:07.503716 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.503699    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84c8d974b8-2zl8s"
Jul 15 23:31:07.507889 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.507873    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-dnpgs\""
Jul 15 23:31:07.508071 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.508047    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 15 23:31:07.508171 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.508108    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 15 23:31:07.508171 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.508057    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 15 23:31:07.509522 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.509331    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 15 23:31:07.530616 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.530596    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84c8d974b8-2zl8s"]
Jul 15 23:31:07.555453 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.555430    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q7p4w\" (UID: \"f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f\") " pod="openshift-insights/insights-runtime-extractor-q7p4w"
Jul 15 23:31:07.555538 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.555471    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6g9g\" (UniqueName: \"kubernetes.io/projected/f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f-kube-api-access-p6g9g\") pod \"insights-runtime-extractor-q7p4w\" (UID: \"f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f\") " pod="openshift-insights/insights-runtime-extractor-q7p4w"
Jul 15 23:31:07.555538 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.555504    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f-data-volume\") pod \"insights-runtime-extractor-q7p4w\" (UID: \"f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f\") " pod="openshift-insights/insights-runtime-extractor-q7p4w"
Jul 15 23:31:07.555618 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.555566    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f-crio-socket\") pod \"insights-runtime-extractor-q7p4w\" (UID: \"f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f\") " pod="openshift-insights/insights-runtime-extractor-q7p4w"
Jul 15 23:31:07.555618 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.555594    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q7p4w\" (UID: \"f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f\") " pod="openshift-insights/insights-runtime-extractor-q7p4w"
Jul 15 23:31:07.595956 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.595935    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2592g"]
Jul 15 23:31:07.598748 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.598733    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2592g"
Jul 15 23:31:07.601136 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.601108    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 15 23:31:07.601250 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.601174    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8q2dp\""
Jul 15 23:31:07.601250 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.601186    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 15 23:31:07.611963 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.611947    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2592g"]
Jul 15 23:31:07.656691 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.656664    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f-crio-socket\") pod \"insights-runtime-extractor-q7p4w\" (UID: \"f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f\") " pod="openshift-insights/insights-runtime-extractor-q7p4w"
Jul 15 23:31:07.656787 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.656696    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bed32c6b-2085-4aa0-af5b-3250e2f47db7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-84c8d974b8-2zl8s\" (UID: \"bed32c6b-2085-4aa0-af5b-3250e2f47db7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84c8d974b8-2zl8s"
Jul 15 23:31:07.656787 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.656717    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q7p4w\" (UID: \"f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f\") " pod="openshift-insights/insights-runtime-extractor-q7p4w"
Jul 15 23:31:07.656787 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.656735    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8htg\" (UniqueName: \"kubernetes.io/projected/c1390dd1-fb99-4f5d-a2ee-205c999d8e9c-kube-api-access-c8htg\") pod \"migrator-7f59b54f6c-2592g\" (UID: \"c1390dd1-fb99-4f5d-a2ee-205c999d8e9c\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2592g"
Jul 15 23:31:07.656787 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.656782    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f-crio-socket\") pod \"insights-runtime-extractor-q7p4w\" (UID: \"f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f\") " pod="openshift-insights/insights-runtime-extractor-q7p4w"
Jul 15 23:31:07.656961 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.656811    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7sx8\" (UniqueName: \"kubernetes.io/projected/bed32c6b-2085-4aa0-af5b-3250e2f47db7-kube-api-access-n7sx8\") pod \"managed-serviceaccount-addon-agent-84c8d974b8-2zl8s\" (UID: \"bed32c6b-2085-4aa0-af5b-3250e2f47db7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84c8d974b8-2zl8s"
Jul 15 23:31:07.656961 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.656868    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f-data-volume\") pod \"insights-runtime-extractor-q7p4w\" (UID: \"f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f\") " pod="openshift-insights/insights-runtime-extractor-q7p4w"
Jul 15 23:31:07.656961 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.656892    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q7p4w\" (UID: \"f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f\") " pod="openshift-insights/insights-runtime-extractor-q7p4w"
Jul 15 23:31:07.656961 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.656926    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6g9g\" (UniqueName: \"kubernetes.io/projected/f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f-kube-api-access-p6g9g\") pod \"insights-runtime-extractor-q7p4w\" (UID: \"f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f\") " pod="openshift-insights/insights-runtime-extractor-q7p4w"
Jul 15 23:31:07.657155 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.657145    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q7p4w\" (UID: \"f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f\") " pod="openshift-insights/insights-runtime-extractor-q7p4w"
Jul 15 23:31:07.657200 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.657148    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f-data-volume\") pod \"insights-runtime-extractor-q7p4w\" (UID: \"f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f\") " pod="openshift-insights/insights-runtime-extractor-q7p4w"
Jul 15 23:31:07.659163 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.659139    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q7p4w\" (UID: \"f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f\") " pod="openshift-insights/insights-runtime-extractor-q7p4w"
Jul 15 23:31:07.674600 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.674571    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6g9g\" (UniqueName: \"kubernetes.io/projected/f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f-kube-api-access-p6g9g\") pod \"insights-runtime-extractor-q7p4w\" (UID: \"f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f\") " pod="openshift-insights/insights-runtime-extractor-q7p4w"
Jul 15 23:31:07.757897 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.757874    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q7p4w"
Jul 15 23:31:07.757999 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.757936    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bed32c6b-2085-4aa0-af5b-3250e2f47db7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-84c8d974b8-2zl8s\" (UID: \"bed32c6b-2085-4aa0-af5b-3250e2f47db7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84c8d974b8-2zl8s"
Jul 15 23:31:07.757999 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.757974    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8htg\" (UniqueName: \"kubernetes.io/projected/c1390dd1-fb99-4f5d-a2ee-205c999d8e9c-kube-api-access-c8htg\") pod \"migrator-7f59b54f6c-2592g\" (UID: \"c1390dd1-fb99-4f5d-a2ee-205c999d8e9c\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2592g"
Jul 15 23:31:07.758115 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.758030    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7sx8\" (UniqueName: \"kubernetes.io/projected/bed32c6b-2085-4aa0-af5b-3250e2f47db7-kube-api-access-n7sx8\") pod \"managed-serviceaccount-addon-agent-84c8d974b8-2zl8s\" (UID: \"bed32c6b-2085-4aa0-af5b-3250e2f47db7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84c8d974b8-2zl8s"
Jul 15 23:31:07.760194 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.760174    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bed32c6b-2085-4aa0-af5b-3250e2f47db7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-84c8d974b8-2zl8s\" (UID: \"bed32c6b-2085-4aa0-af5b-3250e2f47db7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84c8d974b8-2zl8s"
Jul 15 23:31:07.768649 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.768611    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7sx8\" (UniqueName: \"kubernetes.io/projected/bed32c6b-2085-4aa0-af5b-3250e2f47db7-kube-api-access-n7sx8\") pod \"managed-serviceaccount-addon-agent-84c8d974b8-2zl8s\" (UID: \"bed32c6b-2085-4aa0-af5b-3250e2f47db7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84c8d974b8-2zl8s"
Jul 15 23:31:07.768649 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.768639    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8htg\" (UniqueName: \"kubernetes.io/projected/c1390dd1-fb99-4f5d-a2ee-205c999d8e9c-kube-api-access-c8htg\") pod \"migrator-7f59b54f6c-2592g\" (UID: \"c1390dd1-fb99-4f5d-a2ee-205c999d8e9c\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2592g"
Jul 15 23:31:07.823243 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.823206    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84c8d974b8-2zl8s"
Jul 15 23:31:07.891899 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.891868    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q7p4w"]
Jul 15 23:31:07.895613 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:31:07.895586    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4ebf79d_eeb3_40b5_afa5_74ddb5ca060f.slice/crio-4eda28c2c333b36313310844b46febcabc13bffab60253fb297d97931d92ae76 WatchSource:0}: Error finding container 4eda28c2c333b36313310844b46febcabc13bffab60253fb297d97931d92ae76: Status 404 returned error can't find the container with id 4eda28c2c333b36313310844b46febcabc13bffab60253fb297d97931d92ae76
Jul 15 23:31:07.907510 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.907477    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2592g"
Jul 15 23:31:07.950858 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:07.950831    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84c8d974b8-2zl8s"]
Jul 15 23:31:07.954334 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:31:07.954305    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbed32c6b_2085_4aa0_af5b_3250e2f47db7.slice/crio-b7dd1ec3ad2fdcc45ff6b73981bef19e11fe828b2c5a1b90ef3dfa650ec82e19 WatchSource:0}: Error finding container b7dd1ec3ad2fdcc45ff6b73981bef19e11fe828b2c5a1b90ef3dfa650ec82e19: Status 404 returned error can't find the container with id b7dd1ec3ad2fdcc45ff6b73981bef19e11fe828b2c5a1b90ef3dfa650ec82e19
Jul 15 23:31:08.031835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:08.031778    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2592g"]
Jul 15 23:31:08.034655 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:31:08.034633    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1390dd1_fb99_4f5d_a2ee_205c999d8e9c.slice/crio-92d7b99c19f63a7f5726fbc3e77d6ba8c30f4a32c1443663f8decdac6c5a8198 WatchSource:0}: Error finding container 92d7b99c19f63a7f5726fbc3e77d6ba8c30f4a32c1443663f8decdac6c5a8198: Status 404 returned error can't find the container with id 92d7b99c19f63a7f5726fbc3e77d6ba8c30f4a32c1443663f8decdac6c5a8198
Jul 15 23:31:08.279093 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:08.278994    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2592g" event={"ID":"c1390dd1-fb99-4f5d-a2ee-205c999d8e9c","Type":"ContainerStarted","Data":"92d7b99c19f63a7f5726fbc3e77d6ba8c30f4a32c1443663f8decdac6c5a8198"}
Jul 15 23:31:08.280579 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:08.280549    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84c8d974b8-2zl8s" event={"ID":"bed32c6b-2085-4aa0-af5b-3250e2f47db7","Type":"ContainerStarted","Data":"b7dd1ec3ad2fdcc45ff6b73981bef19e11fe828b2c5a1b90ef3dfa650ec82e19"}
Jul 15 23:31:08.282133 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:08.282070    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q7p4w" event={"ID":"f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f","Type":"ContainerStarted","Data":"4eda28c2c333b36313310844b46febcabc13bffab60253fb297d97931d92ae76"}
Jul 15 23:31:08.713790 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:08.712730    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-5dr64"]
Jul 15 23:31:08.716725 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:08.715946    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-5dr64"
Jul 15 23:31:08.718379 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:08.718355    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-2vw6v\""
Jul 15 23:31:08.718601 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:08.718585    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 23:31:08.718819 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:08.718803    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 23:31:08.725474 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:08.725451    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-5dr64"]
Jul 15 23:31:08.872302 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:08.872263    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8b6x\" (UniqueName: \"kubernetes.io/projected/71c24f93-ca51-4491-a5d2-b9270f9330f6-kube-api-access-f8b6x\") pod \"downloads-68c9cbb497-5dr64\" (UID: \"71c24f93-ca51-4491-a5d2-b9270f9330f6\") " pod="openshift-console/downloads-68c9cbb497-5dr64"
Jul 15 23:31:08.974018 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:08.973925    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8b6x\" (UniqueName: \"kubernetes.io/projected/71c24f93-ca51-4491-a5d2-b9270f9330f6-kube-api-access-f8b6x\") pod \"downloads-68c9cbb497-5dr64\" (UID: \"71c24f93-ca51-4491-a5d2-b9270f9330f6\") " pod="openshift-console/downloads-68c9cbb497-5dr64"
Jul 15 23:31:08.988205 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:08.984908    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8b6x\" (UniqueName: \"kubernetes.io/projected/71c24f93-ca51-4491-a5d2-b9270f9330f6-kube-api-access-f8b6x\") pod \"downloads-68c9cbb497-5dr64\" (UID: \"71c24f93-ca51-4491-a5d2-b9270f9330f6\") " pod="openshift-console/downloads-68c9cbb497-5dr64"
Jul 15 23:31:09.029963 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:09.029634    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-5dr64"
Jul 15 23:31:09.565680 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:09.565623    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-5dr64"]
Jul 15 23:31:09.571134 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:31:09.571107    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c24f93_ca51_4491_a5d2_b9270f9330f6.slice/crio-a8e2cd264e4a50cd49ec714a90994d0ea1676b7e539265ef9ddb20e43a0c2f41 WatchSource:0}: Error finding container a8e2cd264e4a50cd49ec714a90994d0ea1676b7e539265ef9ddb20e43a0c2f41: Status 404 returned error can't find the container with id a8e2cd264e4a50cd49ec714a90994d0ea1676b7e539265ef9ddb20e43a0c2f41
Jul 15 23:31:10.290620 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:10.290549    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-5dr64" event={"ID":"71c24f93-ca51-4491-a5d2-b9270f9330f6","Type":"ContainerStarted","Data":"a8e2cd264e4a50cd49ec714a90994d0ea1676b7e539265ef9ddb20e43a0c2f41"}
Jul 15 23:31:10.292765 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:10.292677    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2592g" event={"ID":"c1390dd1-fb99-4f5d-a2ee-205c999d8e9c","Type":"ContainerStarted","Data":"ef4ca14d6b96868b3ea709ace9d270391d1d89dd67f9b57277c0720a4616847c"}
Jul 15 23:31:10.292765 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:10.292724    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2592g" event={"ID":"c1390dd1-fb99-4f5d-a2ee-205c999d8e9c","Type":"ContainerStarted","Data":"32bfebe732acde827c923bf89fca43b901167a7a4d5c87d81194e2e2822c7851"}
Jul 15 23:31:10.308005 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:10.307810    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2592g" podStartSLOduration=1.877874889 podStartE2EDuration="3.307796372s" totalImagesPullingTime="1.429921483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:31:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:31:10.306196305 +0000 UTC m=+92.849918661" watchObservedRunningTime="2026-07-15 23:31:10.307796372 +0000 UTC m=+92.851518726"
Jul 15 23:31:13.212449 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:13.212408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63e974da-1418-40b8-a9f2-8b07406a824b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-r9gdz\" (UID: \"63e974da-1418-40b8-a9f2-8b07406a824b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-r9gdz"
Jul 15 23:31:13.215390 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:13.215341    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/63e974da-1418-40b8-a9f2-8b07406a824b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-r9gdz\" (UID: \"63e974da-1418-40b8-a9f2-8b07406a824b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-r9gdz"
Jul 15 23:31:13.240302 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:13.240273    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-r9gdz"
Jul 15 23:31:13.906954 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:13.906929    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-r9gdz"]
Jul 15 23:31:13.911276 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:31:13.911214    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63e974da_1418_40b8_a9f2_8b07406a824b.slice/crio-91e7b3350aac8bd00c954ed047cfc07336b82344bf717c280117d8bec4cd2df7 WatchSource:0}: Error finding container 91e7b3350aac8bd00c954ed047cfc07336b82344bf717c280117d8bec4cd2df7: Status 404 returned error can't find the container with id 91e7b3350aac8bd00c954ed047cfc07336b82344bf717c280117d8bec4cd2df7
Jul 15 23:31:14.310169 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:14.310111    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84c8d974b8-2zl8s" event={"ID":"bed32c6b-2085-4aa0-af5b-3250e2f47db7","Type":"ContainerStarted","Data":"fbbc88fe603f48a075e02f272492e4511284c7831b73324e55795a5e1af2020f"}
Jul 15 23:31:14.312446 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:14.312378    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q7p4w" event={"ID":"f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f","Type":"ContainerStarted","Data":"ee7358288ff5214519b56751bfd7de56a726aefaf28aa0d3cd2bd2775910cc1e"}
Jul 15 23:31:14.313815 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:14.313764    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-r9gdz" event={"ID":"63e974da-1418-40b8-a9f2-8b07406a824b","Type":"ContainerStarted","Data":"91e7b3350aac8bd00c954ed047cfc07336b82344bf717c280117d8bec4cd2df7"}
Jul 15 23:31:14.325485 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:14.324825    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84c8d974b8-2zl8s" podStartSLOduration=1.5213805489999999 podStartE2EDuration="7.324807247s" totalImagesPullingTime="5.803426698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:31:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:31:14.323999524 +0000 UTC m=+96.867721879" watchObservedRunningTime="2026-07-15 23:31:14.324807247 +0000 UTC m=+96.868529595"
Jul 15 23:31:17.249132 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.249092    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:31:17.249665 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.249152    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls\") pod \"dns-default-chmd4\" (UID: \"4a5e7446-d01c-4487-8450-b853f451b6f0\") " pod="openshift-dns/dns-default-chmd4"
Jul 15 23:31:17.251979 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.251953    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5e7446-d01c-4487-8450-b853f451b6f0-metrics-tls\") pod \"dns-default-chmd4\" (UID: \"4a5e7446-d01c-4487-8450-b853f451b6f0\") " pod="openshift-dns/dns-default-chmd4"
Jul 15 23:31:17.252102 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.252081    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls\") pod \"image-registry-66fb4fddbc-jcp7c\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") " pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:31:17.266009 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.265979    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mj9fx\""
Jul 15 23:31:17.274097 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.274071    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:31:17.274471 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.274448    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hnnk9\""
Jul 15 23:31:17.283007 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.282935    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-chmd4"
Jul 15 23:31:17.631562 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.631472    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85dcf6d6d-s22zb"]
Jul 15 23:31:17.639859 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.639830    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85dcf6d6d-s22zb"
Jul 15 23:31:17.642118 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.642097    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 23:31:17.643173 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.643151    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 23:31:17.643753 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.643382    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 23:31:17.643753 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.643452    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 23:31:17.643753 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.643643    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-x4dg9\""
Jul 15 23:31:17.643753 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.643651    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 23:31:17.644474 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.644416    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85dcf6d6d-s22zb"]
Jul 15 23:31:17.755004 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.754971    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a51ccc49-7ac8-447d-97d6-5d18e6186972-console-config\") pod \"console-85dcf6d6d-s22zb\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") " pod="openshift-console/console-85dcf6d6d-s22zb"
Jul 15 23:31:17.755181 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.755039    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a51ccc49-7ac8-447d-97d6-5d18e6186972-service-ca\") pod \"console-85dcf6d6d-s22zb\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") " pod="openshift-console/console-85dcf6d6d-s22zb"
Jul 15 23:31:17.755181 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.755095    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a51ccc49-7ac8-447d-97d6-5d18e6186972-oauth-serving-cert\") pod \"console-85dcf6d6d-s22zb\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") " pod="openshift-console/console-85dcf6d6d-s22zb"
Jul 15 23:31:17.755181 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.755164    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a51ccc49-7ac8-447d-97d6-5d18e6186972-console-oauth-config\") pod \"console-85dcf6d6d-s22zb\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") " pod="openshift-console/console-85dcf6d6d-s22zb"
Jul 15 23:31:17.755370 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.755204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf47b\" (UniqueName: \"kubernetes.io/projected/a51ccc49-7ac8-447d-97d6-5d18e6186972-kube-api-access-zf47b\") pod \"console-85dcf6d6d-s22zb\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") " pod="openshift-console/console-85dcf6d6d-s22zb"
Jul 15 23:31:17.755370 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.755293    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a51ccc49-7ac8-447d-97d6-5d18e6186972-console-serving-cert\") pod \"console-85dcf6d6d-s22zb\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") " pod="openshift-console/console-85dcf6d6d-s22zb"
Jul 15 23:31:17.856358 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.856326    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a51ccc49-7ac8-447d-97d6-5d18e6186972-console-oauth-config\") pod \"console-85dcf6d6d-s22zb\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") " pod="openshift-console/console-85dcf6d6d-s22zb"
Jul 15 23:31:17.856569 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.856377    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf47b\" (UniqueName: \"kubernetes.io/projected/a51ccc49-7ac8-447d-97d6-5d18e6186972-kube-api-access-zf47b\") pod \"console-85dcf6d6d-s22zb\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") " pod="openshift-console/console-85dcf6d6d-s22zb"
Jul 15 23:31:17.856569 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.856414    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a51ccc49-7ac8-447d-97d6-5d18e6186972-console-serving-cert\") pod \"console-85dcf6d6d-s22zb\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") " pod="openshift-console/console-85dcf6d6d-s22zb"
Jul 15 23:31:17.856569 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.856439    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a51ccc49-7ac8-447d-97d6-5d18e6186972-console-config\") pod \"console-85dcf6d6d-s22zb\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") " pod="openshift-console/console-85dcf6d6d-s22zb"
Jul 15 23:31:17.856569 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.856481    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a51ccc49-7ac8-447d-97d6-5d18e6186972-service-ca\") pod \"console-85dcf6d6d-s22zb\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") " pod="openshift-console/console-85dcf6d6d-s22zb"
Jul 15 23:31:17.856569 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.856513    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a51ccc49-7ac8-447d-97d6-5d18e6186972-oauth-serving-cert\") pod \"console-85dcf6d6d-s22zb\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") " pod="openshift-console/console-85dcf6d6d-s22zb"
Jul 15 23:31:17.857225 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.857198    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a51ccc49-7ac8-447d-97d6-5d18e6186972-oauth-serving-cert\") pod \"console-85dcf6d6d-s22zb\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") " pod="openshift-console/console-85dcf6d6d-s22zb"
Jul 15 23:31:17.857365 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.857276    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a51ccc49-7ac8-447d-97d6-5d18e6186972-console-config\") pod \"console-85dcf6d6d-s22zb\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") " pod="openshift-console/console-85dcf6d6d-s22zb"
Jul 15 23:31:17.857365 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.857321    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a51ccc49-7ac8-447d-97d6-5d18e6186972-service-ca\") pod \"console-85dcf6d6d-s22zb\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") " pod="openshift-console/console-85dcf6d6d-s22zb"
Jul 15 23:31:17.859280 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.859259    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a51ccc49-7ac8-447d-97d6-5d18e6186972-console-oauth-config\") pod \"console-85dcf6d6d-s22zb\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") " pod="openshift-console/console-85dcf6d6d-s22zb"
Jul 15 23:31:17.859873 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.859831    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a51ccc49-7ac8-447d-97d6-5d18e6186972-console-serving-cert\") pod \"console-85dcf6d6d-s22zb\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") " pod="openshift-console/console-85dcf6d6d-s22zb"
Jul 15 23:31:17.864533 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.864493    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf47b\" (UniqueName: \"kubernetes.io/projected/a51ccc49-7ac8-447d-97d6-5d18e6186972-kube-api-access-zf47b\") pod \"console-85dcf6d6d-s22zb\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") " pod="openshift-console/console-85dcf6d6d-s22zb"
Jul 15 23:31:17.953029 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:17.953007    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85dcf6d6d-s22zb"
Jul 15 23:31:18.325150 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:18.325076    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-chmd4"]
Jul 15 23:31:18.331386 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:31:18.329581    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a5e7446_d01c_4487_8450_b853f451b6f0.slice/crio-beacb8229ad8b5d9c58c086a3264c2c353bf9b0887748cf87297dad96a9e9cee WatchSource:0}: Error finding container beacb8229ad8b5d9c58c086a3264c2c353bf9b0887748cf87297dad96a9e9cee: Status 404 returned error can't find the container with id beacb8229ad8b5d9c58c086a3264c2c353bf9b0887748cf87297dad96a9e9cee
Jul 15 23:31:18.340651 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:18.340622    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-r9gdz" event={"ID":"63e974da-1418-40b8-a9f2-8b07406a824b","Type":"ContainerStarted","Data":"3b8ae339d00e8a8ae4f39dece8ab700e56cb18f52c637f9bde43c68aa5cee9b0"}
Jul 15 23:31:18.358785 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:18.358733    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-r9gdz" podStartSLOduration=33.106598804 podStartE2EDuration="37.358713895s" totalImagesPullingTime="4.252115091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:30:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:31:18.358412755 +0000 UTC m=+100.902135122" watchObservedRunningTime="2026-07-15 23:31:18.358713895 +0000 UTC m=+100.902436251"
Jul 15 23:31:18.560704 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:18.560602    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85dcf6d6d-s22zb"]
Jul 15 23:31:18.564165 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:31:18.564139    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda51ccc49_7ac8_447d_97d6_5d18e6186972.slice/crio-6665bdf0f473e698c3c6cca75fa4119b7ed7a32d510587044effcbf389305cda WatchSource:0}: Error finding container 6665bdf0f473e698c3c6cca75fa4119b7ed7a32d510587044effcbf389305cda: Status 404 returned error can't find the container with id 6665bdf0f473e698c3c6cca75fa4119b7ed7a32d510587044effcbf389305cda
Jul 15 23:31:18.564933 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:18.564868    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66fb4fddbc-jcp7c"]
Jul 15 23:31:18.570644 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:31:18.570553    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68137bb8_91d0_4f64_b8eb_cd9cf2d0c6cd.slice/crio-13a1f861df5d679c745be5fc2c19cc59330c77cbbffff2f317bf171f1144703b WatchSource:0}: Error finding container 13a1f861df5d679c745be5fc2c19cc59330c77cbbffff2f317bf171f1144703b: Status 404 returned error can't find the container with id 13a1f861df5d679c745be5fc2c19cc59330c77cbbffff2f317bf171f1144703b
Jul 15 23:31:19.230422 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:19.230285    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9lphg"
Jul 15 23:31:19.352684 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:19.352647    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85dcf6d6d-s22zb" event={"ID":"a51ccc49-7ac8-447d-97d6-5d18e6186972","Type":"ContainerStarted","Data":"6665bdf0f473e698c3c6cca75fa4119b7ed7a32d510587044effcbf389305cda"}
Jul 15 23:31:19.355181 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:19.355156    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c" event={"ID":"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd","Type":"ContainerStarted","Data":"e9454bb0160d9c1701485d9adc55dacb7d1e7bba61ea670490930414237426db"}
Jul 15 23:31:19.355396 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:19.355364    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c" event={"ID":"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd","Type":"ContainerStarted","Data":"13a1f861df5d679c745be5fc2c19cc59330c77cbbffff2f317bf171f1144703b"}
Jul 15 23:31:19.355509 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:19.355429    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:31:19.357166 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:19.357140    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-chmd4" event={"ID":"4a5e7446-d01c-4487-8450-b853f451b6f0","Type":"ContainerStarted","Data":"beacb8229ad8b5d9c58c086a3264c2c353bf9b0887748cf87297dad96a9e9cee"}
Jul 15 23:31:19.360318 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:19.360298    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q7p4w" event={"ID":"f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f","Type":"ContainerStarted","Data":"4b28b7225364d037fc4d883d2c9b5aaa701c9bfaf6542e9b861025252d235999"}
Jul 15 23:31:19.375852 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:19.375807    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c" podStartSLOduration=78.375791841 podStartE2EDuration="1m18.375791841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:30:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:31:19.374800198 +0000 UTC m=+101.918522552" watchObservedRunningTime="2026-07-15 23:31:19.375791841 +0000 UTC m=+101.919514194"
Jul 15 23:31:23.813933 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:23.813898    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-9sv5k"]
Jul 15 23:31:23.817680 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:23.817657    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-9sv5k"
Jul 15 23:31:23.820772 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:23.820746    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hg9dv\""
Jul 15 23:31:23.820772 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:23.820762    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 15 23:31:23.820984 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:23.820772    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 15 23:31:23.821670 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:23.821457    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 23:31:23.836840 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:23.836816    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-9sv5k"]
Jul 15 23:31:24.006028 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:24.005986    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd8ca0be-afb0-46df-910c-7190fbd9b7ef-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-9sv5k\" (UID: \"cd8ca0be-afb0-46df-910c-7190fbd9b7ef\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9sv5k"
Jul 15 23:31:24.006184 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:24.006096    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd8ca0be-afb0-46df-910c-7190fbd9b7ef-metrics-client-ca\") pod \"prometheus-operator-64785b6675-9sv5k\" (UID: \"cd8ca0be-afb0-46df-910c-7190fbd9b7ef\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9sv5k"
Jul 15 23:31:24.006184 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:24.006146    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w49f\" (UniqueName: \"kubernetes.io/projected/cd8ca0be-afb0-46df-910c-7190fbd9b7ef-kube-api-access-6w49f\") pod \"prometheus-operator-64785b6675-9sv5k\" (UID: \"cd8ca0be-afb0-46df-910c-7190fbd9b7ef\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9sv5k"
Jul 15 23:31:24.006310 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:24.006195    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd8ca0be-afb0-46df-910c-7190fbd9b7ef-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-9sv5k\" (UID: \"cd8ca0be-afb0-46df-910c-7190fbd9b7ef\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9sv5k"
Jul 15 23:31:24.107568 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:24.107494    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w49f\" (UniqueName: \"kubernetes.io/projected/cd8ca0be-afb0-46df-910c-7190fbd9b7ef-kube-api-access-6w49f\") pod \"prometheus-operator-64785b6675-9sv5k\" (UID: \"cd8ca0be-afb0-46df-910c-7190fbd9b7ef\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9sv5k"
Jul 15 23:31:24.107568 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:24.107551    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd8ca0be-afb0-46df-910c-7190fbd9b7ef-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-9sv5k\" (UID: \"cd8ca0be-afb0-46df-910c-7190fbd9b7ef\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9sv5k"
Jul 15 23:31:24.107772 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:24.107593    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd8ca0be-afb0-46df-910c-7190fbd9b7ef-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-9sv5k\" (UID: \"cd8ca0be-afb0-46df-910c-7190fbd9b7ef\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9sv5k"
Jul 15 23:31:24.107772 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:24.107665    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd8ca0be-afb0-46df-910c-7190fbd9b7ef-metrics-client-ca\") pod \"prometheus-operator-64785b6675-9sv5k\" (UID: \"cd8ca0be-afb0-46df-910c-7190fbd9b7ef\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9sv5k"
Jul 15 23:31:24.108407 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:24.108362    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd8ca0be-afb0-46df-910c-7190fbd9b7ef-metrics-client-ca\") pod \"prometheus-operator-64785b6675-9sv5k\" (UID: \"cd8ca0be-afb0-46df-910c-7190fbd9b7ef\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9sv5k"
Jul 15 23:31:24.110305 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:24.110278    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd8ca0be-afb0-46df-910c-7190fbd9b7ef-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-9sv5k\" (UID: \"cd8ca0be-afb0-46df-910c-7190fbd9b7ef\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9sv5k"
Jul 15 23:31:24.110421 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:24.110327    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd8ca0be-afb0-46df-910c-7190fbd9b7ef-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-9sv5k\" (UID: \"cd8ca0be-afb0-46df-910c-7190fbd9b7ef\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9sv5k"
Jul 15 23:31:24.122153 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:24.122126    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w49f\" (UniqueName: \"kubernetes.io/projected/cd8ca0be-afb0-46df-910c-7190fbd9b7ef-kube-api-access-6w49f\") pod \"prometheus-operator-64785b6675-9sv5k\" (UID: \"cd8ca0be-afb0-46df-910c-7190fbd9b7ef\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9sv5k"
Jul 15 23:31:24.128341 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:24.128320    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-9sv5k"
Jul 15 23:31:30.692010 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:30.691971    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66fb4fddbc-jcp7c"]
Jul 15 23:31:31.065536 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:31.065502    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85dcf6d6d-s22zb"]
Jul 15 23:31:31.794451 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:31.794424    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-9sv5k"]
Jul 15 23:31:31.797451 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:31:31.797428    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd8ca0be_afb0_46df_910c_7190fbd9b7ef.slice/crio-2a5ead932e5cce6c2b08acfbe552316b383b6d52155860a8e8d372bd55fb5c56 WatchSource:0}: Error finding container 2a5ead932e5cce6c2b08acfbe552316b383b6d52155860a8e8d372bd55fb5c56: Status 404 returned error can't find the container with id 2a5ead932e5cce6c2b08acfbe552316b383b6d52155860a8e8d372bd55fb5c56
Jul 15 23:31:32.412886 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:32.412846    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q7p4w" event={"ID":"f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f","Type":"ContainerStarted","Data":"e443fc26e4da434d00d53fa8c3c97101efc59aab2f9db853abc9069f41b9c39b"}
Jul 15 23:31:32.415168 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:32.415136    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85dcf6d6d-s22zb" event={"ID":"a51ccc49-7ac8-447d-97d6-5d18e6186972","Type":"ContainerStarted","Data":"79910d20105cb63e95fe3d24a27b6a192d982f8263290beb0b911c06f08bb42e"}
Jul 15 23:31:32.417181 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:32.417128    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-5dr64" event={"ID":"71c24f93-ca51-4491-a5d2-b9270f9330f6","Type":"ContainerStarted","Data":"d7a315024ee6b981592b2a77c9c3e3393a10dc4a66bbe8549bc918a250015fbc"}
Jul 15 23:31:32.417373 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:32.417354    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-5dr64"
Jul 15 23:31:32.420032 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:32.420001    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-chmd4" event={"ID":"4a5e7446-d01c-4487-8450-b853f451b6f0","Type":"ContainerStarted","Data":"de1642befe739bb4fdf5d3cc7389bfb48781d639b82a8bb28fcf8f9f67f34cc2"}
Jul 15 23:31:32.420144 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:32.420049    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-chmd4" event={"ID":"4a5e7446-d01c-4487-8450-b853f451b6f0","Type":"ContainerStarted","Data":"23c2479ef192ed855214c915af3d65437eb12a53fc17bd35f137260c113cbaba"}
Jul 15 23:31:32.420144 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:32.420117    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-chmd4"
Jul 15 23:31:32.421478 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:32.421455    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-9sv5k" event={"ID":"cd8ca0be-afb0-46df-910c-7190fbd9b7ef","Type":"ContainerStarted","Data":"2a5ead932e5cce6c2b08acfbe552316b383b6d52155860a8e8d372bd55fb5c56"}
Jul 15 23:31:32.429147 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:32.429106    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-q7p4w" podStartSLOduration=1.852426562 podStartE2EDuration="25.429093862s" totalImagesPullingTime="23.5766673s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:31:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:31:32.428291118 +0000 UTC m=+114.972013472" watchObservedRunningTime="2026-07-15 23:31:32.429093862 +0000 UTC m=+114.972816224"
Jul 15 23:31:32.430038 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:32.430013    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-5dr64"
Jul 15 23:31:32.443622 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:32.443584    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85dcf6d6d-s22zb" podStartSLOduration=2.354500351 podStartE2EDuration="15.443570947s" totalImagesPullingTime="13.089070596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:31:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:31:32.442981726 +0000 UTC m=+114.986704080" watchObservedRunningTime="2026-07-15 23:31:32.443570947 +0000 UTC m=+114.987293300"
Jul 15 23:31:32.457961 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:32.457917    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-chmd4" podStartSLOduration=66.134190231 podStartE2EDuration="1m19.457898958s" totalImagesPullingTime="13.323708727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:30:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:31:32.456569762 +0000 UTC m=+115.000292117" watchObservedRunningTime="2026-07-15 23:31:32.457898958 +0000 UTC m=+115.001621313"
Jul 15 23:31:32.470418 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:32.470372    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-5dr64" podStartSLOduration=2.334866979 podStartE2EDuration="24.470356799s" totalImagesPullingTime="22.13548982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:31:32.470128434 +0000 UTC m=+115.013850789" watchObservedRunningTime="2026-07-15 23:31:32.470356799 +0000 UTC m=+115.014079155"
Jul 15 23:31:34.433003 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:34.432967    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-9sv5k" event={"ID":"cd8ca0be-afb0-46df-910c-7190fbd9b7ef","Type":"ContainerStarted","Data":"52a9df3f9120a2ca53826ff169f11b06e2732994abdcdca90f9552e45f842193"}
Jul 15 23:31:34.433503 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:34.433062    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-9sv5k" event={"ID":"cd8ca0be-afb0-46df-910c-7190fbd9b7ef","Type":"ContainerStarted","Data":"c7ad14dfe828a387a4c94df998e8e96682c03738559b84634a548caed720deab"}
Jul 15 23:31:34.452545 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:34.452497    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-9sv5k" podStartSLOduration=9.332726833 podStartE2EDuration="11.452480014s" totalImagesPullingTime="2.119753181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:31:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:31:34.451464253 +0000 UTC m=+116.995186627" watchObservedRunningTime="2026-07-15 23:31:34.452480014 +0000 UTC m=+116.996202369"
Jul 15 23:31:36.179630 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.179603    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-twjdt"]
Jul 15 23:31:36.228685 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.228657    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.231829 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.231801    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 23:31:36.231962 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.231804    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6lqmk\""
Jul 15 23:31:36.232088 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.232063    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 23:31:36.232471 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.232447    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 23:31:36.298472 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.298441    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b187e6a-05e7-4d28-9b57-79f48444d4c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.298596 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.298497    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b187e6a-05e7-4d28-9b57-79f48444d4c6-root\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.298596 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.298525    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b187e6a-05e7-4d28-9b57-79f48444d4c6-node-exporter-textfile\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.298596 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.298566    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b187e6a-05e7-4d28-9b57-79f48444d4c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.298596 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.298587    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b187e6a-05e7-4d28-9b57-79f48444d4c6-sys\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.298769 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.298626    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b187e6a-05e7-4d28-9b57-79f48444d4c6-node-exporter-wtmp\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.298769 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.298649    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b187e6a-05e7-4d28-9b57-79f48444d4c6-metrics-client-ca\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.298769 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.298685    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzkqd\" (UniqueName: \"kubernetes.io/projected/6b187e6a-05e7-4d28-9b57-79f48444d4c6-kube-api-access-fzkqd\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.298769 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.298706    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b187e6a-05e7-4d28-9b57-79f48444d4c6-node-exporter-tls\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.399082 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.399049    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b187e6a-05e7-4d28-9b57-79f48444d4c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.399258 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.399102    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b187e6a-05e7-4d28-9b57-79f48444d4c6-root\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.399258 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.399127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b187e6a-05e7-4d28-9b57-79f48444d4c6-node-exporter-textfile\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.399258 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.399175    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b187e6a-05e7-4d28-9b57-79f48444d4c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.399258 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.399200    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b187e6a-05e7-4d28-9b57-79f48444d4c6-sys\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.399258 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.399208    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b187e6a-05e7-4d28-9b57-79f48444d4c6-root\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.399258 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.399223    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b187e6a-05e7-4d28-9b57-79f48444d4c6-node-exporter-wtmp\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.399573 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.399262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b187e6a-05e7-4d28-9b57-79f48444d4c6-metrics-client-ca\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.399573 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.399303    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzkqd\" (UniqueName: \"kubernetes.io/projected/6b187e6a-05e7-4d28-9b57-79f48444d4c6-kube-api-access-fzkqd\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.399573 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.399329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b187e6a-05e7-4d28-9b57-79f48444d4c6-node-exporter-tls\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.399573 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.399323    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b187e6a-05e7-4d28-9b57-79f48444d4c6-sys\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.399573 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.399382    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b187e6a-05e7-4d28-9b57-79f48444d4c6-node-exporter-wtmp\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.399809 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.399607    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b187e6a-05e7-4d28-9b57-79f48444d4c6-node-exporter-textfile\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.399809 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.399715    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b187e6a-05e7-4d28-9b57-79f48444d4c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.400204 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.400175    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b187e6a-05e7-4d28-9b57-79f48444d4c6-metrics-client-ca\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.401912 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.401892    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b187e6a-05e7-4d28-9b57-79f48444d4c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.402418 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.402397    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b187e6a-05e7-4d28-9b57-79f48444d4c6-node-exporter-tls\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.406622 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.406601    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzkqd\" (UniqueName: \"kubernetes.io/projected/6b187e6a-05e7-4d28-9b57-79f48444d4c6-kube-api-access-fzkqd\") pod \"node-exporter-twjdt\" (UID: \"6b187e6a-05e7-4d28-9b57-79f48444d4c6\") " pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.539749 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:36.539720    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-twjdt"
Jul 15 23:31:36.565702 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:31:36.565676    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b187e6a_05e7_4d28_9b57_79f48444d4c6.slice/crio-580dbac8ab87b23757e30b7b0a5654a0e9a10fbcc94d0cfe81d9dc27058ee947 WatchSource:0}: Error finding container 580dbac8ab87b23757e30b7b0a5654a0e9a10fbcc94d0cfe81d9dc27058ee947: Status 404 returned error can't find the container with id 580dbac8ab87b23757e30b7b0a5654a0e9a10fbcc94d0cfe81d9dc27058ee947
Jul 15 23:31:37.446949 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:37.446909    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-twjdt" event={"ID":"6b187e6a-05e7-4d28-9b57-79f48444d4c6","Type":"ContainerStarted","Data":"580dbac8ab87b23757e30b7b0a5654a0e9a10fbcc94d0cfe81d9dc27058ee947"}
Jul 15 23:31:37.954153 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:37.954124    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85dcf6d6d-s22zb"
Jul 15 23:31:38.159312 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.159282    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-58fcb7865b-thllv"]
Jul 15 23:31:38.182008 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.181978    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58fcb7865b-thllv"]
Jul 15 23:31:38.182155 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.182137    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.184092 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.184070    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 15 23:31:38.184379 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.184332    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 15 23:31:38.184555 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.184503    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 15 23:31:38.184977 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.184080    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 15 23:31:38.185077 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.185033    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 15 23:31:38.185144 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.184570    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5apfgg6rd8ukq\""
Jul 15 23:31:38.185243 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.184463    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jg89r\""
Jul 15 23:31:38.213076 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.213024    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7e47522d-a3ee-4a28-9590-f64d33289a98-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.213076 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.213063    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e47522d-a3ee-4a28-9590-f64d33289a98-metrics-client-ca\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.213221 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.213112    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e47522d-a3ee-4a28-9590-f64d33289a98-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.213221 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.213137    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7e47522d-a3ee-4a28-9590-f64d33289a98-secret-thanos-querier-tls\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.213221 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.213162    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp4tl\" (UniqueName: \"kubernetes.io/projected/7e47522d-a3ee-4a28-9590-f64d33289a98-kube-api-access-gp4tl\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.213400 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.213285    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7e47522d-a3ee-4a28-9590-f64d33289a98-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.213400 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.213327    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e47522d-a3ee-4a28-9590-f64d33289a98-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.213400 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.213359    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e47522d-a3ee-4a28-9590-f64d33289a98-secret-grpc-tls\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.313715 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.313688    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7e47522d-a3ee-4a28-9590-f64d33289a98-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.313850 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.313725    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e47522d-a3ee-4a28-9590-f64d33289a98-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.313850 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.313755    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e47522d-a3ee-4a28-9590-f64d33289a98-secret-grpc-tls\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.313850 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.313816    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7e47522d-a3ee-4a28-9590-f64d33289a98-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.314041 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.313842    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e47522d-a3ee-4a28-9590-f64d33289a98-metrics-client-ca\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.314041 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.313909    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e47522d-a3ee-4a28-9590-f64d33289a98-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.314041 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.313937    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7e47522d-a3ee-4a28-9590-f64d33289a98-secret-thanos-querier-tls\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.314041 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.313964    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp4tl\" (UniqueName: \"kubernetes.io/projected/7e47522d-a3ee-4a28-9590-f64d33289a98-kube-api-access-gp4tl\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.315046 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.315023    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e47522d-a3ee-4a28-9590-f64d33289a98-metrics-client-ca\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.317621 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.317579    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7e47522d-a3ee-4a28-9590-f64d33289a98-secret-thanos-querier-tls\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.318865 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.318168    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7e47522d-a3ee-4a28-9590-f64d33289a98-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.318865 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.318641    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e47522d-a3ee-4a28-9590-f64d33289a98-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.318865 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.318822    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e47522d-a3ee-4a28-9590-f64d33289a98-secret-grpc-tls\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.319066 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.318929    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7e47522d-a3ee-4a28-9590-f64d33289a98-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.319704 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.319657    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e47522d-a3ee-4a28-9590-f64d33289a98-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.321869 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.321846    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp4tl\" (UniqueName: \"kubernetes.io/projected/7e47522d-a3ee-4a28-9590-f64d33289a98-kube-api-access-gp4tl\") pod \"thanos-querier-58fcb7865b-thllv\" (UID: \"7e47522d-a3ee-4a28-9590-f64d33289a98\") " pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.493200 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.493176    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:38.658463 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:38.658391    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58fcb7865b-thllv"]
Jul 15 23:31:38.662333 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:31:38.662307    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e47522d_a3ee_4a28_9590_f64d33289a98.slice/crio-8e9e3a620a895d2f2bafa9a4d23c9b300ccc6610dccf433f868caa13b78054b9 WatchSource:0}: Error finding container 8e9e3a620a895d2f2bafa9a4d23c9b300ccc6610dccf433f868caa13b78054b9: Status 404 returned error can't find the container with id 8e9e3a620a895d2f2bafa9a4d23c9b300ccc6610dccf433f868caa13b78054b9
Jul 15 23:31:39.460138 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:39.460103    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv" event={"ID":"7e47522d-a3ee-4a28-9590-f64d33289a98","Type":"ContainerStarted","Data":"8e9e3a620a895d2f2bafa9a4d23c9b300ccc6610dccf433f868caa13b78054b9"}
Jul 15 23:31:39.461916 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:39.461889    2576 generic.go:356] "Generic (PLEG): container finished" podID="6b187e6a-05e7-4d28-9b57-79f48444d4c6" containerID="673845263d6bcb7f2cae57e979dfa28497c8e914b33a40e76fd3ef1d20170bec" exitCode=0
Jul 15 23:31:39.462089 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:39.461940    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-twjdt" event={"ID":"6b187e6a-05e7-4d28-9b57-79f48444d4c6","Type":"ContainerDied","Data":"673845263d6bcb7f2cae57e979dfa28497c8e914b33a40e76fd3ef1d20170bec"}
Jul 15 23:31:40.469602 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:40.469558    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-twjdt" event={"ID":"6b187e6a-05e7-4d28-9b57-79f48444d4c6","Type":"ContainerStarted","Data":"3ec270fab5c61430ad12728e009be10a3579978c2c7993cf57b0dc8963acb589"}
Jul 15 23:31:40.470068 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:40.469623    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-twjdt" event={"ID":"6b187e6a-05e7-4d28-9b57-79f48444d4c6","Type":"ContainerStarted","Data":"424203b3f76c16fd7a49ec68aa45ed419105983196ed30eb7098b8de587e0387"}
Jul 15 23:31:40.488032 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:40.487976    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-twjdt" podStartSLOduration=2.596053996 podStartE2EDuration="4.487962922s" totalImagesPullingTime="1.77736268s" totalInitContainerRuntime="114.546246ms" isStatefulPod=true podCreationTimestamp="2026-07-15 23:31:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:31:40.487507664 +0000 UTC m=+123.031230106" watchObservedRunningTime="2026-07-15 23:31:40.487962922 +0000 UTC m=+123.031685276"
Jul 15 23:31:40.699126 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:40.699093    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:31:42.332134 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.332096    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 23:31:42.355410 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.355385    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 23:31:42.355577 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.355525    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.357740 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.357713    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-q4x8m\""
Jul 15 23:31:42.357860 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.357715    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 15 23:31:42.359187 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.358927    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-26p9vmi2v3etu\""
Jul 15 23:31:42.359187 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.358972    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 15 23:31:42.359187 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.358980    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 15 23:31:42.359187 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.359021    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 15 23:31:42.359187 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.359055    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 15 23:31:42.359187 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.359155    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 15 23:31:42.359554 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.359446    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 15 23:31:42.359554 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.359516    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 15 23:31:42.359669 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.359572    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 15 23:31:42.359835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.359814    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 15 23:31:42.359920 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.359837    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 15 23:31:42.360618 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.360587    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 15 23:31:42.361227 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.360837    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 15 23:31:42.363014 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.361758    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 15 23:31:42.366057 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.366035    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 15 23:31:42.428491 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.428458    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-chmd4"
Jul 15 23:31:42.445701 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.445671    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.445880 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.445735    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.445880 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.445852    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb52x\" (UniqueName: \"kubernetes.io/projected/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-kube-api-access-sb52x\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.445997 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.445926    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.445997 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.445952    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.446098 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.446013    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.446098 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.446070    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.446201 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.446156    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-web-config\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.446201 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.446184    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-config\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.446435 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.446218    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.446435 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.446286    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-config-out\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.446435 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.446312    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.446435 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.446380    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.446435 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.446420    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.446682 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.446450    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.446682 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.446474    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.446682 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.446499    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.446682 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.446528    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.446682 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.446580    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.446682 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.446608    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.482386 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.482352    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv" event={"ID":"7e47522d-a3ee-4a28-9590-f64d33289a98","Type":"ContainerStarted","Data":"cb41cd57c98618f40963536de60a3c0e0849cde6de2ded023056d5c99b2cd38c"}
Jul 15 23:31:42.482537 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.482482    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv" event={"ID":"7e47522d-a3ee-4a28-9590-f64d33289a98","Type":"ContainerStarted","Data":"73a0e9cfc6ab07257f161ba70fa847caca77c14fec25241b334a96d9ae70be57"}
Jul 15 23:31:42.482537 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.482528    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv" event={"ID":"7e47522d-a3ee-4a28-9590-f64d33289a98","Type":"ContainerStarted","Data":"cc5998b18b89cf7dbcddb65abc4130d24e480da2eda866a88f67c5fd867866ca"}
Jul 15 23:31:42.548051 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.548013    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.549049 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.548064    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-config-out\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.549049 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.548090    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.549049 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.548142    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.549049 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.548179    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.549049 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.548206    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.549049 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.548243    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.549049 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.548264    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.549049 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.548287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.549049 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.548309    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.549049 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.548362    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.549049 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.548390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.549049 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.548416    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.549049 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.548439    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb52x\" (UniqueName: \"kubernetes.io/projected/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-kube-api-access-sb52x\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.549049 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.548474    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.549049 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.548504    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.549049 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.548554    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.549049 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.548581    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.550222 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.548615    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-web-config\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.550222 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.548638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-config\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.550222 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.548782    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.550222 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.548851    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.550222 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.549929    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.552709 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.550500    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.552709 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.552158    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.552709 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.552389    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.552934 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.552744    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.553916 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.553635    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.557965 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.556528    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-config-out\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.557965 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.556701    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-config\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.557965 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.557288    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.557965 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.557382    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.557965 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.557910    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.558306 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.558002    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.558306 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.558184    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.558569 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.558548    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.559589 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.559569    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.559702 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.559655    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.560184 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.560157    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb52x\" (UniqueName: \"kubernetes.io/projected/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-kube-api-access-sb52x\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.561787 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.561757    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02c1febd-07f0-4c9d-99a9-aaa753f9d69c-web-config\") pod \"prometheus-k8s-0\" (UID: \"02c1febd-07f0-4c9d-99a9-aaa753f9d69c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:42.670252 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:42.670154    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:43.018431 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:43.018406    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 23:31:43.023079 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:31:43.023056    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c1febd_07f0_4c9d_99a9_aaa753f9d69c.slice/crio-2e589d417b44cc27c5056b2426cfd525d845ce355c267f9bb983eb9d48fc3024 WatchSource:0}: Error finding container 2e589d417b44cc27c5056b2426cfd525d845ce355c267f9bb983eb9d48fc3024: Status 404 returned error can't find the container with id 2e589d417b44cc27c5056b2426cfd525d845ce355c267f9bb983eb9d48fc3024
Jul 15 23:31:43.491004 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:43.490973    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv" event={"ID":"7e47522d-a3ee-4a28-9590-f64d33289a98","Type":"ContainerStarted","Data":"e917297a98d2255e934e72c3d51d7f760d10a4550fcb94e2445470ec033aae66"}
Jul 15 23:31:43.491346 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:43.491055    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv" event={"ID":"7e47522d-a3ee-4a28-9590-f64d33289a98","Type":"ContainerStarted","Data":"1e6e825fc2542c14ecc541855b12ca120be42f8faeeec4b4d2f183155a1f9833"}
Jul 15 23:31:43.491346 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:43.491099    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv" event={"ID":"7e47522d-a3ee-4a28-9590-f64d33289a98","Type":"ContainerStarted","Data":"6dcfe17243ff75dafd44f1fe2f66dbd428954aeb5366689e57f6d7e299b05a39"}
Jul 15 23:31:43.491346 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:43.491145    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:43.492571 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:43.492548    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02c1febd-07f0-4c9d-99a9-aaa753f9d69c","Type":"ContainerStarted","Data":"2e589d417b44cc27c5056b2426cfd525d845ce355c267f9bb983eb9d48fc3024"}
Jul 15 23:31:43.516549 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:43.516331    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv" podStartSLOduration=1.287110443 podStartE2EDuration="5.516314744s" totalImagesPullingTime="4.229204301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:31:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:31:43.5153028 +0000 UTC m=+126.059025154" watchObservedRunningTime="2026-07-15 23:31:43.516314744 +0000 UTC m=+126.060037098"
Jul 15 23:31:45.505566 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:45.505530    2576 generic.go:356] "Generic (PLEG): container finished" podID="02c1febd-07f0-4c9d-99a9-aaa753f9d69c" containerID="de83927871ebbc8848ba4f445c34ac40a85c057a097f4337c4ad778f7c481a56" exitCode=0
Jul 15 23:31:45.505947 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:45.505609    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02c1febd-07f0-4c9d-99a9-aaa753f9d69c","Type":"ContainerDied","Data":"de83927871ebbc8848ba4f445c34ac40a85c057a097f4337c4ad778f7c481a56"}
Jul 15 23:31:47.696996 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:47.696959    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs\") pod \"network-metrics-daemon-v68p6\" (UID: \"469dc602-e468-466b-84e4-3504671a58c2\") " pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:31:47.699671 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:47.699643    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/469dc602-e468-466b-84e4-3504671a58c2-metrics-certs\") pod \"network-metrics-daemon-v68p6\" (UID: \"469dc602-e468-466b-84e4-3504671a58c2\") " pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:31:47.982294 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:47.982200    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wjrwg\""
Jul 15 23:31:47.991168 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:47.991140    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v68p6"
Jul 15 23:31:49.204479 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:49.204455    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v68p6"]
Jul 15 23:31:49.207421 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:31:49.207394    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod469dc602_e468_466b_84e4_3504671a58c2.slice/crio-29565e79ce84452495bf859008f1c569e2e3b72d14ba99c83bccbeeba2e01076 WatchSource:0}: Error finding container 29565e79ce84452495bf859008f1c569e2e3b72d14ba99c83bccbeeba2e01076: Status 404 returned error can't find the container with id 29565e79ce84452495bf859008f1c569e2e3b72d14ba99c83bccbeeba2e01076
Jul 15 23:31:49.520769 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:49.520751    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-58fcb7865b-thllv"
Jul 15 23:31:49.526167 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:49.526138    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v68p6" event={"ID":"469dc602-e468-466b-84e4-3504671a58c2","Type":"ContainerStarted","Data":"29565e79ce84452495bf859008f1c569e2e3b72d14ba99c83bccbeeba2e01076"}
Jul 15 23:31:50.535619 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:50.535587    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02c1febd-07f0-4c9d-99a9-aaa753f9d69c","Type":"ContainerStarted","Data":"d4d588c7dd14a84a275cfb9823d94e3c15609a9c412b6ce529789e7375ec9312"}
Jul 15 23:31:50.536023 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:50.535665    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02c1febd-07f0-4c9d-99a9-aaa753f9d69c","Type":"ContainerStarted","Data":"6f5b8006da74e5b44ef31ab7b9e91f47a4ea7ce90062a23dd28b45f66505fa44"}
Jul 15 23:31:50.536023 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:50.535707    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02c1febd-07f0-4c9d-99a9-aaa753f9d69c","Type":"ContainerStarted","Data":"b25ad474323d17f0666c4a4a6c2a9c6e12e95b239ccca9af9d07990ed0e68bd7"}
Jul 15 23:31:50.536023 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:50.535747    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02c1febd-07f0-4c9d-99a9-aaa753f9d69c","Type":"ContainerStarted","Data":"ffe9a465715bcb6ce25071750c11327973fa34d4c1f196ef11f240ea8f495da1"}
Jul 15 23:31:50.536023 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:50.535786    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02c1febd-07f0-4c9d-99a9-aaa753f9d69c","Type":"ContainerStarted","Data":"96b3502440c2ee26f7fd0b2de8d39107b54147613feb3c0c57709116c676c247"}
Jul 15 23:31:50.536023 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:50.535823    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02c1febd-07f0-4c9d-99a9-aaa753f9d69c","Type":"ContainerStarted","Data":"a6f3a80c9c3c6aae4376738481daf9857a7d45cea03896cee3c90865577af565"}
Jul 15 23:31:50.560145 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:50.560088    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.101035642 podStartE2EDuration="8.560068716s" totalImagesPullingTime="5.44278847s" totalInitContainerRuntime="16.244604ms" isStatefulPod=false podCreationTimestamp="2026-07-15 23:31:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:31:50.558739583 +0000 UTC m=+133.102462002" watchObservedRunningTime="2026-07-15 23:31:50.560068716 +0000 UTC m=+133.103791070"
Jul 15 23:31:51.546420 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:51.546389    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v68p6" event={"ID":"469dc602-e468-466b-84e4-3504671a58c2","Type":"ContainerStarted","Data":"9c3886a286cfb0a6f32171fc7944d3040340aeaae887154cb32ceea514091fa9"}
Jul 15 23:31:51.546887 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:51.546469    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v68p6" event={"ID":"469dc602-e468-466b-84e4-3504671a58c2","Type":"ContainerStarted","Data":"77c8b9051166959f2d9cf02c93b640f3138a534068d0dc3cd71778e29a6eda63"}
Jul 15 23:31:51.560842 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:51.560791    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v68p6" podStartSLOduration=132.012210957 podStartE2EDuration="2m13.560774314s" totalImagesPullingTime="1.548563357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:31:51.559401005 +0000 UTC m=+134.103123359" watchObservedRunningTime="2026-07-15 23:31:51.560774314 +0000 UTC m=+134.104496670"
Jul 15 23:31:52.671053 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:52.671024    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:31:55.714063 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:55.714025    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c" podUID="68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd" containerName="registry" containerID="cri-o://e9454bb0160d9c1701485d9adc55dacb7d1e7bba61ea670490930414237426db" gracePeriod=30
Jul 15 23:31:55.984963 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:55.984916    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:31:56.063332 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.063305    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-trusted-ca\") pod \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") "
Jul 15 23:31:56.063459 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.063351    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-image-registry-private-configuration\") pod \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") "
Jul 15 23:31:56.063459 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.063378    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-bound-sa-token\") pod \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") "
Jul 15 23:31:56.063576 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.063553    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-certificates\") pod \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") "
Jul 15 23:31:56.063633 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.063602    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-ca-trust-extracted\") pod \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") "
Jul 15 23:31:56.063686 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.063637    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jprqp\" (UniqueName: \"kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-kube-api-access-jprqp\") pod \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") "
Jul 15 23:31:56.063686 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.063664    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls\") pod \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") "
Jul 15 23:31:56.063686 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.063664    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd" (UID: "68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:31:56.063840 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.063711    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-installation-pull-secrets\") pod \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\" (UID: \"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd\") "
Jul 15 23:31:56.063992 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.063949    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd" (UID: "68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:31:56.063992 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.063975    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-trusted-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:31:56.065962 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.065936    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd" (UID: "68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:31:56.066058 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.065960    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd" (UID: "68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:31:56.066120 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.066074    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-kube-api-access-jprqp" (OuterVolumeSpecName: "kube-api-access-jprqp") pod "68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd" (UID: "68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd"). InnerVolumeSpecName "kube-api-access-jprqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:31:56.066159 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.066115    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd" (UID: "68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:31:56.066253 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.066214    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd" (UID: "68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:31:56.072886 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.072862    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd" (UID: "68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:31:56.165191 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.165161    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-image-registry-private-configuration\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:31:56.165191 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.165192    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-bound-sa-token\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:31:56.165324 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.165202    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-certificates\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:31:56.165324 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.165212    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-ca-trust-extracted\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:31:56.165324 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.165221    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jprqp\" (UniqueName: \"kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-kube-api-access-jprqp\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:31:56.165324 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.165245    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-registry-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:31:56.165324 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.165253    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd-installation-pull-secrets\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:31:56.567614 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.567585    2576 generic.go:356] "Generic (PLEG): container finished" podID="68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd" containerID="e9454bb0160d9c1701485d9adc55dacb7d1e7bba61ea670490930414237426db" exitCode=0
Jul 15 23:31:56.567760 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.567628    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c"
Jul 15 23:31:56.567760 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.567669    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c" event={"ID":"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd","Type":"ContainerDied","Data":"e9454bb0160d9c1701485d9adc55dacb7d1e7bba61ea670490930414237426db"}
Jul 15 23:31:56.567760 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.567725    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66fb4fddbc-jcp7c" event={"ID":"68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd","Type":"ContainerDied","Data":"13a1f861df5d679c745be5fc2c19cc59330c77cbbffff2f317bf171f1144703b"}
Jul 15 23:31:56.567760 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.567750    2576 scope.go:117] "RemoveContainer" containerID="e9454bb0160d9c1701485d9adc55dacb7d1e7bba61ea670490930414237426db"
Jul 15 23:31:56.576755 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.576736    2576 scope.go:117] "RemoveContainer" containerID="e9454bb0160d9c1701485d9adc55dacb7d1e7bba61ea670490930414237426db"
Jul 15 23:31:56.577004 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:31:56.576987    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9454bb0160d9c1701485d9adc55dacb7d1e7bba61ea670490930414237426db\": container with ID starting with e9454bb0160d9c1701485d9adc55dacb7d1e7bba61ea670490930414237426db not found: ID does not exist" containerID="e9454bb0160d9c1701485d9adc55dacb7d1e7bba61ea670490930414237426db"
Jul 15 23:31:56.577045 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.577012    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9454bb0160d9c1701485d9adc55dacb7d1e7bba61ea670490930414237426db"} err="failed to get container status \"e9454bb0160d9c1701485d9adc55dacb7d1e7bba61ea670490930414237426db\": rpc error: code = NotFound desc = could not find container \"e9454bb0160d9c1701485d9adc55dacb7d1e7bba61ea670490930414237426db\": container with ID starting with e9454bb0160d9c1701485d9adc55dacb7d1e7bba61ea670490930414237426db not found: ID does not exist"
Jul 15 23:31:56.586945 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.586924    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66fb4fddbc-jcp7c"]
Jul 15 23:31:56.590465 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:56.590441    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-66fb4fddbc-jcp7c"]
Jul 15 23:31:57.439994 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:57.439960    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-85dcf6d6d-s22zb" podUID="a51ccc49-7ac8-447d-97d6-5d18e6186972" containerName="console" containerID="cri-o://79910d20105cb63e95fe3d24a27b6a192d982f8263290beb0b911c06f08bb42e" gracePeriod=15
Jul 15 23:31:57.573375 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:57.573349    2576 generic.go:356] "Generic (PLEG): container finished" podID="a51ccc49-7ac8-447d-97d6-5d18e6186972" containerID="79910d20105cb63e95fe3d24a27b6a192d982f8263290beb0b911c06f08bb42e" exitCode=0
Jul 15 23:31:57.573478 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:57.573424    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85dcf6d6d-s22zb" event={"ID":"a51ccc49-7ac8-447d-97d6-5d18e6186972","Type":"ContainerDied","Data":"79910d20105cb63e95fe3d24a27b6a192d982f8263290beb0b911c06f08bb42e"}
Jul 15 23:31:57.702861 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:57.702811    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85dcf6d6d-s22zb"
Jul 15 23:31:57.774764 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:57.774738    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a51ccc49-7ac8-447d-97d6-5d18e6186972-oauth-serving-cert\") pod \"a51ccc49-7ac8-447d-97d6-5d18e6186972\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") "
Jul 15 23:31:57.774764 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:57.774770    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a51ccc49-7ac8-447d-97d6-5d18e6186972-console-serving-cert\") pod \"a51ccc49-7ac8-447d-97d6-5d18e6186972\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") "
Jul 15 23:31:57.774975 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:57.774821    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zf47b\" (UniqueName: \"kubernetes.io/projected/a51ccc49-7ac8-447d-97d6-5d18e6186972-kube-api-access-zf47b\") pod \"a51ccc49-7ac8-447d-97d6-5d18e6186972\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") "
Jul 15 23:31:57.774975 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:57.774847    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a51ccc49-7ac8-447d-97d6-5d18e6186972-console-config\") pod \"a51ccc49-7ac8-447d-97d6-5d18e6186972\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") "
Jul 15 23:31:57.774975 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:57.774885    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a51ccc49-7ac8-447d-97d6-5d18e6186972-console-oauth-config\") pod \"a51ccc49-7ac8-447d-97d6-5d18e6186972\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") "
Jul 15 23:31:57.774975 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:57.774928    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a51ccc49-7ac8-447d-97d6-5d18e6186972-service-ca\") pod \"a51ccc49-7ac8-447d-97d6-5d18e6186972\" (UID: \"a51ccc49-7ac8-447d-97d6-5d18e6186972\") "
Jul 15 23:31:57.775207 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:57.775177    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a51ccc49-7ac8-447d-97d6-5d18e6186972-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a51ccc49-7ac8-447d-97d6-5d18e6186972" (UID: "a51ccc49-7ac8-447d-97d6-5d18e6186972"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:31:57.775285 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:57.775269    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a51ccc49-7ac8-447d-97d6-5d18e6186972-console-config" (OuterVolumeSpecName: "console-config") pod "a51ccc49-7ac8-447d-97d6-5d18e6186972" (UID: "a51ccc49-7ac8-447d-97d6-5d18e6186972"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:31:57.775489 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:57.775465    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a51ccc49-7ac8-447d-97d6-5d18e6186972-service-ca" (OuterVolumeSpecName: "service-ca") pod "a51ccc49-7ac8-447d-97d6-5d18e6186972" (UID: "a51ccc49-7ac8-447d-97d6-5d18e6186972"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:31:57.777183 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:57.777159    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a51ccc49-7ac8-447d-97d6-5d18e6186972-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a51ccc49-7ac8-447d-97d6-5d18e6186972" (UID: "a51ccc49-7ac8-447d-97d6-5d18e6186972"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:31:57.777451 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:57.777430    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a51ccc49-7ac8-447d-97d6-5d18e6186972-kube-api-access-zf47b" (OuterVolumeSpecName: "kube-api-access-zf47b") pod "a51ccc49-7ac8-447d-97d6-5d18e6186972" (UID: "a51ccc49-7ac8-447d-97d6-5d18e6186972"). InnerVolumeSpecName "kube-api-access-zf47b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:31:57.777545 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:57.777469    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a51ccc49-7ac8-447d-97d6-5d18e6186972-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a51ccc49-7ac8-447d-97d6-5d18e6186972" (UID: "a51ccc49-7ac8-447d-97d6-5d18e6186972"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:31:57.876372 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:57.876350    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zf47b\" (UniqueName: \"kubernetes.io/projected/a51ccc49-7ac8-447d-97d6-5d18e6186972-kube-api-access-zf47b\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:31:57.876372 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:57.876370    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a51ccc49-7ac8-447d-97d6-5d18e6186972-console-config\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:31:57.876514 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:57.876381    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a51ccc49-7ac8-447d-97d6-5d18e6186972-console-oauth-config\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:31:57.876514 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:57.876389    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a51ccc49-7ac8-447d-97d6-5d18e6186972-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:31:57.876514 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:57.876397    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a51ccc49-7ac8-447d-97d6-5d18e6186972-oauth-serving-cert\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:31:57.876514 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:57.876406    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a51ccc49-7ac8-447d-97d6-5d18e6186972-console-serving-cert\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:31:57.969036 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:57.968983    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd" path="/var/lib/kubelet/pods/68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd/volumes"
Jul 15 23:31:58.578891 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:58.578859    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85dcf6d6d-s22zb" event={"ID":"a51ccc49-7ac8-447d-97d6-5d18e6186972","Type":"ContainerDied","Data":"6665bdf0f473e698c3c6cca75fa4119b7ed7a32d510587044effcbf389305cda"}
Jul 15 23:31:58.579291 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:58.578897    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85dcf6d6d-s22zb"
Jul 15 23:31:58.579291 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:58.578938    2576 scope.go:117] "RemoveContainer" containerID="79910d20105cb63e95fe3d24a27b6a192d982f8263290beb0b911c06f08bb42e"
Jul 15 23:31:58.593858 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:58.593833    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85dcf6d6d-s22zb"]
Jul 15 23:31:58.599280 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:58.599259    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85dcf6d6d-s22zb"]
Jul 15 23:31:59.968964 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:31:59.968930    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a51ccc49-7ac8-447d-97d6-5d18e6186972" path="/var/lib/kubelet/pods/a51ccc49-7ac8-447d-97d6-5d18e6186972/volumes"
Jul 15 23:32:05.608138 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:32:05.608101    2576 generic.go:356] "Generic (PLEG): container finished" podID="c2a6d23f-5460-4848-b18e-071cfe3c240d" containerID="5c8a61a41e0afc8d0da696c89c0bb997ae978e119872a5ca336de2c710640779" exitCode=0
Jul 15 23:32:05.608586 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:32:05.608176    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rnn4g" event={"ID":"c2a6d23f-5460-4848-b18e-071cfe3c240d","Type":"ContainerDied","Data":"5c8a61a41e0afc8d0da696c89c0bb997ae978e119872a5ca336de2c710640779"}
Jul 15 23:32:05.608586 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:32:05.608486    2576 scope.go:117] "RemoveContainer" containerID="5c8a61a41e0afc8d0da696c89c0bb997ae978e119872a5ca336de2c710640779"
Jul 15 23:32:06.613664 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:32:06.613629    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rnn4g" event={"ID":"c2a6d23f-5460-4848-b18e-071cfe3c240d","Type":"ContainerStarted","Data":"11bc650d3af3b7b074f17e6405a9c0415f9b7564c4af8a3c84d35263ba008d04"}
Jul 15 23:32:42.671051 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:32:42.671019    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:32:42.689843 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:32:42.689816    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:32:42.768539 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:32:42.768516    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 23:34:37.881368 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:34:37.881336    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2wsc4_2678ca67-7c8a-42d0-a4fc-99b257a177a5/ovn-acl-logging/0.log"
Jul 15 23:34:37.887087 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:34:37.887064    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2wsc4_2678ca67-7c8a-42d0-a4fc-99b257a177a5/ovn-acl-logging/0.log"
Jul 15 23:34:37.888833 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:34:37.888812    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 23:35:01.395538 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:01.395495    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fjnvp"]
Jul 15 23:35:01.397981 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:01.395762    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a51ccc49-7ac8-447d-97d6-5d18e6186972" containerName="console"
Jul 15 23:35:01.397981 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:01.395773    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a51ccc49-7ac8-447d-97d6-5d18e6186972" containerName="console"
Jul 15 23:35:01.397981 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:01.395790    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd" containerName="registry"
Jul 15 23:35:01.397981 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:01.395797    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd" containerName="registry"
Jul 15 23:35:01.397981 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:01.395847    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="68137bb8-91d0-4f64-b8eb-cd9cf2d0c6cd" containerName="registry"
Jul 15 23:35:01.397981 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:01.395857    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a51ccc49-7ac8-447d-97d6-5d18e6186972" containerName="console"
Jul 15 23:35:01.398806 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:01.398790    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-fjnvp"
Jul 15 23:35:01.400640 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:01.400621    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 23:35:01.400768 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:01.400682    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-q557n\""
Jul 15 23:35:01.401139 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:01.401126    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 23:35:01.405973 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:01.405955    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fjnvp"]
Jul 15 23:35:01.445579 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:01.445553    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttrv4\" (UniqueName: \"kubernetes.io/projected/54fa8c23-a548-47e8-87d9-aeff0d8be6af-kube-api-access-ttrv4\") pod \"cert-manager-55b4d954d5-fjnvp\" (UID: \"54fa8c23-a548-47e8-87d9-aeff0d8be6af\") " pod="cert-manager/cert-manager-55b4d954d5-fjnvp"
Jul 15 23:35:01.445665 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:01.445595    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54fa8c23-a548-47e8-87d9-aeff0d8be6af-bound-sa-token\") pod \"cert-manager-55b4d954d5-fjnvp\" (UID: \"54fa8c23-a548-47e8-87d9-aeff0d8be6af\") " pod="cert-manager/cert-manager-55b4d954d5-fjnvp"
Jul 15 23:35:01.546731 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:01.546714    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttrv4\" (UniqueName: \"kubernetes.io/projected/54fa8c23-a548-47e8-87d9-aeff0d8be6af-kube-api-access-ttrv4\") pod \"cert-manager-55b4d954d5-fjnvp\" (UID: \"54fa8c23-a548-47e8-87d9-aeff0d8be6af\") " pod="cert-manager/cert-manager-55b4d954d5-fjnvp"
Jul 15 23:35:01.546832 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:01.546749    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54fa8c23-a548-47e8-87d9-aeff0d8be6af-bound-sa-token\") pod \"cert-manager-55b4d954d5-fjnvp\" (UID: \"54fa8c23-a548-47e8-87d9-aeff0d8be6af\") " pod="cert-manager/cert-manager-55b4d954d5-fjnvp"
Jul 15 23:35:01.554507 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:01.554481    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54fa8c23-a548-47e8-87d9-aeff0d8be6af-bound-sa-token\") pod \"cert-manager-55b4d954d5-fjnvp\" (UID: \"54fa8c23-a548-47e8-87d9-aeff0d8be6af\") " pod="cert-manager/cert-manager-55b4d954d5-fjnvp"
Jul 15 23:35:01.554778 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:01.554757    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttrv4\" (UniqueName: \"kubernetes.io/projected/54fa8c23-a548-47e8-87d9-aeff0d8be6af-kube-api-access-ttrv4\") pod \"cert-manager-55b4d954d5-fjnvp\" (UID: \"54fa8c23-a548-47e8-87d9-aeff0d8be6af\") " pod="cert-manager/cert-manager-55b4d954d5-fjnvp"
Jul 15 23:35:01.708600 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:01.708544    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-fjnvp"
Jul 15 23:35:01.829034 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:01.829000    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fjnvp"]
Jul 15 23:35:01.832409 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:35:01.832380    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54fa8c23_a548_47e8_87d9_aeff0d8be6af.slice/crio-5f965e87657e28228d77a2f1c4bb38e85732d51be64f6f2b88987894828b9636 WatchSource:0}: Error finding container 5f965e87657e28228d77a2f1c4bb38e85732d51be64f6f2b88987894828b9636: Status 404 returned error can't find the container with id 5f965e87657e28228d77a2f1c4bb38e85732d51be64f6f2b88987894828b9636
Jul 15 23:35:01.834845 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:01.834828    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 23:35:02.263739 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:02.263708    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-fjnvp" event={"ID":"54fa8c23-a548-47e8-87d9-aeff0d8be6af","Type":"ContainerStarted","Data":"5f965e87657e28228d77a2f1c4bb38e85732d51be64f6f2b88987894828b9636"}
Jul 15 23:35:05.278479 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:05.278443    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-fjnvp" event={"ID":"54fa8c23-a548-47e8-87d9-aeff0d8be6af","Type":"ContainerStarted","Data":"8231212feb24a9e220532d76ce6c9f5858841c957240724f738e45789ad961f1"}
Jul 15 23:35:05.293196 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:05.293149    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-fjnvp" podStartSLOduration=1.328221935 podStartE2EDuration="4.29313267s" totalImagesPullingTime="2.964910735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:35:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:35:05.291767716 +0000 UTC m=+327.835490071" watchObservedRunningTime="2026-07-15 23:35:05.29313267 +0000 UTC m=+327.836855023"
Jul 15 23:35:32.089934 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:32.089904    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-cd598598b-pkw5s"]
Jul 15 23:35:32.093208 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:32.093191    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-cd598598b-pkw5s"
Jul 15 23:35:32.096979 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:32.096343    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 23:35:32.097785 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:32.097572    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 23:35:32.097890 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:32.097848    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 23:35:32.098039 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:32.098018    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qp8vb\""
Jul 15 23:35:32.099274 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:32.098393    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 23:35:32.101826 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:32.101807    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 23:35:32.109874 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:32.109853    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-cd598598b-pkw5s"]
Jul 15 23:35:32.158633 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:32.158609    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/05be4595-447b-4314-a8a0-0e2bc261ce49-manager-config\") pod \"lws-controller-manager-cd598598b-pkw5s\" (UID: \"05be4595-447b-4314-a8a0-0e2bc261ce49\") " pod="openshift-lws-operator/lws-controller-manager-cd598598b-pkw5s"
Jul 15 23:35:32.158732 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:32.158656    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05be4595-447b-4314-a8a0-0e2bc261ce49-cert\") pod \"lws-controller-manager-cd598598b-pkw5s\" (UID: \"05be4595-447b-4314-a8a0-0e2bc261ce49\") " pod="openshift-lws-operator/lws-controller-manager-cd598598b-pkw5s"
Jul 15 23:35:32.158732 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:32.158674    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/05be4595-447b-4314-a8a0-0e2bc261ce49-metrics-cert\") pod \"lws-controller-manager-cd598598b-pkw5s\" (UID: \"05be4595-447b-4314-a8a0-0e2bc261ce49\") " pod="openshift-lws-operator/lws-controller-manager-cd598598b-pkw5s"
Jul 15 23:35:32.158840 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:32.158769    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdhmc\" (UniqueName: \"kubernetes.io/projected/05be4595-447b-4314-a8a0-0e2bc261ce49-kube-api-access-fdhmc\") pod \"lws-controller-manager-cd598598b-pkw5s\" (UID: \"05be4595-447b-4314-a8a0-0e2bc261ce49\") " pod="openshift-lws-operator/lws-controller-manager-cd598598b-pkw5s"
Jul 15 23:35:32.259590 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:32.259565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/05be4595-447b-4314-a8a0-0e2bc261ce49-manager-config\") pod \"lws-controller-manager-cd598598b-pkw5s\" (UID: \"05be4595-447b-4314-a8a0-0e2bc261ce49\") " pod="openshift-lws-operator/lws-controller-manager-cd598598b-pkw5s"
Jul 15 23:35:32.259682 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:32.259615    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05be4595-447b-4314-a8a0-0e2bc261ce49-cert\") pod \"lws-controller-manager-cd598598b-pkw5s\" (UID: \"05be4595-447b-4314-a8a0-0e2bc261ce49\") " pod="openshift-lws-operator/lws-controller-manager-cd598598b-pkw5s"
Jul 15 23:35:32.259682 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:32.259639    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/05be4595-447b-4314-a8a0-0e2bc261ce49-metrics-cert\") pod \"lws-controller-manager-cd598598b-pkw5s\" (UID: \"05be4595-447b-4314-a8a0-0e2bc261ce49\") " pod="openshift-lws-operator/lws-controller-manager-cd598598b-pkw5s"
Jul 15 23:35:32.259682 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:32.259677    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdhmc\" (UniqueName: \"kubernetes.io/projected/05be4595-447b-4314-a8a0-0e2bc261ce49-kube-api-access-fdhmc\") pod \"lws-controller-manager-cd598598b-pkw5s\" (UID: \"05be4595-447b-4314-a8a0-0e2bc261ce49\") " pod="openshift-lws-operator/lws-controller-manager-cd598598b-pkw5s"
Jul 15 23:35:32.260238 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:32.260217    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/05be4595-447b-4314-a8a0-0e2bc261ce49-manager-config\") pod \"lws-controller-manager-cd598598b-pkw5s\" (UID: \"05be4595-447b-4314-a8a0-0e2bc261ce49\") " pod="openshift-lws-operator/lws-controller-manager-cd598598b-pkw5s"
Jul 15 23:35:32.262186 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:32.262164    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05be4595-447b-4314-a8a0-0e2bc261ce49-cert\") pod \"lws-controller-manager-cd598598b-pkw5s\" (UID: \"05be4595-447b-4314-a8a0-0e2bc261ce49\") " pod="openshift-lws-operator/lws-controller-manager-cd598598b-pkw5s"
Jul 15 23:35:32.262282 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:32.262175    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/05be4595-447b-4314-a8a0-0e2bc261ce49-metrics-cert\") pod \"lws-controller-manager-cd598598b-pkw5s\" (UID: \"05be4595-447b-4314-a8a0-0e2bc261ce49\") " pod="openshift-lws-operator/lws-controller-manager-cd598598b-pkw5s"
Jul 15 23:35:32.268863 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:32.268842    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdhmc\" (UniqueName: \"kubernetes.io/projected/05be4595-447b-4314-a8a0-0e2bc261ce49-kube-api-access-fdhmc\") pod \"lws-controller-manager-cd598598b-pkw5s\" (UID: \"05be4595-447b-4314-a8a0-0e2bc261ce49\") " pod="openshift-lws-operator/lws-controller-manager-cd598598b-pkw5s"
Jul 15 23:35:32.406610 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:32.406550    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-cd598598b-pkw5s"
Jul 15 23:35:32.532008 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:32.531978    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-cd598598b-pkw5s"]
Jul 15 23:35:32.534971 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:35:32.534945    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05be4595_447b_4314_a8a0_0e2bc261ce49.slice/crio-846f2cc28169e6185cc1d587a6e54c609d0f40b9c7287c1390a44075a396ba09 WatchSource:0}: Error finding container 846f2cc28169e6185cc1d587a6e54c609d0f40b9c7287c1390a44075a396ba09: Status 404 returned error can't find the container with id 846f2cc28169e6185cc1d587a6e54c609d0f40b9c7287c1390a44075a396ba09
Jul 15 23:35:33.391006 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.390958    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-cd598598b-pkw5s" event={"ID":"05be4595-447b-4314-a8a0-0e2bc261ce49","Type":"ContainerStarted","Data":"846f2cc28169e6185cc1d587a6e54c609d0f40b9c7287c1390a44075a396ba09"}
Jul 15 23:35:33.728303 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.727596    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88"]
Jul 15 23:35:33.731166 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.731147    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88"
Jul 15 23:35:33.733540 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.733389    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 23:35:33.733540 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.733409    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 23:35:33.733540 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.733456    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 23:35:33.733540 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.733497    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 23:35:33.733782 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.733742    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mnxnd\""
Jul 15 23:35:33.744114 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.744092    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88"]
Jul 15 23:35:33.875347 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.875314    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/551dc737-8443-4379-ba2f-13d7b3066ff9-webhook-cert\") pod \"opendatahub-operator-controller-manager-6ccf6fdd4-w8h88\" (UID: \"551dc737-8443-4379-ba2f-13d7b3066ff9\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88"
Jul 15 23:35:33.875518 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.875377    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/551dc737-8443-4379-ba2f-13d7b3066ff9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6ccf6fdd4-w8h88\" (UID: \"551dc737-8443-4379-ba2f-13d7b3066ff9\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88"
Jul 15 23:35:33.875518 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.875409    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/551dc737-8443-4379-ba2f-13d7b3066ff9-tmp\") pod \"opendatahub-operator-controller-manager-6ccf6fdd4-w8h88\" (UID: \"551dc737-8443-4379-ba2f-13d7b3066ff9\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88"
Jul 15 23:35:33.875518 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.875438    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/551dc737-8443-4379-ba2f-13d7b3066ff9-manifests\") pod \"opendatahub-operator-controller-manager-6ccf6fdd4-w8h88\" (UID: \"551dc737-8443-4379-ba2f-13d7b3066ff9\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88"
Jul 15 23:35:33.875518 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.875480    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffr2s\" (UniqueName: \"kubernetes.io/projected/551dc737-8443-4379-ba2f-13d7b3066ff9-kube-api-access-ffr2s\") pod \"opendatahub-operator-controller-manager-6ccf6fdd4-w8h88\" (UID: \"551dc737-8443-4379-ba2f-13d7b3066ff9\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88"
Jul 15 23:35:33.976298 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.976266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffr2s\" (UniqueName: \"kubernetes.io/projected/551dc737-8443-4379-ba2f-13d7b3066ff9-kube-api-access-ffr2s\") pod \"opendatahub-operator-controller-manager-6ccf6fdd4-w8h88\" (UID: \"551dc737-8443-4379-ba2f-13d7b3066ff9\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88"
Jul 15 23:35:33.976485 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.976315    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/551dc737-8443-4379-ba2f-13d7b3066ff9-webhook-cert\") pod \"opendatahub-operator-controller-manager-6ccf6fdd4-w8h88\" (UID: \"551dc737-8443-4379-ba2f-13d7b3066ff9\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88"
Jul 15 23:35:33.976485 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.976368    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/551dc737-8443-4379-ba2f-13d7b3066ff9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6ccf6fdd4-w8h88\" (UID: \"551dc737-8443-4379-ba2f-13d7b3066ff9\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88"
Jul 15 23:35:33.976485 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.976389    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/551dc737-8443-4379-ba2f-13d7b3066ff9-tmp\") pod \"opendatahub-operator-controller-manager-6ccf6fdd4-w8h88\" (UID: \"551dc737-8443-4379-ba2f-13d7b3066ff9\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88"
Jul 15 23:35:33.976485 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.976412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/551dc737-8443-4379-ba2f-13d7b3066ff9-manifests\") pod \"opendatahub-operator-controller-manager-6ccf6fdd4-w8h88\" (UID: \"551dc737-8443-4379-ba2f-13d7b3066ff9\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88"
Jul 15 23:35:33.976773 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.976749    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/551dc737-8443-4379-ba2f-13d7b3066ff9-manifests\") pod \"opendatahub-operator-controller-manager-6ccf6fdd4-w8h88\" (UID: \"551dc737-8443-4379-ba2f-13d7b3066ff9\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88"
Jul 15 23:35:33.978851 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.978771    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/551dc737-8443-4379-ba2f-13d7b3066ff9-tmp\") pod \"opendatahub-operator-controller-manager-6ccf6fdd4-w8h88\" (UID: \"551dc737-8443-4379-ba2f-13d7b3066ff9\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88"
Jul 15 23:35:33.979127 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.979105    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/551dc737-8443-4379-ba2f-13d7b3066ff9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6ccf6fdd4-w8h88\" (UID: \"551dc737-8443-4379-ba2f-13d7b3066ff9\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88"
Jul 15 23:35:33.979200 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.979113    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/551dc737-8443-4379-ba2f-13d7b3066ff9-webhook-cert\") pod \"opendatahub-operator-controller-manager-6ccf6fdd4-w8h88\" (UID: \"551dc737-8443-4379-ba2f-13d7b3066ff9\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88"
Jul 15 23:35:33.983653 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:33.983627    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffr2s\" (UniqueName: \"kubernetes.io/projected/551dc737-8443-4379-ba2f-13d7b3066ff9-kube-api-access-ffr2s\") pod \"opendatahub-operator-controller-manager-6ccf6fdd4-w8h88\" (UID: \"551dc737-8443-4379-ba2f-13d7b3066ff9\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88"
Jul 15 23:35:34.043487 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:34.043466    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88"
Jul 15 23:35:34.907921 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:34.907797    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88"]
Jul 15 23:35:34.910402 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:35:34.910376    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod551dc737_8443_4379_ba2f_13d7b3066ff9.slice/crio-8af0a3ae3adf7a61ffaf342b4420f20cd4b15765ebc67ed5155fe5f1fead5206 WatchSource:0}: Error finding container 8af0a3ae3adf7a61ffaf342b4420f20cd4b15765ebc67ed5155fe5f1fead5206: Status 404 returned error can't find the container with id 8af0a3ae3adf7a61ffaf342b4420f20cd4b15765ebc67ed5155fe5f1fead5206
Jul 15 23:35:35.402113 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:35.402065    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-cd598598b-pkw5s" event={"ID":"05be4595-447b-4314-a8a0-0e2bc261ce49","Type":"ContainerStarted","Data":"b9697181dc5b26d841f1be4b7efb55dbb01050a6085bb44b778d163a68e14462"}
Jul 15 23:35:35.402314 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:35.402198    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-cd598598b-pkw5s"
Jul 15 23:35:35.403512 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:35.403491    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88" event={"ID":"551dc737-8443-4379-ba2f-13d7b3066ff9","Type":"ContainerStarted","Data":"8af0a3ae3adf7a61ffaf342b4420f20cd4b15765ebc67ed5155fe5f1fead5206"}
Jul 15 23:35:35.420664 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:35.420613    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-cd598598b-pkw5s" podStartSLOduration=1.116497974 podStartE2EDuration="3.420594212s" totalImagesPullingTime="2.304096238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:35:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:35:35.419341062 +0000 UTC m=+357.963063413" watchObservedRunningTime="2026-07-15 23:35:35.420594212 +0000 UTC m=+357.964316566"
Jul 15 23:35:38.423903 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:38.423872    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88" event={"ID":"551dc737-8443-4379-ba2f-13d7b3066ff9","Type":"ContainerStarted","Data":"dff97d40b85bbb65b6820496ea56c7f5c07defe3cb3baf08e1e660feb776224d"}
Jul 15 23:35:39.429643 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:39.429576    2576 generic.go:356] "Generic (PLEG): container finished" podID="551dc737-8443-4379-ba2f-13d7b3066ff9" containerID="dff97d40b85bbb65b6820496ea56c7f5c07defe3cb3baf08e1e660feb776224d" exitCode=0
Jul 15 23:35:39.429992 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:39.429658    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88" event={"ID":"551dc737-8443-4379-ba2f-13d7b3066ff9","Type":"ContainerDied","Data":"dff97d40b85bbb65b6820496ea56c7f5c07defe3cb3baf08e1e660feb776224d"}
Jul 15 23:35:40.435677 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:40.435645    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88" event={"ID":"551dc737-8443-4379-ba2f-13d7b3066ff9","Type":"ContainerStarted","Data":"7a70bf71b74ab732d3a2a84e3b6d90cea1463a00874a8885f5765fb149875bd7"}
Jul 15 23:35:40.436031 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:40.435722    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88"
Jul 15 23:35:40.454297 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:40.454217    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88" podStartSLOduration=3.016028109 podStartE2EDuration="7.454200538s" totalImagesPullingTime="3.380081201s" totalInitContainerRuntime="1.058091228s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:35:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:35:40.452769655 +0000 UTC m=+362.996492009" watchObservedRunningTime="2026-07-15 23:35:40.454200538 +0000 UTC m=+362.997922894"
Jul 15 23:35:46.409829 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:46.409802    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-cd598598b-pkw5s"
Jul 15 23:35:51.441362 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:51.441337    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6ccf6fdd4-w8h88"
Jul 15 23:35:53.892150 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:53.892118    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7bddb6d9b-k8czw"]
Jul 15 23:35:53.900927 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:53.900839    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bddb6d9b-k8czw"
Jul 15 23:35:53.903452 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:53.903425    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 23:35:53.903452 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:53.903439    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-nptn2\""
Jul 15 23:35:53.903637 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:53.903430    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 23:35:53.903637 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:53.903493    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 23:35:53.905616 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:53.905600    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 23:35:53.911450 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:53.911431    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bddb6d9b-k8czw"]
Jul 15 23:35:54.028473 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:54.028439    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4227919-8c1f-49fe-9d54-7ba139823de9-tls-certs\") pod \"kube-auth-proxy-7bddb6d9b-k8czw\" (UID: \"b4227919-8c1f-49fe-9d54-7ba139823de9\") " pod="openshift-ingress/kube-auth-proxy-7bddb6d9b-k8czw"
Jul 15 23:35:54.028473 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:54.028470    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhxfn\" (UniqueName: \"kubernetes.io/projected/b4227919-8c1f-49fe-9d54-7ba139823de9-kube-api-access-jhxfn\") pod \"kube-auth-proxy-7bddb6d9b-k8czw\" (UID: \"b4227919-8c1f-49fe-9d54-7ba139823de9\") " pod="openshift-ingress/kube-auth-proxy-7bddb6d9b-k8czw"
Jul 15 23:35:54.028651 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:54.028499    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4227919-8c1f-49fe-9d54-7ba139823de9-tmp\") pod \"kube-auth-proxy-7bddb6d9b-k8czw\" (UID: \"b4227919-8c1f-49fe-9d54-7ba139823de9\") " pod="openshift-ingress/kube-auth-proxy-7bddb6d9b-k8czw"
Jul 15 23:35:54.129482 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:54.129460    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4227919-8c1f-49fe-9d54-7ba139823de9-tmp\") pod \"kube-auth-proxy-7bddb6d9b-k8czw\" (UID: \"b4227919-8c1f-49fe-9d54-7ba139823de9\") " pod="openshift-ingress/kube-auth-proxy-7bddb6d9b-k8czw"
Jul 15 23:35:54.129608 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:54.129516    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4227919-8c1f-49fe-9d54-7ba139823de9-tls-certs\") pod \"kube-auth-proxy-7bddb6d9b-k8czw\" (UID: \"b4227919-8c1f-49fe-9d54-7ba139823de9\") " pod="openshift-ingress/kube-auth-proxy-7bddb6d9b-k8czw"
Jul 15 23:35:54.129608 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:35:54.129589    2576 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 15 23:35:54.129692 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:54.129629    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhxfn\" (UniqueName: \"kubernetes.io/projected/b4227919-8c1f-49fe-9d54-7ba139823de9-kube-api-access-jhxfn\") pod \"kube-auth-proxy-7bddb6d9b-k8czw\" (UID: \"b4227919-8c1f-49fe-9d54-7ba139823de9\") " pod="openshift-ingress/kube-auth-proxy-7bddb6d9b-k8czw"
Jul 15 23:35:54.129692 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:35:54.129654    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4227919-8c1f-49fe-9d54-7ba139823de9-tls-certs podName:b4227919-8c1f-49fe-9d54-7ba139823de9 nodeName:}" failed. No retries permitted until 2026-07-15 23:35:54.629638964 +0000 UTC m=+377.173361296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b4227919-8c1f-49fe-9d54-7ba139823de9-tls-certs") pod "kube-auth-proxy-7bddb6d9b-k8czw" (UID: "b4227919-8c1f-49fe-9d54-7ba139823de9") : secret "kube-auth-proxy-tls" not found
Jul 15 23:35:54.131670 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:54.131650    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4227919-8c1f-49fe-9d54-7ba139823de9-tmp\") pod \"kube-auth-proxy-7bddb6d9b-k8czw\" (UID: \"b4227919-8c1f-49fe-9d54-7ba139823de9\") " pod="openshift-ingress/kube-auth-proxy-7bddb6d9b-k8czw"
Jul 15 23:35:54.138019 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:54.137992    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhxfn\" (UniqueName: \"kubernetes.io/projected/b4227919-8c1f-49fe-9d54-7ba139823de9-kube-api-access-jhxfn\") pod \"kube-auth-proxy-7bddb6d9b-k8czw\" (UID: \"b4227919-8c1f-49fe-9d54-7ba139823de9\") " pod="openshift-ingress/kube-auth-proxy-7bddb6d9b-k8czw"
Jul 15 23:35:54.634107 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:54.634071    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4227919-8c1f-49fe-9d54-7ba139823de9-tls-certs\") pod \"kube-auth-proxy-7bddb6d9b-k8czw\" (UID: \"b4227919-8c1f-49fe-9d54-7ba139823de9\") " pod="openshift-ingress/kube-auth-proxy-7bddb6d9b-k8czw"
Jul 15 23:35:54.636599 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:54.636574    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4227919-8c1f-49fe-9d54-7ba139823de9-tls-certs\") pod \"kube-auth-proxy-7bddb6d9b-k8czw\" (UID: \"b4227919-8c1f-49fe-9d54-7ba139823de9\") " pod="openshift-ingress/kube-auth-proxy-7bddb6d9b-k8czw"
Jul 15 23:35:54.810983 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:54.810948    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bddb6d9b-k8czw"
Jul 15 23:35:54.937081 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:54.936951    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bddb6d9b-k8czw"]
Jul 15 23:35:54.939624 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:35:54.939600    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4227919_8c1f_49fe_9d54_7ba139823de9.slice/crio-484bdad49ae9b58857a9904a1adb6d8c53edc7dd71b2495ab5132f63d3574820 WatchSource:0}: Error finding container 484bdad49ae9b58857a9904a1adb6d8c53edc7dd71b2495ab5132f63d3574820: Status 404 returned error can't find the container with id 484bdad49ae9b58857a9904a1adb6d8c53edc7dd71b2495ab5132f63d3574820
Jul 15 23:35:55.495940 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:55.495908    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bddb6d9b-k8czw" event={"ID":"b4227919-8c1f-49fe-9d54-7ba139823de9","Type":"ContainerStarted","Data":"484bdad49ae9b58857a9904a1adb6d8c53edc7dd71b2495ab5132f63d3574820"}
Jul 15 23:35:58.510673 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:58.510634    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bddb6d9b-k8czw" event={"ID":"b4227919-8c1f-49fe-9d54-7ba139823de9","Type":"ContainerStarted","Data":"c1f03d68425bac3b34bfd48435bf5cd95afa15a149f0a91476d5b6f562ec4a6f"}
Jul 15 23:35:58.526060 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:35:58.526017    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7bddb6d9b-k8czw" podStartSLOduration=2.602865385 podStartE2EDuration="5.526001833s" totalImagesPullingTime="2.923136448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:35:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:35:58.524116927 +0000 UTC m=+381.067839293" watchObservedRunningTime="2026-07-15 23:35:58.526001833 +0000 UTC m=+381.069724186"
Jul 15 23:37:33.470445 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:33.470413    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mvtfw"]
Jul 15 23:37:33.473631 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:33.473612    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mvtfw"
Jul 15 23:37:33.475713 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:33.475687    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 23:37:33.475824 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:33.475739    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 23:37:33.475824 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:33.475773    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 15 23:37:33.476145 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:33.476130    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-wbp44\""
Jul 15 23:37:33.484563 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:33.484542    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mvtfw"]
Jul 15 23:37:33.640383 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:33.640358    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9cbx\" (UniqueName: \"kubernetes.io/projected/d11915e9-1615-4182-a5e3-74dfe33488c4-kube-api-access-m9cbx\") pod \"dns-operator-controller-manager-864dd78c4c-mvtfw\" (UID: \"d11915e9-1615-4182-a5e3-74dfe33488c4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mvtfw"
Jul 15 23:37:33.741183 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:33.741134    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9cbx\" (UniqueName: \"kubernetes.io/projected/d11915e9-1615-4182-a5e3-74dfe33488c4-kube-api-access-m9cbx\") pod \"dns-operator-controller-manager-864dd78c4c-mvtfw\" (UID: \"d11915e9-1615-4182-a5e3-74dfe33488c4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mvtfw"
Jul 15 23:37:33.754345 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:33.754323    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9cbx\" (UniqueName: \"kubernetes.io/projected/d11915e9-1615-4182-a5e3-74dfe33488c4-kube-api-access-m9cbx\") pod \"dns-operator-controller-manager-864dd78c4c-mvtfw\" (UID: \"d11915e9-1615-4182-a5e3-74dfe33488c4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mvtfw"
Jul 15 23:37:33.783221 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:33.783200    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mvtfw"
Jul 15 23:37:33.910267 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:33.910163    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mvtfw"]
Jul 15 23:37:33.913009 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:37:33.912984    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd11915e9_1615_4182_a5e3_74dfe33488c4.slice/crio-a5548472a6913d0a5f488f2c71f3d5e663eec84a937beaa379b6ccd9e17ddf91 WatchSource:0}: Error finding container a5548472a6913d0a5f488f2c71f3d5e663eec84a937beaa379b6ccd9e17ddf91: Status 404 returned error can't find the container with id a5548472a6913d0a5f488f2c71f3d5e663eec84a937beaa379b6ccd9e17ddf91
Jul 15 23:37:34.914374 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:34.914343    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mvtfw" event={"ID":"d11915e9-1615-4182-a5e3-74dfe33488c4","Type":"ContainerStarted","Data":"a5548472a6913d0a5f488f2c71f3d5e663eec84a937beaa379b6ccd9e17ddf91"}
Jul 15 23:37:36.925926 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:36.925888    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mvtfw" event={"ID":"d11915e9-1615-4182-a5e3-74dfe33488c4","Type":"ContainerStarted","Data":"59a3c9b06652155bdefc24cea16314f9e56fde5ab5be9ae4fc19e1fee2a27d4c"}
Jul 15 23:37:36.926399 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:36.925959    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mvtfw"
Jul 15 23:37:36.942761 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:36.942714    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mvtfw" podStartSLOduration=1.8549209819999999 podStartE2EDuration="3.942700316s" totalImagesPullingTime="2.087779334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:37:36.941636259 +0000 UTC m=+479.485358612" watchObservedRunningTime="2026-07-15 23:37:36.942700316 +0000 UTC m=+479.486422670"
Jul 15 23:37:38.686730 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:38.686699    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zltmd"]
Jul 15 23:37:38.689986 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:38.689970    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zltmd"
Jul 15 23:37:38.691693 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:38.691667    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 15 23:37:38.691825 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:38.691724    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 15 23:37:38.692042 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:38.692026    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-grzcx\""
Jul 15 23:37:38.699641 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:38.699619    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zltmd"]
Jul 15 23:37:38.780290 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:38.780268    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fltkm\" (UniqueName: \"kubernetes.io/projected/583a7908-5618-4315-bc8b-17ee4abc1300-kube-api-access-fltkm\") pod \"kuadrant-console-plugin-66b5774985-zltmd\" (UID: \"583a7908-5618-4315-bc8b-17ee4abc1300\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zltmd"
Jul 15 23:37:38.780394 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:38.780302    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/583a7908-5618-4315-bc8b-17ee4abc1300-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zltmd\" (UID: \"583a7908-5618-4315-bc8b-17ee4abc1300\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zltmd"
Jul 15 23:37:38.780394 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:38.780320    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/583a7908-5618-4315-bc8b-17ee4abc1300-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zltmd\" (UID: \"583a7908-5618-4315-bc8b-17ee4abc1300\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zltmd"
Jul 15 23:37:38.880761 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:38.880738    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/583a7908-5618-4315-bc8b-17ee4abc1300-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zltmd\" (UID: \"583a7908-5618-4315-bc8b-17ee4abc1300\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zltmd"
Jul 15 23:37:38.880870 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:38.880767    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/583a7908-5618-4315-bc8b-17ee4abc1300-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zltmd\" (UID: \"583a7908-5618-4315-bc8b-17ee4abc1300\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zltmd"
Jul 15 23:37:38.880870 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:38.880834    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fltkm\" (UniqueName: \"kubernetes.io/projected/583a7908-5618-4315-bc8b-17ee4abc1300-kube-api-access-fltkm\") pod \"kuadrant-console-plugin-66b5774985-zltmd\" (UID: \"583a7908-5618-4315-bc8b-17ee4abc1300\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zltmd"
Jul 15 23:37:38.880937 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:37:38.880876    2576 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 15 23:37:38.880937 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:37:38.880935    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/583a7908-5618-4315-bc8b-17ee4abc1300-plugin-serving-cert podName:583a7908-5618-4315-bc8b-17ee4abc1300 nodeName:}" failed. No retries permitted until 2026-07-15 23:37:39.380919205 +0000 UTC m=+481.924641542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/583a7908-5618-4315-bc8b-17ee4abc1300-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-zltmd" (UID: "583a7908-5618-4315-bc8b-17ee4abc1300") : secret "plugin-serving-cert" not found
Jul 15 23:37:38.881459 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:38.881441    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/583a7908-5618-4315-bc8b-17ee4abc1300-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zltmd\" (UID: \"583a7908-5618-4315-bc8b-17ee4abc1300\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zltmd"
Jul 15 23:37:38.890504 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:38.890483    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fltkm\" (UniqueName: \"kubernetes.io/projected/583a7908-5618-4315-bc8b-17ee4abc1300-kube-api-access-fltkm\") pod \"kuadrant-console-plugin-66b5774985-zltmd\" (UID: \"583a7908-5618-4315-bc8b-17ee4abc1300\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zltmd"
Jul 15 23:37:39.384338 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:39.384304    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/583a7908-5618-4315-bc8b-17ee4abc1300-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zltmd\" (UID: \"583a7908-5618-4315-bc8b-17ee4abc1300\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zltmd"
Jul 15 23:37:39.386566 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:39.386538    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/583a7908-5618-4315-bc8b-17ee4abc1300-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zltmd\" (UID: \"583a7908-5618-4315-bc8b-17ee4abc1300\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zltmd"
Jul 15 23:37:39.599409 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:39.599384    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zltmd"
Jul 15 23:37:39.723198 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:39.723168    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zltmd"]
Jul 15 23:37:39.726403 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:37:39.726377    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod583a7908_5618_4315_bc8b_17ee4abc1300.slice/crio-6e4ee72db86d1ae74f261adc9876654bf4f921c3b7bc5141b49b89c7cccd1663 WatchSource:0}: Error finding container 6e4ee72db86d1ae74f261adc9876654bf4f921c3b7bc5141b49b89c7cccd1663: Status 404 returned error can't find the container with id 6e4ee72db86d1ae74f261adc9876654bf4f921c3b7bc5141b49b89c7cccd1663
Jul 15 23:37:39.938863 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:39.938804    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zltmd" event={"ID":"583a7908-5618-4315-bc8b-17ee4abc1300","Type":"ContainerStarted","Data":"6e4ee72db86d1ae74f261adc9876654bf4f921c3b7bc5141b49b89c7cccd1663"}
Jul 15 23:37:47.931918 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:47.931884    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mvtfw"
Jul 15 23:37:48.590136 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:48.590104    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8bkg9"]
Jul 15 23:37:48.606352 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:48.606319    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8bkg9"
Jul 15 23:37:48.606860 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:48.606827    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8bkg9"]
Jul 15 23:37:48.608190 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:48.608168    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-44h9l\""
Jul 15 23:37:48.766947 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:48.766905    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89fef8d3-85b2-4acf-8e65-1891a2c68a1b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8bkg9\" (UID: \"89fef8d3-85b2-4acf-8e65-1891a2c68a1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8bkg9"
Jul 15 23:37:48.767129 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:48.767007    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vrvv\" (UniqueName: \"kubernetes.io/projected/89fef8d3-85b2-4acf-8e65-1891a2c68a1b-kube-api-access-4vrvv\") pod \"kuadrant-operator-controller-manager-55467d9f7-8bkg9\" (UID: \"89fef8d3-85b2-4acf-8e65-1891a2c68a1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8bkg9"
Jul 15 23:37:48.868384 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:48.868295    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89fef8d3-85b2-4acf-8e65-1891a2c68a1b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8bkg9\" (UID: \"89fef8d3-85b2-4acf-8e65-1891a2c68a1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8bkg9"
Jul 15 23:37:48.868384 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:48.868367    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vrvv\" (UniqueName: \"kubernetes.io/projected/89fef8d3-85b2-4acf-8e65-1891a2c68a1b-kube-api-access-4vrvv\") pod \"kuadrant-operator-controller-manager-55467d9f7-8bkg9\" (UID: \"89fef8d3-85b2-4acf-8e65-1891a2c68a1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8bkg9"
Jul 15 23:37:48.868692 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:48.868669    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89fef8d3-85b2-4acf-8e65-1891a2c68a1b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8bkg9\" (UID: \"89fef8d3-85b2-4acf-8e65-1891a2c68a1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8bkg9"
Jul 15 23:37:48.877675 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:48.877646    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vrvv\" (UniqueName: \"kubernetes.io/projected/89fef8d3-85b2-4acf-8e65-1891a2c68a1b-kube-api-access-4vrvv\") pod \"kuadrant-operator-controller-manager-55467d9f7-8bkg9\" (UID: \"89fef8d3-85b2-4acf-8e65-1891a2c68a1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8bkg9"
Jul 15 23:37:48.920339 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:48.920307    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8bkg9"
Jul 15 23:37:49.008791 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:49.008763    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8bkg9"]
Jul 15 23:37:49.013264 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:49.013220    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8bkg9"]
Jul 15 23:37:49.035171 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:49.035146    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh"]
Jul 15 23:37:49.038804 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:49.038778    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh"
Jul 15 23:37:49.055679 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:49.055633    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh"]
Jul 15 23:37:49.070036 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:49.070006    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7kf7\" (UniqueName: \"kubernetes.io/projected/78761c7d-7e73-41e8-9bfe-0bb0c1f02a52-kube-api-access-g7kf7\") pod \"kuadrant-operator-controller-manager-55467d9f7-9tfkh\" (UID: \"78761c7d-7e73-41e8-9bfe-0bb0c1f02a52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh"
Jul 15 23:37:49.070168 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:49.070090    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/78761c7d-7e73-41e8-9bfe-0bb0c1f02a52-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-9tfkh\" (UID: \"78761c7d-7e73-41e8-9bfe-0bb0c1f02a52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh"
Jul 15 23:37:49.171177 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:49.171090    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/78761c7d-7e73-41e8-9bfe-0bb0c1f02a52-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-9tfkh\" (UID: \"78761c7d-7e73-41e8-9bfe-0bb0c1f02a52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh"
Jul 15 23:37:49.171177 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:49.171159    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7kf7\" (UniqueName: \"kubernetes.io/projected/78761c7d-7e73-41e8-9bfe-0bb0c1f02a52-kube-api-access-g7kf7\") pod \"kuadrant-operator-controller-manager-55467d9f7-9tfkh\" (UID: \"78761c7d-7e73-41e8-9bfe-0bb0c1f02a52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh"
Jul 15 23:37:49.171626 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:49.171602    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/78761c7d-7e73-41e8-9bfe-0bb0c1f02a52-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-9tfkh\" (UID: \"78761c7d-7e73-41e8-9bfe-0bb0c1f02a52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh"
Jul 15 23:37:49.179161 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:49.179136    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7kf7\" (UniqueName: \"kubernetes.io/projected/78761c7d-7e73-41e8-9bfe-0bb0c1f02a52-kube-api-access-g7kf7\") pod \"kuadrant-operator-controller-manager-55467d9f7-9tfkh\" (UID: \"78761c7d-7e73-41e8-9bfe-0bb0c1f02a52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh"
Jul 15 23:37:49.351456 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:37:49.351418    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh"
Jul 15 23:38:01.449010 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:01.448967    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh"]
Jul 15 23:38:01.598211 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:38:01.598146    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78761c7d_7e73_41e8_9bfe_0bb0c1f02a52.slice/crio-2a9681e4dff719b1db8abfce3fe66be3b917f848ce6a982e0b3956a62336aa58 WatchSource:0}: Error finding container 2a9681e4dff719b1db8abfce3fe66be3b917f848ce6a982e0b3956a62336aa58: Status 404 returned error can't find the container with id 2a9681e4dff719b1db8abfce3fe66be3b917f848ce6a982e0b3956a62336aa58
Jul 15 23:38:02.044910 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:02.044880    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh" event={"ID":"78761c7d-7e73-41e8-9bfe-0bb0c1f02a52","Type":"ContainerStarted","Data":"2a9681e4dff719b1db8abfce3fe66be3b917f848ce6a982e0b3956a62336aa58"}
Jul 15 23:38:02.046200 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:02.046168    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zltmd" event={"ID":"583a7908-5618-4315-bc8b-17ee4abc1300","Type":"ContainerStarted","Data":"fedeffb2970d4b4db1e1f4ee2c1bbf7478831a2469eade25294c06aa9e11abb7"}
Jul 15 23:38:02.063269 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:02.063212    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zltmd" podStartSLOduration=2.018482294 podStartE2EDuration="24.063193057s" totalImagesPullingTime="22.044710763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:38:02.061199087 +0000 UTC m=+504.604921444" watchObservedRunningTime="2026-07-15 23:38:02.063193057 +0000 UTC m=+504.606915411"
Jul 15 23:38:03.854399 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:38:03.854358    2576 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-8bkg9_kuadrant-system_89fef8d3-85b2-4acf-8e65-1891a2c68a1b_0(6cf3842939f72b71e73f47577479cc77e0f1239650390064db7255223db2590f): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-8bkg9 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 15 23:38:03.854754 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:38:03.854431    2576 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-8bkg9_kuadrant-system_89fef8d3-85b2-4acf-8e65-1891a2c68a1b_0(6cf3842939f72b71e73f47577479cc77e0f1239650390064db7255223db2590f): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-8bkg9 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8bkg9"
Jul 15 23:38:04.054491 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:04.054459    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8bkg9"
Jul 15 23:38:04.056740 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:38:04.056712    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8bkg9\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="89fef8d3-85b2-4acf-8e65-1891a2c68a1b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8bkg9"
Jul 15 23:38:04.062092 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:04.062075    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8bkg9"
Jul 15 23:38:04.064072 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:38:04.064051    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8bkg9\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="89fef8d3-85b2-4acf-8e65-1891a2c68a1b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8bkg9"
Jul 15 23:38:04.091276 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:04.091201    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vrvv\" (UniqueName: \"kubernetes.io/projected/89fef8d3-85b2-4acf-8e65-1891a2c68a1b-kube-api-access-4vrvv\") pod \"89fef8d3-85b2-4acf-8e65-1891a2c68a1b\" (UID: \"89fef8d3-85b2-4acf-8e65-1891a2c68a1b\") "
Jul 15 23:38:04.091374 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:04.091282    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89fef8d3-85b2-4acf-8e65-1891a2c68a1b-extensions-socket-volume\") pod \"89fef8d3-85b2-4acf-8e65-1891a2c68a1b\" (UID: \"89fef8d3-85b2-4acf-8e65-1891a2c68a1b\") "
Jul 15 23:38:04.091587 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:04.091563    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89fef8d3-85b2-4acf-8e65-1891a2c68a1b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "89fef8d3-85b2-4acf-8e65-1891a2c68a1b" (UID: "89fef8d3-85b2-4acf-8e65-1891a2c68a1b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:38:04.093734 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:04.093708    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89fef8d3-85b2-4acf-8e65-1891a2c68a1b-kube-api-access-4vrvv" (OuterVolumeSpecName: "kube-api-access-4vrvv") pod "89fef8d3-85b2-4acf-8e65-1891a2c68a1b" (UID: "89fef8d3-85b2-4acf-8e65-1891a2c68a1b"). InnerVolumeSpecName "kube-api-access-4vrvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:38:04.192282 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:04.192248    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vrvv\" (UniqueName: \"kubernetes.io/projected/89fef8d3-85b2-4acf-8e65-1891a2c68a1b-kube-api-access-4vrvv\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:38:04.192282 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:04.192277    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89fef8d3-85b2-4acf-8e65-1891a2c68a1b-extensions-socket-volume\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:38:05.059294 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:05.059254    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8bkg9"
Jul 15 23:38:05.061439 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:38:05.061397    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8bkg9\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="89fef8d3-85b2-4acf-8e65-1891a2c68a1b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8bkg9"
Jul 15 23:38:05.067554 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:38:05.067520    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8bkg9\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="89fef8d3-85b2-4acf-8e65-1891a2c68a1b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8bkg9"
Jul 15 23:38:05.970943 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:05.970907    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89fef8d3-85b2-4acf-8e65-1891a2c68a1b" path="/var/lib/kubelet/pods/89fef8d3-85b2-4acf-8e65-1891a2c68a1b/volumes"
Jul 15 23:38:07.069492 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:07.069457    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh" event={"ID":"78761c7d-7e73-41e8-9bfe-0bb0c1f02a52","Type":"ContainerStarted","Data":"12dc4ece0361f57ec7c594bc7b0974fd964859df26cf49ab689d7fa6cea06b28"}
Jul 15 23:38:07.069945 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:07.069581    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh"
Jul 15 23:38:07.088403 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:07.088361    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh" podStartSLOduration=13.499570234 podStartE2EDuration="18.088346381s" totalImagesPullingTime="4.588776147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:37:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:38:07.086728508 +0000 UTC m=+509.630450863" watchObservedRunningTime="2026-07-15 23:38:07.088346381 +0000 UTC m=+509.632068734"
Jul 15 23:38:18.077083 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:18.077056    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh"
Jul 15 23:38:30.530921 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:30.530848    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh"]
Jul 15 23:38:30.531275 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:30.531051    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh" podUID="78761c7d-7e73-41e8-9bfe-0bb0c1f02a52" containerName="manager" containerID="cri-o://12dc4ece0361f57ec7c594bc7b0974fd964859df26cf49ab689d7fa6cea06b28" gracePeriod=10
Jul 15 23:38:30.772597 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:30.772575    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh"
Jul 15 23:38:30.897879 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:30.897805    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/78761c7d-7e73-41e8-9bfe-0bb0c1f02a52-extensions-socket-volume\") pod \"78761c7d-7e73-41e8-9bfe-0bb0c1f02a52\" (UID: \"78761c7d-7e73-41e8-9bfe-0bb0c1f02a52\") "
Jul 15 23:38:30.897879 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:30.897839    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7kf7\" (UniqueName: \"kubernetes.io/projected/78761c7d-7e73-41e8-9bfe-0bb0c1f02a52-kube-api-access-g7kf7\") pod \"78761c7d-7e73-41e8-9bfe-0bb0c1f02a52\" (UID: \"78761c7d-7e73-41e8-9bfe-0bb0c1f02a52\") "
Jul 15 23:38:30.898365 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:30.898335    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78761c7d-7e73-41e8-9bfe-0bb0c1f02a52-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "78761c7d-7e73-41e8-9bfe-0bb0c1f02a52" (UID: "78761c7d-7e73-41e8-9bfe-0bb0c1f02a52"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:38:30.900033 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:30.900009    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78761c7d-7e73-41e8-9bfe-0bb0c1f02a52-kube-api-access-g7kf7" (OuterVolumeSpecName: "kube-api-access-g7kf7") pod "78761c7d-7e73-41e8-9bfe-0bb0c1f02a52" (UID: "78761c7d-7e73-41e8-9bfe-0bb0c1f02a52"). InnerVolumeSpecName "kube-api-access-g7kf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:38:30.999212 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:30.999185    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/78761c7d-7e73-41e8-9bfe-0bb0c1f02a52-extensions-socket-volume\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:38:30.999212 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:30.999209    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7kf7\" (UniqueName: \"kubernetes.io/projected/78761c7d-7e73-41e8-9bfe-0bb0c1f02a52-kube-api-access-g7kf7\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:38:31.168546 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:31.168471    2576 generic.go:356] "Generic (PLEG): container finished" podID="78761c7d-7e73-41e8-9bfe-0bb0c1f02a52" containerID="12dc4ece0361f57ec7c594bc7b0974fd964859df26cf49ab689d7fa6cea06b28" exitCode=0
Jul 15 23:38:31.168546 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:31.168516    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh"
Jul 15 23:38:31.168726 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:31.168553    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh" event={"ID":"78761c7d-7e73-41e8-9bfe-0bb0c1f02a52","Type":"ContainerDied","Data":"12dc4ece0361f57ec7c594bc7b0974fd964859df26cf49ab689d7fa6cea06b28"}
Jul 15 23:38:31.168726 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:31.168605    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh" event={"ID":"78761c7d-7e73-41e8-9bfe-0bb0c1f02a52","Type":"ContainerDied","Data":"2a9681e4dff719b1db8abfce3fe66be3b917f848ce6a982e0b3956a62336aa58"}
Jul 15 23:38:31.168726 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:31.168627    2576 scope.go:117] "RemoveContainer" containerID="12dc4ece0361f57ec7c594bc7b0974fd964859df26cf49ab689d7fa6cea06b28"
Jul 15 23:38:31.177524 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:31.177510    2576 scope.go:117] "RemoveContainer" containerID="12dc4ece0361f57ec7c594bc7b0974fd964859df26cf49ab689d7fa6cea06b28"
Jul 15 23:38:31.177757 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:38:31.177736    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12dc4ece0361f57ec7c594bc7b0974fd964859df26cf49ab689d7fa6cea06b28\": container with ID starting with 12dc4ece0361f57ec7c594bc7b0974fd964859df26cf49ab689d7fa6cea06b28 not found: ID does not exist" containerID="12dc4ece0361f57ec7c594bc7b0974fd964859df26cf49ab689d7fa6cea06b28"
Jul 15 23:38:31.177886 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:31.177763    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12dc4ece0361f57ec7c594bc7b0974fd964859df26cf49ab689d7fa6cea06b28"} err="failed to get container status \"12dc4ece0361f57ec7c594bc7b0974fd964859df26cf49ab689d7fa6cea06b28\": rpc error: code = NotFound desc = could not find container \"12dc4ece0361f57ec7c594bc7b0974fd964859df26cf49ab689d7fa6cea06b28\": container with ID starting with 12dc4ece0361f57ec7c594bc7b0974fd964859df26cf49ab689d7fa6cea06b28 not found: ID does not exist"
Jul 15 23:38:31.191530 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:31.191508    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh"]
Jul 15 23:38:31.198952 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:31.198896    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9tfkh"]
Jul 15 23:38:31.969978 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:31.969942    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78761c7d-7e73-41e8-9bfe-0bb0c1f02a52" path="/var/lib/kubelet/pods/78761c7d-7e73-41e8-9bfe-0bb0c1f02a52/volumes"
Jul 15 23:38:37.392565 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:37.392536    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k2brb"]
Jul 15 23:38:37.392910 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:37.392847    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78761c7d-7e73-41e8-9bfe-0bb0c1f02a52" containerName="manager"
Jul 15 23:38:37.392910 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:37.392857    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="78761c7d-7e73-41e8-9bfe-0bb0c1f02a52" containerName="manager"
Jul 15 23:38:37.392979 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:37.392913    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="78761c7d-7e73-41e8-9bfe-0bb0c1f02a52" containerName="manager"
Jul 15 23:38:37.428639 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:37.428613    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k2brb"]
Jul 15 23:38:37.428776 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:37.428695    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2brb"
Jul 15 23:38:37.430628 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:37.430608    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 23:38:37.488468 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:37.488438    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k2brb"]
Jul 15 23:38:37.550112 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:37.550085    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/410e51b9-4494-4c95-a5e3-f8f50314b50b-config-file\") pod \"limitador-limitador-64c94fd64f-k2brb\" (UID: \"410e51b9-4494-4c95-a5e3-f8f50314b50b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k2brb"
Jul 15 23:38:37.550264 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:37.550125    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x7vp\" (UniqueName: \"kubernetes.io/projected/410e51b9-4494-4c95-a5e3-f8f50314b50b-kube-api-access-4x7vp\") pod \"limitador-limitador-64c94fd64f-k2brb\" (UID: \"410e51b9-4494-4c95-a5e3-f8f50314b50b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k2brb"
Jul 15 23:38:37.650769 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:37.650711    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/410e51b9-4494-4c95-a5e3-f8f50314b50b-config-file\") pod \"limitador-limitador-64c94fd64f-k2brb\" (UID: \"410e51b9-4494-4c95-a5e3-f8f50314b50b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k2brb"
Jul 15 23:38:37.650769 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:37.650755    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x7vp\" (UniqueName: \"kubernetes.io/projected/410e51b9-4494-4c95-a5e3-f8f50314b50b-kube-api-access-4x7vp\") pod \"limitador-limitador-64c94fd64f-k2brb\" (UID: \"410e51b9-4494-4c95-a5e3-f8f50314b50b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k2brb"
Jul 15 23:38:37.651267 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:37.651251    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/410e51b9-4494-4c95-a5e3-f8f50314b50b-config-file\") pod \"limitador-limitador-64c94fd64f-k2brb\" (UID: \"410e51b9-4494-4c95-a5e3-f8f50314b50b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k2brb"
Jul 15 23:38:37.660629 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:37.660610    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x7vp\" (UniqueName: \"kubernetes.io/projected/410e51b9-4494-4c95-a5e3-f8f50314b50b-kube-api-access-4x7vp\") pod \"limitador-limitador-64c94fd64f-k2brb\" (UID: \"410e51b9-4494-4c95-a5e3-f8f50314b50b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k2brb"
Jul 15 23:38:37.738218 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:37.738197    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2brb"
Jul 15 23:38:37.863943 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:37.863919    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k2brb"]
Jul 15 23:38:37.866614 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:38:37.866589    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod410e51b9_4494_4c95_a5e3_f8f50314b50b.slice/crio-1c153b235ee588884db1546098c9ad562cf22c2911677897b8c20d3137d09cb2 WatchSource:0}: Error finding container 1c153b235ee588884db1546098c9ad562cf22c2911677897b8c20d3137d09cb2: Status 404 returned error can't find the container with id 1c153b235ee588884db1546098c9ad562cf22c2911677897b8c20d3137d09cb2
Jul 15 23:38:38.199351 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:38.199285    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2brb" event={"ID":"410e51b9-4494-4c95-a5e3-f8f50314b50b","Type":"ContainerStarted","Data":"1c153b235ee588884db1546098c9ad562cf22c2911677897b8c20d3137d09cb2"}
Jul 15 23:38:41.214047 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:41.214007    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2brb" event={"ID":"410e51b9-4494-4c95-a5e3-f8f50314b50b","Type":"ContainerStarted","Data":"c8a40a44ba02f000117226c72d5e13423ba5b528af59c5f6e521c3ec5bc08421"}
Jul 15 23:38:41.214454 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:41.214126    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2brb"
Jul 15 23:38:41.232090 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:41.232050    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2brb" podStartSLOduration=1.558488554 podStartE2EDuration="4.232038083s" totalImagesPullingTime="2.673549529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:38:41.230633323 +0000 UTC m=+543.774355685" watchObservedRunningTime="2026-07-15 23:38:41.232038083 +0000 UTC m=+543.775760436"
Jul 15 23:38:52.225607 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:52.225578    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2brb"
Jul 15 23:38:54.649799 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:54.649766    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k2brb"]
Jul 15 23:38:54.650291 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:54.649926    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2brb" podUID="410e51b9-4494-4c95-a5e3-f8f50314b50b" containerName="limitador" containerID="cri-o://c8a40a44ba02f000117226c72d5e13423ba5b528af59c5f6e521c3ec5bc08421" gracePeriod=30
Jul 15 23:38:55.279264 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:55.279215    2576 generic.go:356] "Generic (PLEG): container finished" podID="410e51b9-4494-4c95-a5e3-f8f50314b50b" containerID="c8a40a44ba02f000117226c72d5e13423ba5b528af59c5f6e521c3ec5bc08421" exitCode=0
Jul 15 23:38:55.279392 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:55.279291    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2brb" event={"ID":"410e51b9-4494-4c95-a5e3-f8f50314b50b","Type":"ContainerDied","Data":"c8a40a44ba02f000117226c72d5e13423ba5b528af59c5f6e521c3ec5bc08421"}
Jul 15 23:38:55.589501 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:55.589480    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2brb"
Jul 15 23:38:55.687066 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:55.687043    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4x7vp\" (UniqueName: \"kubernetes.io/projected/410e51b9-4494-4c95-a5e3-f8f50314b50b-kube-api-access-4x7vp\") pod \"410e51b9-4494-4c95-a5e3-f8f50314b50b\" (UID: \"410e51b9-4494-4c95-a5e3-f8f50314b50b\") "
Jul 15 23:38:55.687369 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:55.687099    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/410e51b9-4494-4c95-a5e3-f8f50314b50b-config-file\") pod \"410e51b9-4494-4c95-a5e3-f8f50314b50b\" (UID: \"410e51b9-4494-4c95-a5e3-f8f50314b50b\") "
Jul 15 23:38:55.687446 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:55.687423    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/410e51b9-4494-4c95-a5e3-f8f50314b50b-config-file" (OuterVolumeSpecName: "config-file") pod "410e51b9-4494-4c95-a5e3-f8f50314b50b" (UID: "410e51b9-4494-4c95-a5e3-f8f50314b50b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:38:55.689000 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:55.688975    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/410e51b9-4494-4c95-a5e3-f8f50314b50b-kube-api-access-4x7vp" (OuterVolumeSpecName: "kube-api-access-4x7vp") pod "410e51b9-4494-4c95-a5e3-f8f50314b50b" (UID: "410e51b9-4494-4c95-a5e3-f8f50314b50b"). InnerVolumeSpecName "kube-api-access-4x7vp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:38:55.788097 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:55.788072    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4x7vp\" (UniqueName: \"kubernetes.io/projected/410e51b9-4494-4c95-a5e3-f8f50314b50b-kube-api-access-4x7vp\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:38:55.788097 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:55.788092    2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/410e51b9-4494-4c95-a5e3-f8f50314b50b-config-file\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:38:56.284988 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:56.284967    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2brb"
Jul 15 23:38:56.285106 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:56.285011    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-k2brb" event={"ID":"410e51b9-4494-4c95-a5e3-f8f50314b50b","Type":"ContainerDied","Data":"1c153b235ee588884db1546098c9ad562cf22c2911677897b8c20d3137d09cb2"}
Jul 15 23:38:56.285106 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:56.285065    2576 scope.go:117] "RemoveContainer" containerID="c8a40a44ba02f000117226c72d5e13423ba5b528af59c5f6e521c3ec5bc08421"
Jul 15 23:38:56.298777 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:56.298754    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k2brb"]
Jul 15 23:38:56.302987 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:56.302968    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k2brb"]
Jul 15 23:38:57.970274 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:57.970223    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="410e51b9-4494-4c95-a5e3-f8f50314b50b" path="/var/lib/kubelet/pods/410e51b9-4494-4c95-a5e3-f8f50314b50b/volumes"
Jul 15 23:38:58.873225 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:58.873181    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6f8v7"]
Jul 15 23:38:58.873619 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:58.873602    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="410e51b9-4494-4c95-a5e3-f8f50314b50b" containerName="limitador"
Jul 15 23:38:58.873619 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:58.873618    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="410e51b9-4494-4c95-a5e3-f8f50314b50b" containerName="limitador"
Jul 15 23:38:58.873739 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:58.873684    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="410e51b9-4494-4c95-a5e3-f8f50314b50b" containerName="limitador"
Jul 15 23:38:58.878065 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:58.878042    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6f8v7"
Jul 15 23:38:58.880296 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:58.880273    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-n6l6b\""
Jul 15 23:38:58.881718 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:58.881699    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 15 23:38:58.881881 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:58.881861    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 23:38:58.881956 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:58.881908    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 23:38:58.888615 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:58.888592    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6f8v7"]
Jul 15 23:38:58.910674 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:58.910649    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b0e52bba-7b74-4335-94fc-ff26cb78aa1b-data\") pod \"postgres-69fb4594cf-6f8v7\" (UID: \"b0e52bba-7b74-4335-94fc-ff26cb78aa1b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6f8v7"
Jul 15 23:38:58.910776 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:58.910678    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqx54\" (UniqueName: \"kubernetes.io/projected/b0e52bba-7b74-4335-94fc-ff26cb78aa1b-kube-api-access-jqx54\") pod \"postgres-69fb4594cf-6f8v7\" (UID: \"b0e52bba-7b74-4335-94fc-ff26cb78aa1b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6f8v7"
Jul 15 23:38:59.011090 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:59.011068    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b0e52bba-7b74-4335-94fc-ff26cb78aa1b-data\") pod \"postgres-69fb4594cf-6f8v7\" (UID: \"b0e52bba-7b74-4335-94fc-ff26cb78aa1b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6f8v7"
Jul 15 23:38:59.011392 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:59.011099    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqx54\" (UniqueName: \"kubernetes.io/projected/b0e52bba-7b74-4335-94fc-ff26cb78aa1b-kube-api-access-jqx54\") pod \"postgres-69fb4594cf-6f8v7\" (UID: \"b0e52bba-7b74-4335-94fc-ff26cb78aa1b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6f8v7"
Jul 15 23:38:59.011504 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:59.011488    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b0e52bba-7b74-4335-94fc-ff26cb78aa1b-data\") pod \"postgres-69fb4594cf-6f8v7\" (UID: \"b0e52bba-7b74-4335-94fc-ff26cb78aa1b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6f8v7"
Jul 15 23:38:59.019676 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:59.019654    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqx54\" (UniqueName: \"kubernetes.io/projected/b0e52bba-7b74-4335-94fc-ff26cb78aa1b-kube-api-access-jqx54\") pod \"postgres-69fb4594cf-6f8v7\" (UID: \"b0e52bba-7b74-4335-94fc-ff26cb78aa1b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6f8v7"
Jul 15 23:38:59.192558 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:59.192501    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6f8v7"
Jul 15 23:38:59.320747 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:38:59.320716    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6f8v7"]
Jul 15 23:38:59.323655 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:38:59.323626    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0e52bba_7b74_4335_94fc_ff26cb78aa1b.slice/crio-5b0d0884ba2f82ba8213edf4f06442a0acf5a82461c9ebcabc6c50ea0f24cdce WatchSource:0}: Error finding container 5b0d0884ba2f82ba8213edf4f06442a0acf5a82461c9ebcabc6c50ea0f24cdce: Status 404 returned error can't find the container with id 5b0d0884ba2f82ba8213edf4f06442a0acf5a82461c9ebcabc6c50ea0f24cdce
Jul 15 23:39:00.309097 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:00.309025    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6f8v7" event={"ID":"b0e52bba-7b74-4335-94fc-ff26cb78aa1b","Type":"ContainerStarted","Data":"5b0d0884ba2f82ba8213edf4f06442a0acf5a82461c9ebcabc6c50ea0f24cdce"}
Jul 15 23:39:04.331172 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:04.331145    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6f8v7" event={"ID":"b0e52bba-7b74-4335-94fc-ff26cb78aa1b","Type":"ContainerStarted","Data":"85d206b83904f5f4c7331621a9413d4ba0121b1f00dbe0d4fe12146fc7f6d92f"}
Jul 15 23:39:04.331465 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:04.331200    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6f8v7"
Jul 15 23:39:04.345743 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:04.345694    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6f8v7" podStartSLOduration=1.401084189 podStartE2EDuration="6.345677681s" totalImagesPullingTime="4.944593492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:38:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:39:04.343998913 +0000 UTC m=+566.887721267" watchObservedRunningTime="2026-07-15 23:39:04.345677681 +0000 UTC m=+566.889400034"
Jul 15 23:39:10.365693 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:10.365656    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6f8v7"
Jul 15 23:39:37.912896 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:37.912869    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2wsc4_2678ca67-7c8a-42d0-a4fc-99b257a177a5/ovn-acl-logging/0.log"
Jul 15 23:39:37.914492 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:37.914471    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2wsc4_2678ca67-7c8a-42d0-a4fc-99b257a177a5/ovn-acl-logging/0.log"
Jul 15 23:39:52.238742 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.238695    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6f7f9b8ff8-sb6m5"]
Jul 15 23:39:52.257793 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.257766    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6f7f9b8ff8-sb6m5"]
Jul 15 23:39:52.257960 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.257866    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6f7f9b8ff8-sb6m5"
Jul 15 23:39:52.260202 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.260180    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 15 23:39:52.260638 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.260617    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tcjb2\""
Jul 15 23:39:52.411466 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.411431    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85774ef4-b047-4c7d-8ef1-79cbcdeab63b-openshift-service-ca\") pod \"maas-api-6f7f9b8ff8-sb6m5\" (UID: \"85774ef4-b047-4c7d-8ef1-79cbcdeab63b\") " pod="odh-ai-gateway-infra/maas-api-6f7f9b8ff8-sb6m5"
Jul 15 23:39:52.411466 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.411465    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85774ef4-b047-4c7d-8ef1-79cbcdeab63b-maas-api-tls\") pod \"maas-api-6f7f9b8ff8-sb6m5\" (UID: \"85774ef4-b047-4c7d-8ef1-79cbcdeab63b\") " pod="odh-ai-gateway-infra/maas-api-6f7f9b8ff8-sb6m5"
Jul 15 23:39:52.411655 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.411528    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ptwq\" (UniqueName: \"kubernetes.io/projected/85774ef4-b047-4c7d-8ef1-79cbcdeab63b-kube-api-access-2ptwq\") pod \"maas-api-6f7f9b8ff8-sb6m5\" (UID: \"85774ef4-b047-4c7d-8ef1-79cbcdeab63b\") " pod="odh-ai-gateway-infra/maas-api-6f7f9b8ff8-sb6m5"
Jul 15 23:39:52.512843 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.512815    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ptwq\" (UniqueName: \"kubernetes.io/projected/85774ef4-b047-4c7d-8ef1-79cbcdeab63b-kube-api-access-2ptwq\") pod \"maas-api-6f7f9b8ff8-sb6m5\" (UID: \"85774ef4-b047-4c7d-8ef1-79cbcdeab63b\") " pod="odh-ai-gateway-infra/maas-api-6f7f9b8ff8-sb6m5"
Jul 15 23:39:52.513012 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.512896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85774ef4-b047-4c7d-8ef1-79cbcdeab63b-openshift-service-ca\") pod \"maas-api-6f7f9b8ff8-sb6m5\" (UID: \"85774ef4-b047-4c7d-8ef1-79cbcdeab63b\") " pod="odh-ai-gateway-infra/maas-api-6f7f9b8ff8-sb6m5"
Jul 15 23:39:52.513012 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.512915    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85774ef4-b047-4c7d-8ef1-79cbcdeab63b-maas-api-tls\") pod \"maas-api-6f7f9b8ff8-sb6m5\" (UID: \"85774ef4-b047-4c7d-8ef1-79cbcdeab63b\") " pod="odh-ai-gateway-infra/maas-api-6f7f9b8ff8-sb6m5"
Jul 15 23:39:52.513583 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.513557    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85774ef4-b047-4c7d-8ef1-79cbcdeab63b-openshift-service-ca\") pod \"maas-api-6f7f9b8ff8-sb6m5\" (UID: \"85774ef4-b047-4c7d-8ef1-79cbcdeab63b\") " pod="odh-ai-gateway-infra/maas-api-6f7f9b8ff8-sb6m5"
Jul 15 23:39:52.515276 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.515258    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85774ef4-b047-4c7d-8ef1-79cbcdeab63b-maas-api-tls\") pod \"maas-api-6f7f9b8ff8-sb6m5\" (UID: \"85774ef4-b047-4c7d-8ef1-79cbcdeab63b\") " pod="odh-ai-gateway-infra/maas-api-6f7f9b8ff8-sb6m5"
Jul 15 23:39:52.524511 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.524490    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ptwq\" (UniqueName: \"kubernetes.io/projected/85774ef4-b047-4c7d-8ef1-79cbcdeab63b-kube-api-access-2ptwq\") pod \"maas-api-6f7f9b8ff8-sb6m5\" (UID: \"85774ef4-b047-4c7d-8ef1-79cbcdeab63b\") " pod="odh-ai-gateway-infra/maas-api-6f7f9b8ff8-sb6m5"
Jul 15 23:39:52.567374 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.567349    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6f7f9b8ff8-sb6m5"
Jul 15 23:39:52.702407 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.702378    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6f7f9b8ff8-sb6m5"]
Jul 15 23:39:52.706075 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:39:52.706043    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85774ef4_b047_4c7d_8ef1_79cbcdeab63b.slice/crio-8d62563d5346c5a6970faaef53c87b5bed7c53f4f7661275b7148da529fc3daa WatchSource:0}: Error finding container 8d62563d5346c5a6970faaef53c87b5bed7c53f4f7661275b7148da529fc3daa: Status 404 returned error can't find the container with id 8d62563d5346c5a6970faaef53c87b5bed7c53f4f7661275b7148da529fc3daa
Jul 15 23:39:52.820188 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.820114    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-pfjwg"]
Jul 15 23:39:52.824686 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.824669    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-pfjwg"
Jul 15 23:39:52.826733 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.826711    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 15 23:39:52.826836 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.826772    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-dfw5s\""
Jul 15 23:39:52.836254 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.836217    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-pfjwg"]
Jul 15 23:39:52.857526 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.857504    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-bmsq7"]
Jul 15 23:39:52.860827 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.860813    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-bmsq7"
Jul 15 23:39:52.870003 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.869983    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-bmsq7"]
Jul 15 23:39:52.916133 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.916102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shbfd\" (UniqueName: \"kubernetes.io/projected/d5c1742f-1db1-4a9a-bca9-ced160cd4e9b-kube-api-access-shbfd\") pod \"payload-processing-f9b8d9b9b-pfjwg\" (UID: \"d5c1742f-1db1-4a9a-bca9-ced160cd4e9b\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pfjwg"
Jul 15 23:39:52.916324 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:52.916151    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5c1742f-1db1-4a9a-bca9-ced160cd4e9b-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-pfjwg\" (UID: \"d5c1742f-1db1-4a9a-bca9-ced160cd4e9b\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pfjwg"
Jul 15 23:39:53.017213 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:53.017168    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shbfd\" (UniqueName: \"kubernetes.io/projected/d5c1742f-1db1-4a9a-bca9-ced160cd4e9b-kube-api-access-shbfd\") pod \"payload-processing-f9b8d9b9b-pfjwg\" (UID: \"d5c1742f-1db1-4a9a-bca9-ced160cd4e9b\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pfjwg"
Jul 15 23:39:53.017410 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:53.017222    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5c1742f-1db1-4a9a-bca9-ced160cd4e9b-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-pfjwg\" (UID: \"d5c1742f-1db1-4a9a-bca9-ced160cd4e9b\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pfjwg"
Jul 15 23:39:53.017410 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:53.017276    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfkh9\" (UniqueName: \"kubernetes.io/projected/920f7ba0-96e2-4a6a-aa34-e5ae322bf4be-kube-api-access-rfkh9\") pod \"payload-pre-processing-74584bb9f8-bmsq7\" (UID: \"920f7ba0-96e2-4a6a-aa34-e5ae322bf4be\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-bmsq7"
Jul 15 23:39:53.017410 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:53.017298    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/920f7ba0-96e2-4a6a-aa34-e5ae322bf4be-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-bmsq7\" (UID: \"920f7ba0-96e2-4a6a-aa34-e5ae322bf4be\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-bmsq7"
Jul 15 23:39:53.017934 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:53.017915    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5c1742f-1db1-4a9a-bca9-ced160cd4e9b-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-pfjwg\" (UID: \"d5c1742f-1db1-4a9a-bca9-ced160cd4e9b\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pfjwg"
Jul 15 23:39:53.024445 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:53.024426    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shbfd\" (UniqueName: \"kubernetes.io/projected/d5c1742f-1db1-4a9a-bca9-ced160cd4e9b-kube-api-access-shbfd\") pod \"payload-processing-f9b8d9b9b-pfjwg\" (UID: \"d5c1742f-1db1-4a9a-bca9-ced160cd4e9b\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pfjwg"
Jul 15 23:39:53.118696 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:53.118630    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfkh9\" (UniqueName: \"kubernetes.io/projected/920f7ba0-96e2-4a6a-aa34-e5ae322bf4be-kube-api-access-rfkh9\") pod \"payload-pre-processing-74584bb9f8-bmsq7\" (UID: \"920f7ba0-96e2-4a6a-aa34-e5ae322bf4be\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-bmsq7"
Jul 15 23:39:53.118696 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:53.118665    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/920f7ba0-96e2-4a6a-aa34-e5ae322bf4be-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-bmsq7\" (UID: \"920f7ba0-96e2-4a6a-aa34-e5ae322bf4be\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-bmsq7"
Jul 15 23:39:53.119325 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:53.119308    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/920f7ba0-96e2-4a6a-aa34-e5ae322bf4be-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-bmsq7\" (UID: \"920f7ba0-96e2-4a6a-aa34-e5ae322bf4be\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-bmsq7"
Jul 15 23:39:53.125460 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:53.125441    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfkh9\" (UniqueName: \"kubernetes.io/projected/920f7ba0-96e2-4a6a-aa34-e5ae322bf4be-kube-api-access-rfkh9\") pod \"payload-pre-processing-74584bb9f8-bmsq7\" (UID: \"920f7ba0-96e2-4a6a-aa34-e5ae322bf4be\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-bmsq7"
Jul 15 23:39:53.135308 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:53.135292    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-pfjwg"
Jul 15 23:39:53.170183 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:53.170159    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-bmsq7"
Jul 15 23:39:53.276084 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:53.275576    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-pfjwg"]
Jul 15 23:39:53.277747 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:39:53.277704    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5c1742f_1db1_4a9a_bca9_ced160cd4e9b.slice/crio-d9df5e5356b46b3e680b9a0ee2535b9eb4ba84c2e442eef12c0e6fb8a9ede06b WatchSource:0}: Error finding container d9df5e5356b46b3e680b9a0ee2535b9eb4ba84c2e442eef12c0e6fb8a9ede06b: Status 404 returned error can't find the container with id d9df5e5356b46b3e680b9a0ee2535b9eb4ba84c2e442eef12c0e6fb8a9ede06b
Jul 15 23:39:53.315279 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:53.315226    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-bmsq7"]
Jul 15 23:39:53.318567 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:39:53.318540    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod920f7ba0_96e2_4a6a_aa34_e5ae322bf4be.slice/crio-2bc86d98de473c0c5ac01b172c21d050baab3b8971eaf94f48bc6d198188c2db WatchSource:0}: Error finding container 2bc86d98de473c0c5ac01b172c21d050baab3b8971eaf94f48bc6d198188c2db: Status 404 returned error can't find the container with id 2bc86d98de473c0c5ac01b172c21d050baab3b8971eaf94f48bc6d198188c2db
Jul 15 23:39:53.543512 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:53.543475    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-pfjwg" event={"ID":"d5c1742f-1db1-4a9a-bca9-ced160cd4e9b","Type":"ContainerStarted","Data":"d9df5e5356b46b3e680b9a0ee2535b9eb4ba84c2e442eef12c0e6fb8a9ede06b"}
Jul 15 23:39:53.544812 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:53.544760    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-bmsq7" event={"ID":"920f7ba0-96e2-4a6a-aa34-e5ae322bf4be","Type":"ContainerStarted","Data":"2bc86d98de473c0c5ac01b172c21d050baab3b8971eaf94f48bc6d198188c2db"}
Jul 15 23:39:53.545962 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:53.545939    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6f7f9b8ff8-sb6m5" event={"ID":"85774ef4-b047-4c7d-8ef1-79cbcdeab63b","Type":"ContainerStarted","Data":"8d62563d5346c5a6970faaef53c87b5bed7c53f4f7661275b7148da529fc3daa"}
Jul 15 23:39:55.559989 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:55.559954    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-bmsq7" event={"ID":"920f7ba0-96e2-4a6a-aa34-e5ae322bf4be","Type":"ContainerStarted","Data":"f109caaf2fd75743710f7fc02d1876954db9b0e171d2f9caf809c36ddeb7afae"}
Jul 15 23:39:55.560505 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:55.560044    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-bmsq7"
Jul 15 23:39:55.561587 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:55.561557    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6f7f9b8ff8-sb6m5" event={"ID":"85774ef4-b047-4c7d-8ef1-79cbcdeab63b","Type":"ContainerStarted","Data":"e8be4f6f1419c39621623747df1c9247706615c4e33b86d7594a39dd228d9433"}
Jul 15 23:39:55.561707 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:55.561630    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6f7f9b8ff8-sb6m5"
Jul 15 23:39:55.563187 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:55.563166    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-pfjwg" event={"ID":"d5c1742f-1db1-4a9a-bca9-ced160cd4e9b","Type":"ContainerStarted","Data":"cc91ec43a0731d1ecc7a3c2d197d992f23a45dbc44352e96920ed0909ac8a3df"}
Jul 15 23:39:55.563354 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:55.563338    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-pfjwg"
Jul 15 23:39:55.575721 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:55.575674    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-bmsq7" podStartSLOduration=1.509554984 podStartE2EDuration="3.575655949s" totalImagesPullingTime="2.066100965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:39:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:39:55.574132624 +0000 UTC m=+618.117854982" watchObservedRunningTime="2026-07-15 23:39:55.575655949 +0000 UTC m=+618.119378303"
Jul 15 23:39:55.590581 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:55.590545    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6f7f9b8ff8-sb6m5" podStartSLOduration=0.911283169 podStartE2EDuration="3.590532849s" totalImagesPullingTime="2.67924968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:39:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:39:55.589084836 +0000 UTC m=+618.132807191" watchObservedRunningTime="2026-07-15 23:39:55.590532849 +0000 UTC m=+618.134255203"
Jul 15 23:39:55.602948 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:39:55.602913    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-pfjwg" podStartSLOduration=1.493543037 podStartE2EDuration="3.60290069s" totalImagesPullingTime="2.109357653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:39:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:39:55.60184323 +0000 UTC m=+618.145565584" watchObservedRunningTime="2026-07-15 23:39:55.60290069 +0000 UTC m=+618.146623044"
Jul 15 23:40:01.580891 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:01.580864    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6f7f9b8ff8-sb6m5"
Jul 15 23:40:06.576663 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:06.576631    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-pfjwg"
Jul 15 23:40:06.577112 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:06.576698    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-bmsq7"
Jul 15 23:40:37.639836 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.639807    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"]
Jul 15 23:40:37.642800 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.642783    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:40:37.645356 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.645336    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 23:40:37.645356 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.645343    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 15 23:40:37.645517 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.645336    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 23:40:37.645517 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.645337    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-t4j8f\""
Jul 15 23:40:37.653327 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.653311    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"]
Jul 15 23:40:37.733668 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.733644    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e90cd12-e8ee-4976-8f31-47147b925cb5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg\" (UID: \"3e90cd12-e8ee-4976-8f31-47147b925cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:40:37.733800 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.733690    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e90cd12-e8ee-4976-8f31-47147b925cb5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg\" (UID: \"3e90cd12-e8ee-4976-8f31-47147b925cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:40:37.733800 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.733717    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e90cd12-e8ee-4976-8f31-47147b925cb5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg\" (UID: \"3e90cd12-e8ee-4976-8f31-47147b925cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:40:37.733875 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.733811    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e90cd12-e8ee-4976-8f31-47147b925cb5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg\" (UID: \"3e90cd12-e8ee-4976-8f31-47147b925cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:40:37.733875 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.733849    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e90cd12-e8ee-4976-8f31-47147b925cb5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg\" (UID: \"3e90cd12-e8ee-4976-8f31-47147b925cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:40:37.733936 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.733874    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6tvj\" (UniqueName: \"kubernetes.io/projected/3e90cd12-e8ee-4976-8f31-47147b925cb5-kube-api-access-v6tvj\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg\" (UID: \"3e90cd12-e8ee-4976-8f31-47147b925cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:40:37.835186 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.835157    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e90cd12-e8ee-4976-8f31-47147b925cb5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg\" (UID: \"3e90cd12-e8ee-4976-8f31-47147b925cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:40:37.835380 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.835202    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e90cd12-e8ee-4976-8f31-47147b925cb5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg\" (UID: \"3e90cd12-e8ee-4976-8f31-47147b925cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:40:37.835380 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.835266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e90cd12-e8ee-4976-8f31-47147b925cb5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg\" (UID: \"3e90cd12-e8ee-4976-8f31-47147b925cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:40:37.835380 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.835300    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6tvj\" (UniqueName: \"kubernetes.io/projected/3e90cd12-e8ee-4976-8f31-47147b925cb5-kube-api-access-v6tvj\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg\" (UID: \"3e90cd12-e8ee-4976-8f31-47147b925cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:40:37.835380 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.835374    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e90cd12-e8ee-4976-8f31-47147b925cb5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg\" (UID: \"3e90cd12-e8ee-4976-8f31-47147b925cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:40:37.835591 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.835417    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e90cd12-e8ee-4976-8f31-47147b925cb5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg\" (UID: \"3e90cd12-e8ee-4976-8f31-47147b925cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:40:37.835692 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.835665    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e90cd12-e8ee-4976-8f31-47147b925cb5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg\" (UID: \"3e90cd12-e8ee-4976-8f31-47147b925cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:40:37.835809 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.835689    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e90cd12-e8ee-4976-8f31-47147b925cb5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg\" (UID: \"3e90cd12-e8ee-4976-8f31-47147b925cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:40:37.835809 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.835765    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e90cd12-e8ee-4976-8f31-47147b925cb5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg\" (UID: \"3e90cd12-e8ee-4976-8f31-47147b925cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:40:37.837318 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.837298    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e90cd12-e8ee-4976-8f31-47147b925cb5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg\" (UID: \"3e90cd12-e8ee-4976-8f31-47147b925cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:40:37.837578 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.837560    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e90cd12-e8ee-4976-8f31-47147b925cb5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg\" (UID: \"3e90cd12-e8ee-4976-8f31-47147b925cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:40:37.842578 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.842555    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6tvj\" (UniqueName: \"kubernetes.io/projected/3e90cd12-e8ee-4976-8f31-47147b925cb5-kube-api-access-v6tvj\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg\" (UID: \"3e90cd12-e8ee-4976-8f31-47147b925cb5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:40:37.956964 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.956915    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-t4j8f\""
Jul 15 23:40:37.965568 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:37.965543    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:40:38.093041 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:38.092996    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"]
Jul 15 23:40:38.096615 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:40:38.096593    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e90cd12_e8ee_4976_8f31_47147b925cb5.slice/crio-2b39015ade6ba88db82faff814f514a1588d98712b4ad795d3fd42960d18c41c WatchSource:0}: Error finding container 2b39015ade6ba88db82faff814f514a1588d98712b4ad795d3fd42960d18c41c: Status 404 returned error can't find the container with id 2b39015ade6ba88db82faff814f514a1588d98712b4ad795d3fd42960d18c41c
Jul 15 23:40:38.097968 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:38.097951    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 23:40:38.758324 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:38.758281    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg" event={"ID":"3e90cd12-e8ee-4976-8f31-47147b925cb5","Type":"ContainerStarted","Data":"2b39015ade6ba88db82faff814f514a1588d98712b4ad795d3fd42960d18c41c"}
Jul 15 23:40:39.764362 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:39.764329    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg" event={"ID":"3e90cd12-e8ee-4976-8f31-47147b925cb5","Type":"ContainerStarted","Data":"97609d6b3d4d649354b3dc41ee505a7955af720df07099aad1f9a99d2e4648c4"}
Jul 15 23:40:39.782545 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:39.782495    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg" podStartSLOduration=1.582446564 podStartE2EDuration="2.782482876s" totalImagesPullingTime="1.200036312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:40:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:40:39.781813275 +0000 UTC m=+662.325535629" watchObservedRunningTime="2026-07-15 23:40:39.782482876 +0000 UTC m=+662.326205229"
Jul 15 23:40:47.971415 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:47.971385    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:40:47.971839 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:47.971439    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:40:47.980838 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:47.980811    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:40:48.819632 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:40:48.819604    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg"
Jul 15 23:44:37.946394 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:44:37.946367    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2wsc4_2678ca67-7c8a-42d0-a4fc-99b257a177a5/ovn-acl-logging/0.log"
Jul 15 23:44:37.946843 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:44:37.946722    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2wsc4_2678ca67-7c8a-42d0-a4fc-99b257a177a5/ovn-acl-logging/0.log"
Jul 15 23:45:00.131148 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:45:00.131119    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735985-txllx"]
Jul 15 23:45:00.134687 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:45:00.134669    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735985-txllx"
Jul 15 23:45:00.136567 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:45:00.136549    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tp4s7\""
Jul 15 23:45:00.141013 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:45:00.140988    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735985-txllx"]
Jul 15 23:45:00.146094 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:45:00.146076    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735985-txllx"
Jul 15 23:45:00.269155 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:45:00.269119    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735985-txllx"]
Jul 15 23:45:00.273393 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:45:00.273367    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ac559b3_9e52_4706_bc71_fbfbbfff5a3e.slice/crio-6cde6e48c48c0c4e64ec7779404afbdc67a6919d8e55f747ab81cb8c19bca1e4 WatchSource:0}: Error finding container 6cde6e48c48c0c4e64ec7779404afbdc67a6919d8e55f747ab81cb8c19bca1e4: Status 404 returned error can't find the container with id 6cde6e48c48c0c4e64ec7779404afbdc67a6919d8e55f747ab81cb8c19bca1e4
Jul 15 23:45:00.941885 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:45:00.941855    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735985-txllx" event={"ID":"8ac559b3-9e52-4706-bc71-fbfbbfff5a3e","Type":"ContainerStarted","Data":"6cde6e48c48c0c4e64ec7779404afbdc67a6919d8e55f747ab81cb8c19bca1e4"}
Jul 15 23:45:02.953072 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:45:02.953043    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735985-txllx" event={"ID":"8ac559b3-9e52-4706-bc71-fbfbbfff5a3e","Type":"ContainerStarted","Data":"98797d0577d427b7e8d96df7809d3f1c6a28348a7b882938e0f6d91f97523a6c"}
Jul 15 23:45:02.967529 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:45:02.967489    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735985-txllx" podStartSLOduration=0.864982479 podStartE2EDuration="2.967473319s" totalImagesPullingTime="2.10249084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:45:02.965648716 +0000 UTC m=+925.509371070" watchObservedRunningTime="2026-07-15 23:45:02.967473319 +0000 UTC m=+925.511195673"
Jul 15 23:45:03.958853 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:45:03.958818    2576 generic.go:356] "Generic (PLEG): container finished" podID="8ac559b3-9e52-4706-bc71-fbfbbfff5a3e" containerID="98797d0577d427b7e8d96df7809d3f1c6a28348a7b882938e0f6d91f97523a6c" exitCode=0
Jul 15 23:45:03.959271 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:45:03.958892    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735985-txllx" event={"ID":"8ac559b3-9e52-4706-bc71-fbfbbfff5a3e","Type":"ContainerDied","Data":"98797d0577d427b7e8d96df7809d3f1c6a28348a7b882938e0f6d91f97523a6c"}
Jul 15 23:45:05.096184 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:45:05.096161    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735985-txllx"
Jul 15 23:45:05.975636 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:45:05.975610    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735985-txllx"
Jul 15 23:45:05.978499 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:45:05.978463    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735985-txllx" event={"ID":"8ac559b3-9e52-4706-bc71-fbfbbfff5a3e","Type":"ContainerDied","Data":"6cde6e48c48c0c4e64ec7779404afbdc67a6919d8e55f747ab81cb8c19bca1e4"}
Jul 15 23:45:05.978635 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:45:05.978520    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6cde6e48c48c0c4e64ec7779404afbdc67a6919d8e55f747ab81cb8c19bca1e4"
Jul 15 23:49:37.975079 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:49:37.975052    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2wsc4_2678ca67-7c8a-42d0-a4fc-99b257a177a5/ovn-acl-logging/0.log"
Jul 15 23:49:37.976376 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:49:37.976354    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2wsc4_2678ca67-7c8a-42d0-a4fc-99b257a177a5/ovn-acl-logging/0.log"
Jul 15 23:50:25.983270 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:50:25.983221    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mphlg"]
Jul 15 23:50:25.985714 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:50:25.983569    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ac559b3-9e52-4706-bc71-fbfbbfff5a3e" containerName="cleanup"
Jul 15 23:50:25.985714 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:50:25.983581    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ac559b3-9e52-4706-bc71-fbfbbfff5a3e" containerName="cleanup"
Jul 15 23:50:25.985714 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:50:25.983647    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ac559b3-9e52-4706-bc71-fbfbbfff5a3e" containerName="cleanup"
Jul 15 23:50:25.986603 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:50:25.986589    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mphlg"
Jul 15 23:50:25.989543 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:50:25.989523    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-44h9l\""
Jul 15 23:50:25.997678 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:50:25.997655    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mphlg"]
Jul 15 23:50:26.052618 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:50:26.052595    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp7wp\" (UniqueName: \"kubernetes.io/projected/c65906a1-12d5-4f31-ade2-ea90f56c085a-kube-api-access-cp7wp\") pod \"kuadrant-operator-controller-manager-86878c769f-mphlg\" (UID: \"c65906a1-12d5-4f31-ade2-ea90f56c085a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mphlg"
Jul 15 23:50:26.052708 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:50:26.052642    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c65906a1-12d5-4f31-ade2-ea90f56c085a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mphlg\" (UID: \"c65906a1-12d5-4f31-ade2-ea90f56c085a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mphlg"
Jul 15 23:50:26.152972 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:50:26.152936    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp7wp\" (UniqueName: \"kubernetes.io/projected/c65906a1-12d5-4f31-ade2-ea90f56c085a-kube-api-access-cp7wp\") pod \"kuadrant-operator-controller-manager-86878c769f-mphlg\" (UID: \"c65906a1-12d5-4f31-ade2-ea90f56c085a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mphlg"
Jul 15 23:50:26.153080 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:50:26.153001    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c65906a1-12d5-4f31-ade2-ea90f56c085a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mphlg\" (UID: \"c65906a1-12d5-4f31-ade2-ea90f56c085a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mphlg"
Jul 15 23:50:26.153377 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:50:26.153356    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c65906a1-12d5-4f31-ade2-ea90f56c085a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mphlg\" (UID: \"c65906a1-12d5-4f31-ade2-ea90f56c085a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mphlg"
Jul 15 23:50:26.160786 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:50:26.160764    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp7wp\" (UniqueName: \"kubernetes.io/projected/c65906a1-12d5-4f31-ade2-ea90f56c085a-kube-api-access-cp7wp\") pod \"kuadrant-operator-controller-manager-86878c769f-mphlg\" (UID: \"c65906a1-12d5-4f31-ade2-ea90f56c085a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mphlg"
Jul 15 23:50:26.296794 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:50:26.296765    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mphlg"
Jul 15 23:50:26.427538 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:50:26.427517    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mphlg"]
Jul 15 23:50:26.430027 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:50:26.430000    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc65906a1_12d5_4f31_ade2_ea90f56c085a.slice/crio-eb5938f719784bc17eec7480b2d29e92abe2fe8a2133c6c3892174e810296fe1 WatchSource:0}: Error finding container eb5938f719784bc17eec7480b2d29e92abe2fe8a2133c6c3892174e810296fe1: Status 404 returned error can't find the container with id eb5938f719784bc17eec7480b2d29e92abe2fe8a2133c6c3892174e810296fe1
Jul 15 23:50:27.421039 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:50:27.421006    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mphlg" event={"ID":"c65906a1-12d5-4f31-ade2-ea90f56c085a","Type":"ContainerStarted","Data":"fdf340d5287afdff6ae675bb506dc9fed18187e931e5b3e4928d49d2291a8ac1"}
Jul 15 23:50:27.421413 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:50:27.421057    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mphlg" event={"ID":"c65906a1-12d5-4f31-ade2-ea90f56c085a","Type":"ContainerStarted","Data":"eb5938f719784bc17eec7480b2d29e92abe2fe8a2133c6c3892174e810296fe1"}
Jul 15 23:50:27.421413 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:50:27.421131    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mphlg"
Jul 15 23:50:27.442983 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:50:27.442939    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mphlg" podStartSLOduration=2.442926742 podStartE2EDuration="2.442926742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:50:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:50:27.441135835 +0000 UTC m=+1249.984858193" watchObservedRunningTime="2026-07-15 23:50:27.442926742 +0000 UTC m=+1249.986649095"
Jul 15 23:50:38.427120 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:50:38.427094    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mphlg"
Jul 15 23:54:38.001871 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:54:38.001845    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2wsc4_2678ca67-7c8a-42d0-a4fc-99b257a177a5/ovn-acl-logging/0.log"
Jul 15 23:54:38.005375 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:54:38.005353    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2wsc4_2678ca67-7c8a-42d0-a4fc-99b257a177a5/ovn-acl-logging/0.log"
Jul 15 23:56:42.800809 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:42.800772    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh"]
Jul 15 23:56:42.804356 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:42.804332    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh"
Jul 15 23:56:42.806395 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:42.806374    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-1b1b98a6-serving-cert\""
Jul 15 23:56:42.814462 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:42.814404    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh"]
Jul 15 23:56:42.885870 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:42.885801    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22792ba8-2942-4832-b5cd-50dc76a5f5a4-maas-api-tls\") pod \"maas-api-e2e-ait-1b1b98a6-85455f487f-45csh\" (UID: \"22792ba8-2942-4832-b5cd-50dc76a5f5a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh"
Jul 15 23:56:42.885870 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:42.885840    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqq9p\" (UniqueName: \"kubernetes.io/projected/22792ba8-2942-4832-b5cd-50dc76a5f5a4-kube-api-access-tqq9p\") pod \"maas-api-e2e-ait-1b1b98a6-85455f487f-45csh\" (UID: \"22792ba8-2942-4832-b5cd-50dc76a5f5a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh"
Jul 15 23:56:42.886054 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:42.885909    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22792ba8-2942-4832-b5cd-50dc76a5f5a4-openshift-service-ca\") pod \"maas-api-e2e-ait-1b1b98a6-85455f487f-45csh\" (UID: \"22792ba8-2942-4832-b5cd-50dc76a5f5a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh"
Jul 15 23:56:42.987118 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:42.987088    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22792ba8-2942-4832-b5cd-50dc76a5f5a4-maas-api-tls\") pod \"maas-api-e2e-ait-1b1b98a6-85455f487f-45csh\" (UID: \"22792ba8-2942-4832-b5cd-50dc76a5f5a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh"
Jul 15 23:56:42.987118 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:42.987119    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqq9p\" (UniqueName: \"kubernetes.io/projected/22792ba8-2942-4832-b5cd-50dc76a5f5a4-kube-api-access-tqq9p\") pod \"maas-api-e2e-ait-1b1b98a6-85455f487f-45csh\" (UID: \"22792ba8-2942-4832-b5cd-50dc76a5f5a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh"
Jul 15 23:56:42.987305 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:42.987159    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22792ba8-2942-4832-b5cd-50dc76a5f5a4-openshift-service-ca\") pod \"maas-api-e2e-ait-1b1b98a6-85455f487f-45csh\" (UID: \"22792ba8-2942-4832-b5cd-50dc76a5f5a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh"
Jul 15 23:56:42.987305 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:56:42.987226    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-serving-cert: secret "maas-api-e2e-ait-1b1b98a6-serving-cert" not found
Jul 15 23:56:42.987372 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:56:42.987316    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22792ba8-2942-4832-b5cd-50dc76a5f5a4-maas-api-tls podName:22792ba8-2942-4832-b5cd-50dc76a5f5a4 nodeName:}" failed. No retries permitted until 2026-07-15 23:56:43.487297221 +0000 UTC m=+1626.031019557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/22792ba8-2942-4832-b5cd-50dc76a5f5a4-maas-api-tls") pod "maas-api-e2e-ait-1b1b98a6-85455f487f-45csh" (UID: "22792ba8-2942-4832-b5cd-50dc76a5f5a4") : secret "maas-api-e2e-ait-1b1b98a6-serving-cert" not found
Jul 15 23:56:42.987800 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:42.987782    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22792ba8-2942-4832-b5cd-50dc76a5f5a4-openshift-service-ca\") pod \"maas-api-e2e-ait-1b1b98a6-85455f487f-45csh\" (UID: \"22792ba8-2942-4832-b5cd-50dc76a5f5a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh"
Jul 15 23:56:42.997983 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:42.997953    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqq9p\" (UniqueName: \"kubernetes.io/projected/22792ba8-2942-4832-b5cd-50dc76a5f5a4-kube-api-access-tqq9p\") pod \"maas-api-e2e-ait-1b1b98a6-85455f487f-45csh\" (UID: \"22792ba8-2942-4832-b5cd-50dc76a5f5a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh"
Jul 15 23:56:43.491483 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:43.491454    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22792ba8-2942-4832-b5cd-50dc76a5f5a4-maas-api-tls\") pod \"maas-api-e2e-ait-1b1b98a6-85455f487f-45csh\" (UID: \"22792ba8-2942-4832-b5cd-50dc76a5f5a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh"
Jul 15 23:56:43.493799 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:43.493772    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22792ba8-2942-4832-b5cd-50dc76a5f5a4-maas-api-tls\") pod \"maas-api-e2e-ait-1b1b98a6-85455f487f-45csh\" (UID: \"22792ba8-2942-4832-b5cd-50dc76a5f5a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh"
Jul 15 23:56:43.718384 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:43.718355    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh"
Jul 15 23:56:43.842951 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:43.842926    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh"]
Jul 15 23:56:43.845665 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:56:43.845636    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22792ba8_2942_4832_b5cd_50dc76a5f5a4.slice/crio-79f66d14d974f1773c42af3d36ba7646082fd30af51bae390b9b97f738dcaefa WatchSource:0}: Error finding container 79f66d14d974f1773c42af3d36ba7646082fd30af51bae390b9b97f738dcaefa: Status 404 returned error can't find the container with id 79f66d14d974f1773c42af3d36ba7646082fd30af51bae390b9b97f738dcaefa
Jul 15 23:56:43.847143 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:43.847123    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 23:56:44.137820 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:44.137739    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh" event={"ID":"22792ba8-2942-4832-b5cd-50dc76a5f5a4","Type":"ContainerStarted","Data":"79f66d14d974f1773c42af3d36ba7646082fd30af51bae390b9b97f738dcaefa"}
Jul 15 23:56:45.144488 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:45.144448    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh" event={"ID":"22792ba8-2942-4832-b5cd-50dc76a5f5a4","Type":"ContainerStarted","Data":"5ff685aa3a1e80ca9be48609d72e2c93b389f032e0dc18f021d3273449ab432c"}
Jul 15 23:56:45.144872 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:45.144543    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh"
Jul 15 23:56:45.159859 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:45.159813    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh" podStartSLOduration=2.746581033 podStartE2EDuration="3.159799031s" totalImagesPullingTime="413.217998ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:56:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:56:45.158766382 +0000 UTC m=+1627.702488738" watchObservedRunningTime="2026-07-15 23:56:45.159799031 +0000 UTC m=+1627.703521385"
Jul 15 23:56:51.153596 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:51.153568    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh"
Jul 15 23:56:54.111159 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:54.111128    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh"]
Jul 15 23:56:54.111637 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:54.111321    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh" podUID="22792ba8-2942-4832-b5cd-50dc76a5f5a4" containerName="maas-api" containerID="cri-o://5ff685aa3a1e80ca9be48609d72e2c93b389f032e0dc18f021d3273449ab432c" gracePeriod=30
Jul 15 23:56:54.355552 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:54.355529    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh"
Jul 15 23:56:54.482550 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:54.482472    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22792ba8-2942-4832-b5cd-50dc76a5f5a4-maas-api-tls\") pod \"22792ba8-2942-4832-b5cd-50dc76a5f5a4\" (UID: \"22792ba8-2942-4832-b5cd-50dc76a5f5a4\") "
Jul 15 23:56:54.482550 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:54.482529    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqq9p\" (UniqueName: \"kubernetes.io/projected/22792ba8-2942-4832-b5cd-50dc76a5f5a4-kube-api-access-tqq9p\") pod \"22792ba8-2942-4832-b5cd-50dc76a5f5a4\" (UID: \"22792ba8-2942-4832-b5cd-50dc76a5f5a4\") "
Jul 15 23:56:54.482762 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:54.482563    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22792ba8-2942-4832-b5cd-50dc76a5f5a4-openshift-service-ca\") pod \"22792ba8-2942-4832-b5cd-50dc76a5f5a4\" (UID: \"22792ba8-2942-4832-b5cd-50dc76a5f5a4\") "
Jul 15 23:56:54.482949 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:54.482923    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22792ba8-2942-4832-b5cd-50dc76a5f5a4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "22792ba8-2942-4832-b5cd-50dc76a5f5a4" (UID: "22792ba8-2942-4832-b5cd-50dc76a5f5a4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:56:54.484579 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:54.484562    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22792ba8-2942-4832-b5cd-50dc76a5f5a4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "22792ba8-2942-4832-b5cd-50dc76a5f5a4" (UID: "22792ba8-2942-4832-b5cd-50dc76a5f5a4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:56:54.484682 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:54.484670    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22792ba8-2942-4832-b5cd-50dc76a5f5a4-kube-api-access-tqq9p" (OuterVolumeSpecName: "kube-api-access-tqq9p") pod "22792ba8-2942-4832-b5cd-50dc76a5f5a4" (UID: "22792ba8-2942-4832-b5cd-50dc76a5f5a4"). InnerVolumeSpecName "kube-api-access-tqq9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:56:54.583682 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:54.583657    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqq9p\" (UniqueName: \"kubernetes.io/projected/22792ba8-2942-4832-b5cd-50dc76a5f5a4-kube-api-access-tqq9p\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:56:54.583682 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:54.583677    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22792ba8-2942-4832-b5cd-50dc76a5f5a4-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:56:54.583815 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:54.583687    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22792ba8-2942-4832-b5cd-50dc76a5f5a4-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:56:55.189536 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:55.189501    2576 generic.go:356] "Generic (PLEG): container finished" podID="22792ba8-2942-4832-b5cd-50dc76a5f5a4" containerID="5ff685aa3a1e80ca9be48609d72e2c93b389f032e0dc18f021d3273449ab432c" exitCode=0
Jul 15 23:56:55.189922 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:55.189558    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh"
Jul 15 23:56:55.189922 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:55.189578    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh" event={"ID":"22792ba8-2942-4832-b5cd-50dc76a5f5a4","Type":"ContainerDied","Data":"5ff685aa3a1e80ca9be48609d72e2c93b389f032e0dc18f021d3273449ab432c"}
Jul 15 23:56:55.189922 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:55.189623    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh" event={"ID":"22792ba8-2942-4832-b5cd-50dc76a5f5a4","Type":"ContainerDied","Data":"79f66d14d974f1773c42af3d36ba7646082fd30af51bae390b9b97f738dcaefa"}
Jul 15 23:56:55.189922 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:55.189646    2576 scope.go:117] "RemoveContainer" containerID="5ff685aa3a1e80ca9be48609d72e2c93b389f032e0dc18f021d3273449ab432c"
Jul 15 23:56:55.205363 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:55.205344    2576 scope.go:117] "RemoveContainer" containerID="5ff685aa3a1e80ca9be48609d72e2c93b389f032e0dc18f021d3273449ab432c"
Jul 15 23:56:55.205616 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:56:55.205596    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ff685aa3a1e80ca9be48609d72e2c93b389f032e0dc18f021d3273449ab432c\": container with ID starting with 5ff685aa3a1e80ca9be48609d72e2c93b389f032e0dc18f021d3273449ab432c not found: ID does not exist" containerID="5ff685aa3a1e80ca9be48609d72e2c93b389f032e0dc18f021d3273449ab432c"
Jul 15 23:56:55.205684 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:55.205627    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ff685aa3a1e80ca9be48609d72e2c93b389f032e0dc18f021d3273449ab432c"} err="failed to get container status \"5ff685aa3a1e80ca9be48609d72e2c93b389f032e0dc18f021d3273449ab432c\": rpc error: code = NotFound desc = could not find container \"5ff685aa3a1e80ca9be48609d72e2c93b389f032e0dc18f021d3273449ab432c\": container with ID starting with 5ff685aa3a1e80ca9be48609d72e2c93b389f032e0dc18f021d3273449ab432c not found: ID does not exist"
Jul 15 23:56:55.211563 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:55.211540    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh"]
Jul 15 23:56:55.215534 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:55.215510    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1b1b98a6-85455f487f-45csh"]
Jul 15 23:56:55.970776 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:56:55.970746    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22792ba8-2942-4832-b5cd-50dc76a5f5a4" path="/var/lib/kubelet/pods/22792ba8-2942-4832-b5cd-50dc76a5f5a4/volumes"
Jul 15 23:57:01.187506 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:01.187439    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm"]
Jul 15 23:57:01.187898 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:01.187763    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22792ba8-2942-4832-b5cd-50dc76a5f5a4" containerName="maas-api"
Jul 15 23:57:01.187898 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:01.187775    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="22792ba8-2942-4832-b5cd-50dc76a5f5a4" containerName="maas-api"
Jul 15 23:57:01.187898 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:01.187855    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="22792ba8-2942-4832-b5cd-50dc76a5f5a4" containerName="maas-api"
Jul 15 23:57:01.192057 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:01.192039    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm"
Jul 15 23:57:01.194071 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:01.194055    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-e8205bad-serving-cert\""
Jul 15 23:57:01.201066 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:01.201044    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm"]
Jul 15 23:57:01.333778 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:01.333744    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d010e97-8d4a-4df2-9c25-87a245fd6e64-maas-api-tls\") pod \"maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm\" (UID: \"4d010e97-8d4a-4df2-9c25-87a245fd6e64\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm"
Jul 15 23:57:01.333925 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:01.333811    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d010e97-8d4a-4df2-9c25-87a245fd6e64-openshift-service-ca\") pod \"maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm\" (UID: \"4d010e97-8d4a-4df2-9c25-87a245fd6e64\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm"
Jul 15 23:57:01.333925 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:01.333839    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9xn9\" (UniqueName: \"kubernetes.io/projected/4d010e97-8d4a-4df2-9c25-87a245fd6e64-kube-api-access-g9xn9\") pod \"maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm\" (UID: \"4d010e97-8d4a-4df2-9c25-87a245fd6e64\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm"
Jul 15 23:57:01.434492 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:01.434461    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d010e97-8d4a-4df2-9c25-87a245fd6e64-maas-api-tls\") pod \"maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm\" (UID: \"4d010e97-8d4a-4df2-9c25-87a245fd6e64\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm"
Jul 15 23:57:01.434630 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:01.434514    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d010e97-8d4a-4df2-9c25-87a245fd6e64-openshift-service-ca\") pod \"maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm\" (UID: \"4d010e97-8d4a-4df2-9c25-87a245fd6e64\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm"
Jul 15 23:57:01.434630 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:01.434532    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9xn9\" (UniqueName: \"kubernetes.io/projected/4d010e97-8d4a-4df2-9c25-87a245fd6e64-kube-api-access-g9xn9\") pod \"maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm\" (UID: \"4d010e97-8d4a-4df2-9c25-87a245fd6e64\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm"
Jul 15 23:57:01.435141 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:01.435116    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d010e97-8d4a-4df2-9c25-87a245fd6e64-openshift-service-ca\") pod \"maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm\" (UID: \"4d010e97-8d4a-4df2-9c25-87a245fd6e64\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm"
Jul 15 23:57:01.436925 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:01.436907    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d010e97-8d4a-4df2-9c25-87a245fd6e64-maas-api-tls\") pod \"maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm\" (UID: \"4d010e97-8d4a-4df2-9c25-87a245fd6e64\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm"
Jul 15 23:57:01.441443 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:01.441391    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9xn9\" (UniqueName: \"kubernetes.io/projected/4d010e97-8d4a-4df2-9c25-87a245fd6e64-kube-api-access-g9xn9\") pod \"maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm\" (UID: \"4d010e97-8d4a-4df2-9c25-87a245fd6e64\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm"
Jul 15 23:57:01.504326 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:01.504299    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm"
Jul 15 23:57:01.635974 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:01.635944    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm"]
Jul 15 23:57:01.639976 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:57:01.639951    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d010e97_8d4a_4df2_9c25_87a245fd6e64.slice/crio-6eacdf7f74c849b55b478510182953d5dc240e5cef31f4e0174ed78ef1fba81c WatchSource:0}: Error finding container 6eacdf7f74c849b55b478510182953d5dc240e5cef31f4e0174ed78ef1fba81c: Status 404 returned error can't find the container with id 6eacdf7f74c849b55b478510182953d5dc240e5cef31f4e0174ed78ef1fba81c
Jul 15 23:57:02.224753 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:02.224682    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm" event={"ID":"4d010e97-8d4a-4df2-9c25-87a245fd6e64","Type":"ContainerStarted","Data":"6ca262c85a73a369d28de3673f036c4f9531772c2a4d20fed97419095d8b54e4"}
Jul 15 23:57:02.224753 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:02.224732    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm" event={"ID":"4d010e97-8d4a-4df2-9c25-87a245fd6e64","Type":"ContainerStarted","Data":"6eacdf7f74c849b55b478510182953d5dc240e5cef31f4e0174ed78ef1fba81c"}
Jul 15 23:57:02.225126 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:02.224760    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm"
Jul 15 23:57:02.239710 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:02.239666    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm" podStartSLOduration=0.956379875 podStartE2EDuration="1.239648098s" totalImagesPullingTime="283.268223ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:57:02.238463396 +0000 UTC m=+1644.782185751" watchObservedRunningTime="2026-07-15 23:57:02.239648098 +0000 UTC m=+1644.783370453"
Jul 15 23:57:08.235797 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:08.235772    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm"
Jul 15 23:57:12.279809 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:12.279776    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm"]
Jul 15 23:57:12.280279 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:12.279974    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm" podUID="4d010e97-8d4a-4df2-9c25-87a245fd6e64" containerName="maas-api" containerID="cri-o://6ca262c85a73a369d28de3673f036c4f9531772c2a4d20fed97419095d8b54e4" gracePeriod=30
Jul 15 23:57:12.525821 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:12.525794    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm"
Jul 15 23:57:12.622019 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:12.621954    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d010e97-8d4a-4df2-9c25-87a245fd6e64-maas-api-tls\") pod \"4d010e97-8d4a-4df2-9c25-87a245fd6e64\" (UID: \"4d010e97-8d4a-4df2-9c25-87a245fd6e64\") "
Jul 15 23:57:12.622192 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:12.622031    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d010e97-8d4a-4df2-9c25-87a245fd6e64-openshift-service-ca\") pod \"4d010e97-8d4a-4df2-9c25-87a245fd6e64\" (UID: \"4d010e97-8d4a-4df2-9c25-87a245fd6e64\") "
Jul 15 23:57:12.622192 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:12.622065    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9xn9\" (UniqueName: \"kubernetes.io/projected/4d010e97-8d4a-4df2-9c25-87a245fd6e64-kube-api-access-g9xn9\") pod \"4d010e97-8d4a-4df2-9c25-87a245fd6e64\" (UID: \"4d010e97-8d4a-4df2-9c25-87a245fd6e64\") "
Jul 15 23:57:12.622404 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:12.622382    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d010e97-8d4a-4df2-9c25-87a245fd6e64-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4d010e97-8d4a-4df2-9c25-87a245fd6e64" (UID: "4d010e97-8d4a-4df2-9c25-87a245fd6e64"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:57:12.623963 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:12.623940    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d010e97-8d4a-4df2-9c25-87a245fd6e64-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4d010e97-8d4a-4df2-9c25-87a245fd6e64" (UID: "4d010e97-8d4a-4df2-9c25-87a245fd6e64"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:57:12.624057 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:12.623984    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d010e97-8d4a-4df2-9c25-87a245fd6e64-kube-api-access-g9xn9" (OuterVolumeSpecName: "kube-api-access-g9xn9") pod "4d010e97-8d4a-4df2-9c25-87a245fd6e64" (UID: "4d010e97-8d4a-4df2-9c25-87a245fd6e64"). InnerVolumeSpecName "kube-api-access-g9xn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:57:12.723590 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:12.723568    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d010e97-8d4a-4df2-9c25-87a245fd6e64-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:57:12.723590 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:12.723589    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9xn9\" (UniqueName: \"kubernetes.io/projected/4d010e97-8d4a-4df2-9c25-87a245fd6e64-kube-api-access-g9xn9\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:57:12.723744 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:12.723598    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d010e97-8d4a-4df2-9c25-87a245fd6e64-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:57:13.275322 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:13.275288    2576 generic.go:356] "Generic (PLEG): container finished" podID="4d010e97-8d4a-4df2-9c25-87a245fd6e64" containerID="6ca262c85a73a369d28de3673f036c4f9531772c2a4d20fed97419095d8b54e4" exitCode=0
Jul 15 23:57:13.275488 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:13.275332    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm"
Jul 15 23:57:13.275488 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:13.275376    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm" event={"ID":"4d010e97-8d4a-4df2-9c25-87a245fd6e64","Type":"ContainerDied","Data":"6ca262c85a73a369d28de3673f036c4f9531772c2a4d20fed97419095d8b54e4"}
Jul 15 23:57:13.275488 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:13.275432    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm" event={"ID":"4d010e97-8d4a-4df2-9c25-87a245fd6e64","Type":"ContainerDied","Data":"6eacdf7f74c849b55b478510182953d5dc240e5cef31f4e0174ed78ef1fba81c"}
Jul 15 23:57:13.275488 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:13.275460    2576 scope.go:117] "RemoveContainer" containerID="6ca262c85a73a369d28de3673f036c4f9531772c2a4d20fed97419095d8b54e4"
Jul 15 23:57:13.290853 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:13.290689    2576 scope.go:117] "RemoveContainer" containerID="6ca262c85a73a369d28de3673f036c4f9531772c2a4d20fed97419095d8b54e4"
Jul 15 23:57:13.291092 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:57:13.290950    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ca262c85a73a369d28de3673f036c4f9531772c2a4d20fed97419095d8b54e4\": container with ID starting with 6ca262c85a73a369d28de3673f036c4f9531772c2a4d20fed97419095d8b54e4 not found: ID does not exist" containerID="6ca262c85a73a369d28de3673f036c4f9531772c2a4d20fed97419095d8b54e4"
Jul 15 23:57:13.291092 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:13.290971    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ca262c85a73a369d28de3673f036c4f9531772c2a4d20fed97419095d8b54e4"} err="failed to get container status \"6ca262c85a73a369d28de3673f036c4f9531772c2a4d20fed97419095d8b54e4\": rpc error: code = NotFound desc = could not find container \"6ca262c85a73a369d28de3673f036c4f9531772c2a4d20fed97419095d8b54e4\": container with ID starting with 6ca262c85a73a369d28de3673f036c4f9531772c2a4d20fed97419095d8b54e4 not found: ID does not exist"
Jul 15 23:57:13.298539 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:13.298518    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm"]
Jul 15 23:57:13.301485 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:13.301466    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e8205bad-86bb7bffdf-mhhzm"]
Jul 15 23:57:13.970419 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:13.970385    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d010e97-8d4a-4df2-9c25-87a245fd6e64" path="/var/lib/kubelet/pods/4d010e97-8d4a-4df2-9c25-87a245fd6e64/volumes"
Jul 15 23:57:18.377163 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:18.377125    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt"]
Jul 15 23:57:18.377635 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:18.377486    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d010e97-8d4a-4df2-9c25-87a245fd6e64" containerName="maas-api"
Jul 15 23:57:18.377635 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:18.377497    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d010e97-8d4a-4df2-9c25-87a245fd6e64" containerName="maas-api"
Jul 15 23:57:18.377635 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:18.377573    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d010e97-8d4a-4df2-9c25-87a245fd6e64" containerName="maas-api"
Jul 15 23:57:18.381780 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:18.381758    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt"
Jul 15 23:57:18.383657 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:18.383640    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-75c89f12-serving-cert\""
Jul 15 23:57:18.395003 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:18.394981    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt"]
Jul 15 23:57:18.465823 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:18.465752    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdf4h\" (UniqueName: \"kubernetes.io/projected/1a7367df-bc92-4e4e-8270-a22e9045c971-kube-api-access-qdf4h\") pod \"maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt\" (UID: \"1a7367df-bc92-4e4e-8270-a22e9045c971\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt"
Jul 15 23:57:18.465823 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:18.465796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a7367df-bc92-4e4e-8270-a22e9045c971-maas-api-tls\") pod \"maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt\" (UID: \"1a7367df-bc92-4e4e-8270-a22e9045c971\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt"
Jul 15 23:57:18.465987 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:18.465877    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a7367df-bc92-4e4e-8270-a22e9045c971-openshift-service-ca\") pod \"maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt\" (UID: \"1a7367df-bc92-4e4e-8270-a22e9045c971\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt"
Jul 15 23:57:18.566506 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:18.566479    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a7367df-bc92-4e4e-8270-a22e9045c971-openshift-service-ca\") pod \"maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt\" (UID: \"1a7367df-bc92-4e4e-8270-a22e9045c971\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt"
Jul 15 23:57:18.566632 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:18.566543    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdf4h\" (UniqueName: \"kubernetes.io/projected/1a7367df-bc92-4e4e-8270-a22e9045c971-kube-api-access-qdf4h\") pod \"maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt\" (UID: \"1a7367df-bc92-4e4e-8270-a22e9045c971\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt"
Jul 15 23:57:18.566632 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:18.566578    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a7367df-bc92-4e4e-8270-a22e9045c971-maas-api-tls\") pod \"maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt\" (UID: \"1a7367df-bc92-4e4e-8270-a22e9045c971\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt"
Jul 15 23:57:18.567049 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:18.567029    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a7367df-bc92-4e4e-8270-a22e9045c971-openshift-service-ca\") pod \"maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt\" (UID: \"1a7367df-bc92-4e4e-8270-a22e9045c971\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt"
Jul 15 23:57:18.568824 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:18.568804    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a7367df-bc92-4e4e-8270-a22e9045c971-maas-api-tls\") pod \"maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt\" (UID: \"1a7367df-bc92-4e4e-8270-a22e9045c971\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt"
Jul 15 23:57:18.575720 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:18.575697    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdf4h\" (UniqueName: \"kubernetes.io/projected/1a7367df-bc92-4e4e-8270-a22e9045c971-kube-api-access-qdf4h\") pod \"maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt\" (UID: \"1a7367df-bc92-4e4e-8270-a22e9045c971\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt"
Jul 15 23:57:18.692867 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:18.692836    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt"
Jul 15 23:57:18.823835 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:18.823807    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt"]
Jul 15 23:57:18.827373 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:57:18.827344    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a7367df_bc92_4e4e_8270_a22e9045c971.slice/crio-cce6be8aa3a6bf6f1280959036578fa1d5c652a639956fde158a03bf805184d9 WatchSource:0}: Error finding container cce6be8aa3a6bf6f1280959036578fa1d5c652a639956fde158a03bf805184d9: Status 404 returned error can't find the container with id cce6be8aa3a6bf6f1280959036578fa1d5c652a639956fde158a03bf805184d9
Jul 15 23:57:19.305174 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:19.305132    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt" event={"ID":"1a7367df-bc92-4e4e-8270-a22e9045c971","Type":"ContainerStarted","Data":"f6ce0ff8483fa62991eb4b53ce5cb76fae2b133c1a65f9520ef296e88209cea2"}
Jul 15 23:57:19.305343 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:19.305196    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt"
Jul 15 23:57:19.305343 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:19.305213    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt" event={"ID":"1a7367df-bc92-4e4e-8270-a22e9045c971","Type":"ContainerStarted","Data":"cce6be8aa3a6bf6f1280959036578fa1d5c652a639956fde158a03bf805184d9"}
Jul 15 23:57:19.321351 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:19.321300    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt" podStartSLOduration=1.002989353 podStartE2EDuration="1.321281106s" totalImagesPullingTime="318.291753ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:57:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:57:19.320289492 +0000 UTC m=+1661.864011845" watchObservedRunningTime="2026-07-15 23:57:19.321281106 +0000 UTC m=+1661.865003439"
Jul 15 23:57:25.316250 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:25.316210    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt"
Jul 15 23:57:29.475178 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:29.475147    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt"]
Jul 15 23:57:29.475635 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:29.475365    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt" podUID="1a7367df-bc92-4e4e-8270-a22e9045c971" containerName="maas-api" containerID="cri-o://f6ce0ff8483fa62991eb4b53ce5cb76fae2b133c1a65f9520ef296e88209cea2" gracePeriod=30
Jul 15 23:57:29.718069 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:29.718044    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt"
Jul 15 23:57:29.753246 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:29.753212    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a7367df-bc92-4e4e-8270-a22e9045c971-maas-api-tls\") pod \"1a7367df-bc92-4e4e-8270-a22e9045c971\" (UID: \"1a7367df-bc92-4e4e-8270-a22e9045c971\") "
Jul 15 23:57:29.753400 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:29.753268    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a7367df-bc92-4e4e-8270-a22e9045c971-openshift-service-ca\") pod \"1a7367df-bc92-4e4e-8270-a22e9045c971\" (UID: \"1a7367df-bc92-4e4e-8270-a22e9045c971\") "
Jul 15 23:57:29.753400 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:29.753316    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdf4h\" (UniqueName: \"kubernetes.io/projected/1a7367df-bc92-4e4e-8270-a22e9045c971-kube-api-access-qdf4h\") pod \"1a7367df-bc92-4e4e-8270-a22e9045c971\" (UID: \"1a7367df-bc92-4e4e-8270-a22e9045c971\") "
Jul 15 23:57:29.753662 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:29.753635    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a7367df-bc92-4e4e-8270-a22e9045c971-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1a7367df-bc92-4e4e-8270-a22e9045c971" (UID: "1a7367df-bc92-4e4e-8270-a22e9045c971"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:57:29.755133 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:29.755107    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a7367df-bc92-4e4e-8270-a22e9045c971-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1a7367df-bc92-4e4e-8270-a22e9045c971" (UID: "1a7367df-bc92-4e4e-8270-a22e9045c971"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:57:29.755276 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:29.755224    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a7367df-bc92-4e4e-8270-a22e9045c971-kube-api-access-qdf4h" (OuterVolumeSpecName: "kube-api-access-qdf4h") pod "1a7367df-bc92-4e4e-8270-a22e9045c971" (UID: "1a7367df-bc92-4e4e-8270-a22e9045c971"). InnerVolumeSpecName "kube-api-access-qdf4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:57:29.853820 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:29.853798    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a7367df-bc92-4e4e-8270-a22e9045c971-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:57:29.853820 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:29.853819    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdf4h\" (UniqueName: \"kubernetes.io/projected/1a7367df-bc92-4e4e-8270-a22e9045c971-kube-api-access-qdf4h\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:57:29.853940 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:29.853829    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a7367df-bc92-4e4e-8270-a22e9045c971-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:57:30.364577 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:30.364541    2576 generic.go:356] "Generic (PLEG): container finished" podID="1a7367df-bc92-4e4e-8270-a22e9045c971" containerID="f6ce0ff8483fa62991eb4b53ce5cb76fae2b133c1a65f9520ef296e88209cea2" exitCode=0
Jul 15 23:57:30.364766 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:30.364603    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt"
Jul 15 23:57:30.364766 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:30.364617    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt" event={"ID":"1a7367df-bc92-4e4e-8270-a22e9045c971","Type":"ContainerDied","Data":"f6ce0ff8483fa62991eb4b53ce5cb76fae2b133c1a65f9520ef296e88209cea2"}
Jul 15 23:57:30.364766 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:30.364680    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt" event={"ID":"1a7367df-bc92-4e4e-8270-a22e9045c971","Type":"ContainerDied","Data":"cce6be8aa3a6bf6f1280959036578fa1d5c652a639956fde158a03bf805184d9"}
Jul 15 23:57:30.364766 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:30.364701    2576 scope.go:117] "RemoveContainer" containerID="f6ce0ff8483fa62991eb4b53ce5cb76fae2b133c1a65f9520ef296e88209cea2"
Jul 15 23:57:30.372853 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:30.372835    2576 scope.go:117] "RemoveContainer" containerID="f6ce0ff8483fa62991eb4b53ce5cb76fae2b133c1a65f9520ef296e88209cea2"
Jul 15 23:57:30.373090 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:57:30.373070    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6ce0ff8483fa62991eb4b53ce5cb76fae2b133c1a65f9520ef296e88209cea2\": container with ID starting with f6ce0ff8483fa62991eb4b53ce5cb76fae2b133c1a65f9520ef296e88209cea2 not found: ID does not exist" containerID="f6ce0ff8483fa62991eb4b53ce5cb76fae2b133c1a65f9520ef296e88209cea2"
Jul 15 23:57:30.373151 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:30.373102    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6ce0ff8483fa62991eb4b53ce5cb76fae2b133c1a65f9520ef296e88209cea2"} err="failed to get container status \"f6ce0ff8483fa62991eb4b53ce5cb76fae2b133c1a65f9520ef296e88209cea2\": rpc error: code = NotFound desc = could not find container \"f6ce0ff8483fa62991eb4b53ce5cb76fae2b133c1a65f9520ef296e88209cea2\": container with ID starting with f6ce0ff8483fa62991eb4b53ce5cb76fae2b133c1a65f9520ef296e88209cea2 not found: ID does not exist"
Jul 15 23:57:30.378907 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:30.378887    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt"]
Jul 15 23:57:30.384639 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:30.384618    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-75c89f12-7c54c4c95c-qszmt"]
Jul 15 23:57:31.970736 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:57:31.970702    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a7367df-bc92-4e4e-8270-a22e9045c971" path="/var/lib/kubelet/pods/1a7367df-bc92-4e4e-8270-a22e9045c971/volumes"
Jul 15 23:59:12.021162 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:12.021131    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth"]
Jul 15 23:59:12.021666 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:12.021496    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a7367df-bc92-4e4e-8270-a22e9045c971" containerName="maas-api"
Jul 15 23:59:12.021666 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:12.021506    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a7367df-bc92-4e4e-8270-a22e9045c971" containerName="maas-api"
Jul 15 23:59:12.021666 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:12.021588    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a7367df-bc92-4e4e-8270-a22e9045c971" containerName="maas-api"
Jul 15 23:59:12.024516 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:12.024499    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth"
Jul 15 23:59:12.027040 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:12.027022    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-f5988523-serving-cert\""
Jul 15 23:59:12.035339 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:12.035317    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth"]
Jul 15 23:59:12.127291 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:12.127267    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67a9c2df-1aec-46fe-aa8c-7d28171177c5-maas-api-tls\") pod \"maas-api-e2e-mt-f5988523-6757654fdd-nvsth\" (UID: \"67a9c2df-1aec-46fe-aa8c-7d28171177c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth"
Jul 15 23:59:12.127411 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:12.127319    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67a9c2df-1aec-46fe-aa8c-7d28171177c5-openshift-service-ca\") pod \"maas-api-e2e-mt-f5988523-6757654fdd-nvsth\" (UID: \"67a9c2df-1aec-46fe-aa8c-7d28171177c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth"
Jul 15 23:59:12.127411 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:12.127348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcjf8\" (UniqueName: \"kubernetes.io/projected/67a9c2df-1aec-46fe-aa8c-7d28171177c5-kube-api-access-wcjf8\") pod \"maas-api-e2e-mt-f5988523-6757654fdd-nvsth\" (UID: \"67a9c2df-1aec-46fe-aa8c-7d28171177c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth"
Jul 15 23:59:12.228516 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:12.228469    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67a9c2df-1aec-46fe-aa8c-7d28171177c5-maas-api-tls\") pod \"maas-api-e2e-mt-f5988523-6757654fdd-nvsth\" (UID: \"67a9c2df-1aec-46fe-aa8c-7d28171177c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth"
Jul 15 23:59:12.228643 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:12.228539    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67a9c2df-1aec-46fe-aa8c-7d28171177c5-openshift-service-ca\") pod \"maas-api-e2e-mt-f5988523-6757654fdd-nvsth\" (UID: \"67a9c2df-1aec-46fe-aa8c-7d28171177c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth"
Jul 15 23:59:12.228643 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:12.228566    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcjf8\" (UniqueName: \"kubernetes.io/projected/67a9c2df-1aec-46fe-aa8c-7d28171177c5-kube-api-access-wcjf8\") pod \"maas-api-e2e-mt-f5988523-6757654fdd-nvsth\" (UID: \"67a9c2df-1aec-46fe-aa8c-7d28171177c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth"
Jul 15 23:59:12.228643 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:59:12.228609    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-serving-cert: secret "maas-api-e2e-mt-f5988523-serving-cert" not found
Jul 15 23:59:12.228811 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:59:12.228674    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67a9c2df-1aec-46fe-aa8c-7d28171177c5-maas-api-tls podName:67a9c2df-1aec-46fe-aa8c-7d28171177c5 nodeName:}" failed. No retries permitted until 2026-07-15 23:59:12.728657892 +0000 UTC m=+1775.272380224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/67a9c2df-1aec-46fe-aa8c-7d28171177c5-maas-api-tls") pod "maas-api-e2e-mt-f5988523-6757654fdd-nvsth" (UID: "67a9c2df-1aec-46fe-aa8c-7d28171177c5") : secret "maas-api-e2e-mt-f5988523-serving-cert" not found
Jul 15 23:59:12.229261 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:12.229219    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67a9c2df-1aec-46fe-aa8c-7d28171177c5-openshift-service-ca\") pod \"maas-api-e2e-mt-f5988523-6757654fdd-nvsth\" (UID: \"67a9c2df-1aec-46fe-aa8c-7d28171177c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth"
Jul 15 23:59:12.245442 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:12.245422    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcjf8\" (UniqueName: \"kubernetes.io/projected/67a9c2df-1aec-46fe-aa8c-7d28171177c5-kube-api-access-wcjf8\") pod \"maas-api-e2e-mt-f5988523-6757654fdd-nvsth\" (UID: \"67a9c2df-1aec-46fe-aa8c-7d28171177c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth"
Jul 15 23:59:12.733596 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:12.733560    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67a9c2df-1aec-46fe-aa8c-7d28171177c5-maas-api-tls\") pod \"maas-api-e2e-mt-f5988523-6757654fdd-nvsth\" (UID: \"67a9c2df-1aec-46fe-aa8c-7d28171177c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth"
Jul 15 23:59:12.735840 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:12.735811    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67a9c2df-1aec-46fe-aa8c-7d28171177c5-maas-api-tls\") pod \"maas-api-e2e-mt-f5988523-6757654fdd-nvsth\" (UID: \"67a9c2df-1aec-46fe-aa8c-7d28171177c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth"
Jul 15 23:59:12.935413 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:12.935386    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth"
Jul 15 23:59:13.068156 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:13.068094    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth"]
Jul 15 23:59:13.070468 ip-10-0-142-22 kubenswrapper[2576]: W0715 23:59:13.070437    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67a9c2df_1aec_46fe_aa8c_7d28171177c5.slice/crio-43f1c59d959c9b653d37816b77048ea148843f1c7e4f0e159c72d6f62c62ae45 WatchSource:0}: Error finding container 43f1c59d959c9b653d37816b77048ea148843f1c7e4f0e159c72d6f62c62ae45: Status 404 returned error can't find the container with id 43f1c59d959c9b653d37816b77048ea148843f1c7e4f0e159c72d6f62c62ae45
Jul 15 23:59:13.843524 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:13.843488    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth" event={"ID":"67a9c2df-1aec-46fe-aa8c-7d28171177c5","Type":"ContainerStarted","Data":"84dc0c4c599f98cccb5469c69f2cf4bb727622a188fd0761cd7f43ef2e5e4eb7"}
Jul 15 23:59:13.843671 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:13.843533    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth" event={"ID":"67a9c2df-1aec-46fe-aa8c-7d28171177c5","Type":"ContainerStarted","Data":"43f1c59d959c9b653d37816b77048ea148843f1c7e4f0e159c72d6f62c62ae45"}
Jul 15 23:59:13.843671 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:13.843619    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth"
Jul 15 23:59:13.877473 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:13.877430    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth" podStartSLOduration=2.48941132 podStartE2EDuration="2.877416303s" totalImagesPullingTime="388.004983ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:59:13.875599687 +0000 UTC m=+1776.419322041" watchObservedRunningTime="2026-07-15 23:59:13.877416303 +0000 UTC m=+1776.421138657"
Jul 15 23:59:19.853636 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:19.853608    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth"
Jul 15 23:59:30.863188 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:30.863115    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth"]
Jul 15 23:59:30.863642 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:30.863344    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth" podUID="67a9c2df-1aec-46fe-aa8c-7d28171177c5" containerName="maas-api" containerID="cri-o://84dc0c4c599f98cccb5469c69f2cf4bb727622a188fd0761cd7f43ef2e5e4eb7" gracePeriod=30
Jul 15 23:59:31.109511 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:31.109489    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth"
Jul 15 23:59:31.275194 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:31.275150    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67a9c2df-1aec-46fe-aa8c-7d28171177c5-openshift-service-ca\") pod \"67a9c2df-1aec-46fe-aa8c-7d28171177c5\" (UID: \"67a9c2df-1aec-46fe-aa8c-7d28171177c5\") "
Jul 15 23:59:31.275389 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:31.275315    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcjf8\" (UniqueName: \"kubernetes.io/projected/67a9c2df-1aec-46fe-aa8c-7d28171177c5-kube-api-access-wcjf8\") pod \"67a9c2df-1aec-46fe-aa8c-7d28171177c5\" (UID: \"67a9c2df-1aec-46fe-aa8c-7d28171177c5\") "
Jul 15 23:59:31.275448 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:31.275416    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67a9c2df-1aec-46fe-aa8c-7d28171177c5-maas-api-tls\") pod \"67a9c2df-1aec-46fe-aa8c-7d28171177c5\" (UID: \"67a9c2df-1aec-46fe-aa8c-7d28171177c5\") "
Jul 15 23:59:31.275615 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:31.275589    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67a9c2df-1aec-46fe-aa8c-7d28171177c5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "67a9c2df-1aec-46fe-aa8c-7d28171177c5" (UID: "67a9c2df-1aec-46fe-aa8c-7d28171177c5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:59:31.275737 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:31.275723    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67a9c2df-1aec-46fe-aa8c-7d28171177c5-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:59:31.277477 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:31.277448    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67a9c2df-1aec-46fe-aa8c-7d28171177c5-kube-api-access-wcjf8" (OuterVolumeSpecName: "kube-api-access-wcjf8") pod "67a9c2df-1aec-46fe-aa8c-7d28171177c5" (UID: "67a9c2df-1aec-46fe-aa8c-7d28171177c5"). InnerVolumeSpecName "kube-api-access-wcjf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:59:31.277477 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:31.277449    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67a9c2df-1aec-46fe-aa8c-7d28171177c5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "67a9c2df-1aec-46fe-aa8c-7d28171177c5" (UID: "67a9c2df-1aec-46fe-aa8c-7d28171177c5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:59:31.376313 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:31.376287    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcjf8\" (UniqueName: \"kubernetes.io/projected/67a9c2df-1aec-46fe-aa8c-7d28171177c5-kube-api-access-wcjf8\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:59:31.376313 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:31.376309    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67a9c2df-1aec-46fe-aa8c-7d28171177c5-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 15 23:59:31.922823 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:31.922789    2576 generic.go:356] "Generic (PLEG): container finished" podID="67a9c2df-1aec-46fe-aa8c-7d28171177c5" containerID="84dc0c4c599f98cccb5469c69f2cf4bb727622a188fd0761cd7f43ef2e5e4eb7" exitCode=0
Jul 15 23:59:31.923257 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:31.922828    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth" event={"ID":"67a9c2df-1aec-46fe-aa8c-7d28171177c5","Type":"ContainerDied","Data":"84dc0c4c599f98cccb5469c69f2cf4bb727622a188fd0761cd7f43ef2e5e4eb7"}
Jul 15 23:59:31.923257 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:31.922854    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth"
Jul 15 23:59:31.923257 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:31.922897    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth" event={"ID":"67a9c2df-1aec-46fe-aa8c-7d28171177c5","Type":"ContainerDied","Data":"43f1c59d959c9b653d37816b77048ea148843f1c7e4f0e159c72d6f62c62ae45"}
Jul 15 23:59:31.923257 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:31.922918    2576 scope.go:117] "RemoveContainer" containerID="84dc0c4c599f98cccb5469c69f2cf4bb727622a188fd0761cd7f43ef2e5e4eb7"
Jul 15 23:59:31.931560 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:31.931541    2576 scope.go:117] "RemoveContainer" containerID="84dc0c4c599f98cccb5469c69f2cf4bb727622a188fd0761cd7f43ef2e5e4eb7"
Jul 15 23:59:31.931813 ip-10-0-142-22 kubenswrapper[2576]: E0715 23:59:31.931789    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84dc0c4c599f98cccb5469c69f2cf4bb727622a188fd0761cd7f43ef2e5e4eb7\": container with ID starting with 84dc0c4c599f98cccb5469c69f2cf4bb727622a188fd0761cd7f43ef2e5e4eb7 not found: ID does not exist" containerID="84dc0c4c599f98cccb5469c69f2cf4bb727622a188fd0761cd7f43ef2e5e4eb7"
Jul 15 23:59:31.931882 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:31.931813    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84dc0c4c599f98cccb5469c69f2cf4bb727622a188fd0761cd7f43ef2e5e4eb7"} err="failed to get container status \"84dc0c4c599f98cccb5469c69f2cf4bb727622a188fd0761cd7f43ef2e5e4eb7\": rpc error: code = NotFound desc = could not find container \"84dc0c4c599f98cccb5469c69f2cf4bb727622a188fd0761cd7f43ef2e5e4eb7\": container with ID starting with 84dc0c4c599f98cccb5469c69f2cf4bb727622a188fd0761cd7f43ef2e5e4eb7 not found: ID does not exist"
Jul 15 23:59:31.944882 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:31.944862    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth"]
Jul 15 23:59:31.948686 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:31.948666    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f5988523-6757654fdd-nvsth"]
Jul 15 23:59:31.970728 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:31.970702    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67a9c2df-1aec-46fe-aa8c-7d28171177c5" path="/var/lib/kubelet/pods/67a9c2df-1aec-46fe-aa8c-7d28171177c5/volumes"
Jul 15 23:59:38.029404 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:38.029379    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2wsc4_2678ca67-7c8a-42d0-a4fc-99b257a177a5/ovn-acl-logging/0.log"
Jul 15 23:59:38.034104 ip-10-0-142-22 kubenswrapper[2576]: I0715 23:59:38.034082    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2wsc4_2678ca67-7c8a-42d0-a4fc-99b257a177a5/ovn-acl-logging/0.log"
Jul 16 00:00:00.138772 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:00.138737    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736000-nzzmn"]
Jul 16 00:00:00.139305 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:00.139250    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67a9c2df-1aec-46fe-aa8c-7d28171177c5" containerName="maas-api"
Jul 16 00:00:00.139305 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:00.139268    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="67a9c2df-1aec-46fe-aa8c-7d28171177c5" containerName="maas-api"
Jul 16 00:00:00.139429 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:00.139390    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="67a9c2df-1aec-46fe-aa8c-7d28171177c5" containerName="maas-api"
Jul 16 00:00:00.142441 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:00.142419    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736000-nzzmn"
Jul 16 00:00:00.145326 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:00.145307    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tp4s7\""
Jul 16 00:00:00.149385 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:00.149363    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736000-nzzmn"]
Jul 16 00:00:00.174514 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:00.174495    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736000-nzzmn"
Jul 16 00:00:00.315799 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:00.315766    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736000-nzzmn"]
Jul 16 00:00:00.319246 ip-10-0-142-22 kubenswrapper[2576]: W0716 00:00:00.319210    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4acfa0e_4617_4d80_8170_1555253742bd.slice/crio-0b89b0fdfdf2a29709d8f8f70e675905d6e88bc90764f18ee9b4cf487404a280 WatchSource:0}: Error finding container 0b89b0fdfdf2a29709d8f8f70e675905d6e88bc90764f18ee9b4cf487404a280: Status 404 returned error can't find the container with id 0b89b0fdfdf2a29709d8f8f70e675905d6e88bc90764f18ee9b4cf487404a280
Jul 16 00:00:01.052023 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:01.051987    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736000-nzzmn" event={"ID":"e4acfa0e-4617-4d80-8170-1555253742bd","Type":"ContainerStarted","Data":"59abe070a5a5d231a0b9e1513c157d9212653f0c30957639fff033400e4c516f"}
Jul 16 00:00:01.052211 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:01.052041    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736000-nzzmn" event={"ID":"e4acfa0e-4617-4d80-8170-1555253742bd","Type":"ContainerStarted","Data":"0b89b0fdfdf2a29709d8f8f70e675905d6e88bc90764f18ee9b4cf487404a280"}
Jul 16 00:00:01.067262 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:01.067008    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736000-nzzmn" podStartSLOduration=1.066991447 podStartE2EDuration="1.066991447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:00:01.066547345 +0000 UTC m=+1823.610269689" watchObservedRunningTime="2026-07-16 00:00:01.066991447 +0000 UTC m=+1823.610713802"
Jul 16 00:00:02.057579 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:02.057544    2576 generic.go:356] "Generic (PLEG): container finished" podID="e4acfa0e-4617-4d80-8170-1555253742bd" containerID="59abe070a5a5d231a0b9e1513c157d9212653f0c30957639fff033400e4c516f" exitCode=0
Jul 16 00:00:02.057996 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:02.057612    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736000-nzzmn" event={"ID":"e4acfa0e-4617-4d80-8170-1555253742bd","Type":"ContainerDied","Data":"59abe070a5a5d231a0b9e1513c157d9212653f0c30957639fff033400e4c516f"}
Jul 16 00:00:03.191061 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:03.191041    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736000-nzzmn"
Jul 16 00:00:04.067021 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:04.066989    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736000-nzzmn" event={"ID":"e4acfa0e-4617-4d80-8170-1555253742bd","Type":"ContainerDied","Data":"0b89b0fdfdf2a29709d8f8f70e675905d6e88bc90764f18ee9b4cf487404a280"}
Jul 16 00:00:04.067021 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:04.067010    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736000-nzzmn"
Jul 16 00:00:04.067187 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:04.067032    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b89b0fdfdf2a29709d8f8f70e675905d6e88bc90764f18ee9b4cf487404a280"
Jul 16 00:00:52.462748 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:52.462718    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2"]
Jul 16 00:00:52.463189 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:52.463094    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4acfa0e-4617-4d80-8170-1555253742bd" containerName="cleanup"
Jul 16 00:00:52.463189 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:52.463106    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4acfa0e-4617-4d80-8170-1555253742bd" containerName="cleanup"
Jul 16 00:00:52.463189 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:52.463173    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4acfa0e-4617-4d80-8170-1555253742bd" containerName="cleanup"
Jul 16 00:00:52.466137 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:52.466120    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2"
Jul 16 00:00:52.468372 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:52.468345    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-9d3c28-serving-cert\""
Jul 16 00:00:52.523086 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:52.523064    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2"]
Jul 16 00:00:52.604345 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:52.604319    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08493492-880b-4588-aa30-9215cc5b2532-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2\" (UID: \"08493492-880b-4588-aa30-9215cc5b2532\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2"
Jul 16 00:00:52.604486 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:52.604361    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08493492-880b-4588-aa30-9215cc5b2532-maas-api-tls\") pod \"maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2\" (UID: \"08493492-880b-4588-aa30-9215cc5b2532\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2"
Jul 16 00:00:52.604486 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:52.604441    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzcwg\" (UniqueName: \"kubernetes.io/projected/08493492-880b-4588-aa30-9215cc5b2532-kube-api-access-qzcwg\") pod \"maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2\" (UID: \"08493492-880b-4588-aa30-9215cc5b2532\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2"
Jul 16 00:00:52.705719 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:52.705695    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08493492-880b-4588-aa30-9215cc5b2532-maas-api-tls\") pod \"maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2\" (UID: \"08493492-880b-4588-aa30-9215cc5b2532\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2"
Jul 16 00:00:52.705849 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:52.705758    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzcwg\" (UniqueName: \"kubernetes.io/projected/08493492-880b-4588-aa30-9215cc5b2532-kube-api-access-qzcwg\") pod \"maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2\" (UID: \"08493492-880b-4588-aa30-9215cc5b2532\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2"
Jul 16 00:00:52.705849 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:52.705791    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08493492-880b-4588-aa30-9215cc5b2532-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2\" (UID: \"08493492-880b-4588-aa30-9215cc5b2532\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2"
Jul 16 00:00:52.706368 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:52.706346    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08493492-880b-4588-aa30-9215cc5b2532-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2\" (UID: \"08493492-880b-4588-aa30-9215cc5b2532\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2"
Jul 16 00:00:52.707933 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:52.707914    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08493492-880b-4588-aa30-9215cc5b2532-maas-api-tls\") pod \"maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2\" (UID: \"08493492-880b-4588-aa30-9215cc5b2532\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2"
Jul 16 00:00:52.717398 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:52.717342    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzcwg\" (UniqueName: \"kubernetes.io/projected/08493492-880b-4588-aa30-9215cc5b2532-kube-api-access-qzcwg\") pod \"maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2\" (UID: \"08493492-880b-4588-aa30-9215cc5b2532\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2"
Jul 16 00:00:52.777020 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:52.776992    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2"
Jul 16 00:00:52.909897 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:52.909870    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2"]
Jul 16 00:00:52.911897 ip-10-0-142-22 kubenswrapper[2576]: W0716 00:00:52.911874    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08493492_880b_4588_aa30_9215cc5b2532.slice/crio-d522887295d85d136737f4e323c7106cb9f1debb92dbb40c6445eeceeccfbb3f WatchSource:0}: Error finding container d522887295d85d136737f4e323c7106cb9f1debb92dbb40c6445eeceeccfbb3f: Status 404 returned error can't find the container with id d522887295d85d136737f4e323c7106cb9f1debb92dbb40c6445eeceeccfbb3f
Jul 16 00:00:53.298134 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:53.298096    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2" event={"ID":"08493492-880b-4588-aa30-9215cc5b2532","Type":"ContainerStarted","Data":"d522887295d85d136737f4e323c7106cb9f1debb92dbb40c6445eeceeccfbb3f"}
Jul 16 00:00:56.313500 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:56.313468    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2" event={"ID":"08493492-880b-4588-aa30-9215cc5b2532","Type":"ContainerStarted","Data":"ecdd3df5bf4639c5af05d0bac36e9a65e0109ffdc1c1d55767ce0b3e0044e23d"}
Jul 16 00:00:56.313881 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:56.313600    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2"
Jul 16 00:00:56.329311 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:00:56.329255    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2" podStartSLOduration=1.8402657119999999 podStartE2EDuration="4.329224845s" totalImagesPullingTime="2.488959133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:00:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:00:56.327443112 +0000 UTC m=+1878.871165471" watchObservedRunningTime="2026-07-16 00:00:56.329224845 +0000 UTC m=+1878.872947243"
Jul 16 00:01:00.385802 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:00.385728    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8"]
Jul 16 00:01:00.389562 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:00.389542    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8"
Jul 16 00:01:00.391282 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:00.391259    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-2a1132-serving-cert\""
Jul 16 00:01:00.399686 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:00.399666    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8"]
Jul 16 00:01:00.566577 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:00.566543    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e844837a-7d24-4458-b0ed-09d44adba4e8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8\" (UID: \"e844837a-7d24-4458-b0ed-09d44adba4e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8"
Jul 16 00:01:00.566715 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:00.566642    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg9qh\" (UniqueName: \"kubernetes.io/projected/e844837a-7d24-4458-b0ed-09d44adba4e8-kube-api-access-jg9qh\") pod \"maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8\" (UID: \"e844837a-7d24-4458-b0ed-09d44adba4e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8"
Jul 16 00:01:00.566715 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:00.566660    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e844837a-7d24-4458-b0ed-09d44adba4e8-maas-api-tls\") pod \"maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8\" (UID: \"e844837a-7d24-4458-b0ed-09d44adba4e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8"
Jul 16 00:01:00.667180 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:00.667124    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg9qh\" (UniqueName: \"kubernetes.io/projected/e844837a-7d24-4458-b0ed-09d44adba4e8-kube-api-access-jg9qh\") pod \"maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8\" (UID: \"e844837a-7d24-4458-b0ed-09d44adba4e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8"
Jul 16 00:01:00.667180 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:00.667152    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e844837a-7d24-4458-b0ed-09d44adba4e8-maas-api-tls\") pod \"maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8\" (UID: \"e844837a-7d24-4458-b0ed-09d44adba4e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8"
Jul 16 00:01:00.667180 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:00.667175    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e844837a-7d24-4458-b0ed-09d44adba4e8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8\" (UID: \"e844837a-7d24-4458-b0ed-09d44adba4e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8"
Jul 16 00:01:00.667420 ip-10-0-142-22 kubenswrapper[2576]: E0716 00:01:00.667300    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-serving-cert: secret "maas-api-e2e-inf-b-2a1132-serving-cert" not found
Jul 16 00:01:00.667420 ip-10-0-142-22 kubenswrapper[2576]: E0716 00:01:00.667356    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e844837a-7d24-4458-b0ed-09d44adba4e8-maas-api-tls podName:e844837a-7d24-4458-b0ed-09d44adba4e8 nodeName:}" failed. No retries permitted until 2026-07-16 00:01:01.167342526 +0000 UTC m=+1883.711064862 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e844837a-7d24-4458-b0ed-09d44adba4e8-maas-api-tls") pod "maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8" (UID: "e844837a-7d24-4458-b0ed-09d44adba4e8") : secret "maas-api-e2e-inf-b-2a1132-serving-cert" not found
Jul 16 00:01:00.667774 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:00.667756    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e844837a-7d24-4458-b0ed-09d44adba4e8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8\" (UID: \"e844837a-7d24-4458-b0ed-09d44adba4e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8"
Jul 16 00:01:00.676951 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:00.676922    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg9qh\" (UniqueName: \"kubernetes.io/projected/e844837a-7d24-4458-b0ed-09d44adba4e8-kube-api-access-jg9qh\") pod \"maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8\" (UID: \"e844837a-7d24-4458-b0ed-09d44adba4e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8"
Jul 16 00:01:01.170693 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:01.170656    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e844837a-7d24-4458-b0ed-09d44adba4e8-maas-api-tls\") pod \"maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8\" (UID: \"e844837a-7d24-4458-b0ed-09d44adba4e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8"
Jul 16 00:01:01.173002 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:01.172979    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e844837a-7d24-4458-b0ed-09d44adba4e8-maas-api-tls\") pod \"maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8\" (UID: \"e844837a-7d24-4458-b0ed-09d44adba4e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8"
Jul 16 00:01:01.299694 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:01.299669    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8"
Jul 16 00:01:01.434644 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:01.433797    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8"]
Jul 16 00:01:01.440053 ip-10-0-142-22 kubenswrapper[2576]: W0716 00:01:01.439987    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode844837a_7d24_4458_b0ed_09d44adba4e8.slice/crio-7fccf114c3f2e669a8fe3d966c4cbe1c584aa74aa955c6e67252cddc3b60b320 WatchSource:0}: Error finding container 7fccf114c3f2e669a8fe3d966c4cbe1c584aa74aa955c6e67252cddc3b60b320: Status 404 returned error can't find the container with id 7fccf114c3f2e669a8fe3d966c4cbe1c584aa74aa955c6e67252cddc3b60b320
Jul 16 00:01:02.323982 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:02.323956    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2"
Jul 16 00:01:02.341731 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:02.341709    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8" event={"ID":"e844837a-7d24-4458-b0ed-09d44adba4e8","Type":"ContainerStarted","Data":"7fccf114c3f2e669a8fe3d966c4cbe1c584aa74aa955c6e67252cddc3b60b320"}
Jul 16 00:01:03.348920 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:03.348882    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8" event={"ID":"e844837a-7d24-4458-b0ed-09d44adba4e8","Type":"ContainerStarted","Data":"eb76d791d548e36e44b4b586f5107f96f05bc0d8c1a38a27115f7cb2545204d0"}
Jul 16 00:01:03.349579 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:03.349079    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8"
Jul 16 00:01:03.364148 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:03.364093    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8" podStartSLOduration=2.506702119 podStartE2EDuration="3.364073795s" totalImagesPullingTime="857.371676ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:01:03.363083425 +0000 UTC m=+1885.906805778" watchObservedRunningTime="2026-07-16 00:01:03.364073795 +0000 UTC m=+1885.907796150"
Jul 16 00:01:09.359164 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:09.359136    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8"
Jul 16 00:01:30.516539 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.516503    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"]
Jul 16 00:01:30.520718 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.520696    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:30.523017 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.522995    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2a1132\"/\"default-dockercfg-7nxh5\""
Jul 16 00:01:30.523017 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.523009    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2a1132\"/\"openshift-service-ca.crt\""
Jul 16 00:01:30.523178 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.523032    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2a1132\"/\"test-model-2a1132-kserve-self-signed-certs\""
Jul 16 00:01:30.523178 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.523063    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2a1132\"/\"kube-root-ca.crt\""
Jul 16 00:01:30.528641 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.528623    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"]
Jul 16 00:01:30.584748 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.584727    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47h2p\" (UniqueName: \"kubernetes.io/projected/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-kube-api-access-47h2p\") pod \"test-model-2a1132-kserve-76586c9957-z4v9x\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") " pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:30.584849 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.584774    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-home\") pod \"test-model-2a1132-kserve-76586c9957-z4v9x\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") " pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:30.584849 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.584788    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-dshm\") pod \"test-model-2a1132-kserve-76586c9957-z4v9x\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") " pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:30.584923 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.584855    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-model-cache\") pod \"test-model-2a1132-kserve-76586c9957-z4v9x\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") " pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:30.584923 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.584906    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-tls-certs\") pod \"test-model-2a1132-kserve-76586c9957-z4v9x\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") " pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:30.584998 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.584930    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-tmp-dir\") pod \"test-model-2a1132-kserve-76586c9957-z4v9x\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") " pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:30.685550 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.685526    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-home\") pod \"test-model-2a1132-kserve-76586c9957-z4v9x\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") " pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:30.685667 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.685552    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-dshm\") pod \"test-model-2a1132-kserve-76586c9957-z4v9x\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") " pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:30.685667 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.685575    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-model-cache\") pod \"test-model-2a1132-kserve-76586c9957-z4v9x\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") " pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:30.685667 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.685606    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-tls-certs\") pod \"test-model-2a1132-kserve-76586c9957-z4v9x\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") " pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:30.685667 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.685637    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-tmp-dir\") pod \"test-model-2a1132-kserve-76586c9957-z4v9x\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") " pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:30.685853 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.685751    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47h2p\" (UniqueName: \"kubernetes.io/projected/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-kube-api-access-47h2p\") pod \"test-model-2a1132-kserve-76586c9957-z4v9x\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") " pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:30.685950 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.685929    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-home\") pod \"test-model-2a1132-kserve-76586c9957-z4v9x\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") " pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:30.686012 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.685977    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-tmp-dir\") pod \"test-model-2a1132-kserve-76586c9957-z4v9x\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") " pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:30.686072 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.686035    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-model-cache\") pod \"test-model-2a1132-kserve-76586c9957-z4v9x\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") " pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:30.687874 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.687852    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-dshm\") pod \"test-model-2a1132-kserve-76586c9957-z4v9x\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") " pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:30.688174 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.688154    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-tls-certs\") pod \"test-model-2a1132-kserve-76586c9957-z4v9x\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") " pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:30.693451 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.693428    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47h2p\" (UniqueName: \"kubernetes.io/projected/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-kube-api-access-47h2p\") pod \"test-model-2a1132-kserve-76586c9957-z4v9x\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") " pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:30.829822 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.829752    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:30.959417 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:30.959393    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"]
Jul 16 00:01:30.961562 ip-10-0-142-22 kubenswrapper[2576]: W0716 00:01:30.961534    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b97e9b8_f1c1_44fc_97fc_055a8c2af163.slice/crio-2ce4d96a66af7a1bd5bf0620476d521b66ef76c3c5dd0f17838058a534520cd1 WatchSource:0}: Error finding container 2ce4d96a66af7a1bd5bf0620476d521b66ef76c3c5dd0f17838058a534520cd1: Status 404 returned error can't find the container with id 2ce4d96a66af7a1bd5bf0620476d521b66ef76c3c5dd0f17838058a534520cd1
Jul 16 00:01:31.480122 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:31.480091    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x" event={"ID":"8b97e9b8-f1c1-44fc-97fc-055a8c2af163","Type":"ContainerStarted","Data":"861686f9d95d07436f3098b0a42c668dfad2659d3dba6a6e2c6d400d75a524ea"}
Jul 16 00:01:31.480378 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:31.480132    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x" event={"ID":"8b97e9b8-f1c1-44fc-97fc-055a8c2af163","Type":"ContainerStarted","Data":"2ce4d96a66af7a1bd5bf0620476d521b66ef76c3c5dd0f17838058a534520cd1"}
Jul 16 00:01:31.497111 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:31.497068    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x" podStartSLOduration=1.497053049 podStartE2EDuration="1.497053049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:01:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:01:31.49485186 +0000 UTC m=+1914.038574216" watchObservedRunningTime="2026-07-16 00:01:31.497053049 +0000 UTC m=+1914.040775415"
Jul 16 00:01:40.829891 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:40.829854    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:40.830315 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:40.829915    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:40.842677 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:40.842652    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:41.540034 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:41.540006    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:01:49.823309 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:01:49.823279    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"]
Jul 16 00:02:04.844699 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:04.844632    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x" podUID="8b97e9b8-f1c1-44fc-97fc-055a8c2af163" containerName="main" containerID="cri-o://861686f9d95d07436f3098b0a42c668dfad2659d3dba6a6e2c6d400d75a524ea" gracePeriod=45
Jul 16 00:02:05.080729 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.080705    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:02:05.157515 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.157460    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-dshm\") pod \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") "
Jul 16 00:02:05.157515 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.157497    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-tmp-dir\") pod \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") "
Jul 16 00:02:05.157688 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.157553    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-home\") pod \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") "
Jul 16 00:02:05.157688 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.157573    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-model-cache\") pod \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") "
Jul 16 00:02:05.157688 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.157611    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47h2p\" (UniqueName: \"kubernetes.io/projected/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-kube-api-access-47h2p\") pod \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") "
Jul 16 00:02:05.157688 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.157637    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-tls-certs\") pod \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\" (UID: \"8b97e9b8-f1c1-44fc-97fc-055a8c2af163\") "
Jul 16 00:02:05.157941 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.157824    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8b97e9b8-f1c1-44fc-97fc-055a8c2af163" (UID: "8b97e9b8-f1c1-44fc-97fc-055a8c2af163"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:02:05.157941 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.157840    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-model-cache" (OuterVolumeSpecName: "model-cache") pod "8b97e9b8-f1c1-44fc-97fc-055a8c2af163" (UID: "8b97e9b8-f1c1-44fc-97fc-055a8c2af163"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:02:05.157941 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.157848    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-home" (OuterVolumeSpecName: "home") pod "8b97e9b8-f1c1-44fc-97fc-055a8c2af163" (UID: "8b97e9b8-f1c1-44fc-97fc-055a8c2af163"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:02:05.157941 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.157918    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-tmp-dir\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:02:05.157941 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.157930    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-home\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:02:05.157941 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.157938    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-model-cache\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:02:05.159603 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.159584    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-dshm" (OuterVolumeSpecName: "dshm") pod "8b97e9b8-f1c1-44fc-97fc-055a8c2af163" (UID: "8b97e9b8-f1c1-44fc-97fc-055a8c2af163"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:02:05.159798 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.159775    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-kube-api-access-47h2p" (OuterVolumeSpecName: "kube-api-access-47h2p") pod "8b97e9b8-f1c1-44fc-97fc-055a8c2af163" (UID: "8b97e9b8-f1c1-44fc-97fc-055a8c2af163"). InnerVolumeSpecName "kube-api-access-47h2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:02:05.159798 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.159786    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8b97e9b8-f1c1-44fc-97fc-055a8c2af163" (UID: "8b97e9b8-f1c1-44fc-97fc-055a8c2af163"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:02:05.259283 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.259249    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-dshm\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:02:05.259283 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.259281    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47h2p\" (UniqueName: \"kubernetes.io/projected/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-kube-api-access-47h2p\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:02:05.259283 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.259291    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b97e9b8-f1c1-44fc-97fc-055a8c2af163-tls-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:02:05.640261 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.640216    2576 generic.go:356] "Generic (PLEG): container finished" podID="8b97e9b8-f1c1-44fc-97fc-055a8c2af163" containerID="861686f9d95d07436f3098b0a42c668dfad2659d3dba6a6e2c6d400d75a524ea" exitCode=0
Jul 16 00:02:05.640407 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.640276    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"
Jul 16 00:02:05.640407 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.640302    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x" event={"ID":"8b97e9b8-f1c1-44fc-97fc-055a8c2af163","Type":"ContainerDied","Data":"861686f9d95d07436f3098b0a42c668dfad2659d3dba6a6e2c6d400d75a524ea"}
Jul 16 00:02:05.640407 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.640348    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x" event={"ID":"8b97e9b8-f1c1-44fc-97fc-055a8c2af163","Type":"ContainerDied","Data":"2ce4d96a66af7a1bd5bf0620476d521b66ef76c3c5dd0f17838058a534520cd1"}
Jul 16 00:02:05.640407 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.640369    2576 scope.go:117] "RemoveContainer" containerID="861686f9d95d07436f3098b0a42c668dfad2659d3dba6a6e2c6d400d75a524ea"
Jul 16 00:02:05.649079 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.649059    2576 scope.go:117] "RemoveContainer" containerID="861686f9d95d07436f3098b0a42c668dfad2659d3dba6a6e2c6d400d75a524ea"
Jul 16 00:02:05.649326 ip-10-0-142-22 kubenswrapper[2576]: E0716 00:02:05.649308    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"861686f9d95d07436f3098b0a42c668dfad2659d3dba6a6e2c6d400d75a524ea\": container with ID starting with 861686f9d95d07436f3098b0a42c668dfad2659d3dba6a6e2c6d400d75a524ea not found: ID does not exist" containerID="861686f9d95d07436f3098b0a42c668dfad2659d3dba6a6e2c6d400d75a524ea"
Jul 16 00:02:05.649389 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.649334    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"861686f9d95d07436f3098b0a42c668dfad2659d3dba6a6e2c6d400d75a524ea"} err="failed to get container status \"861686f9d95d07436f3098b0a42c668dfad2659d3dba6a6e2c6d400d75a524ea\": rpc error: code = NotFound desc = could not find container \"861686f9d95d07436f3098b0a42c668dfad2659d3dba6a6e2c6d400d75a524ea\": container with ID starting with 861686f9d95d07436f3098b0a42c668dfad2659d3dba6a6e2c6d400d75a524ea not found: ID does not exist"
Jul 16 00:02:05.662500 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.662480    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"]
Jul 16 00:02:05.664620 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.664601    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-2a1132/test-model-2a1132-kserve-76586c9957-z4v9x"]
Jul 16 00:02:05.973310 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:05.971630    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b97e9b8-f1c1-44fc-97fc-055a8c2af163" path="/var/lib/kubelet/pods/8b97e9b8-f1c1-44fc-97fc-055a8c2af163/volumes"
Jul 16 00:02:31.984418 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:31.984388    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2"]
Jul 16 00:02:31.984931 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:31.984670    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2" podUID="08493492-880b-4588-aa30-9215cc5b2532" containerName="maas-api" containerID="cri-o://ecdd3df5bf4639c5af05d0bac36e9a65e0109ffdc1c1d55767ce0b3e0044e23d" gracePeriod=30
Jul 16 00:02:32.228792 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:32.228765    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2"
Jul 16 00:02:32.258027 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:32.258000    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzcwg\" (UniqueName: \"kubernetes.io/projected/08493492-880b-4588-aa30-9215cc5b2532-kube-api-access-qzcwg\") pod \"08493492-880b-4588-aa30-9215cc5b2532\" (UID: \"08493492-880b-4588-aa30-9215cc5b2532\") "
Jul 16 00:02:32.258147 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:32.258088    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08493492-880b-4588-aa30-9215cc5b2532-maas-api-tls\") pod \"08493492-880b-4588-aa30-9215cc5b2532\" (UID: \"08493492-880b-4588-aa30-9215cc5b2532\") "
Jul 16 00:02:32.258147 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:32.258135    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08493492-880b-4588-aa30-9215cc5b2532-openshift-service-ca\") pod \"08493492-880b-4588-aa30-9215cc5b2532\" (UID: \"08493492-880b-4588-aa30-9215cc5b2532\") "
Jul 16 00:02:32.258521 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:32.258494    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08493492-880b-4588-aa30-9215cc5b2532-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "08493492-880b-4588-aa30-9215cc5b2532" (UID: "08493492-880b-4588-aa30-9215cc5b2532"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:02:32.260011 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:32.259986    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08493492-880b-4588-aa30-9215cc5b2532-kube-api-access-qzcwg" (OuterVolumeSpecName: "kube-api-access-qzcwg") pod "08493492-880b-4588-aa30-9215cc5b2532" (UID: "08493492-880b-4588-aa30-9215cc5b2532"). InnerVolumeSpecName "kube-api-access-qzcwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:02:32.260101 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:32.260080    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08493492-880b-4588-aa30-9215cc5b2532-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "08493492-880b-4588-aa30-9215cc5b2532" (UID: "08493492-880b-4588-aa30-9215cc5b2532"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:02:32.359223 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:32.359196    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzcwg\" (UniqueName: \"kubernetes.io/projected/08493492-880b-4588-aa30-9215cc5b2532-kube-api-access-qzcwg\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:02:32.359223 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:32.359220    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08493492-880b-4588-aa30-9215cc5b2532-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:02:32.359359 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:32.359247    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08493492-880b-4588-aa30-9215cc5b2532-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:02:32.772529 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:32.772498    2576 generic.go:356] "Generic (PLEG): container finished" podID="08493492-880b-4588-aa30-9215cc5b2532" containerID="ecdd3df5bf4639c5af05d0bac36e9a65e0109ffdc1c1d55767ce0b3e0044e23d" exitCode=0
Jul 16 00:02:32.772693 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:32.772547    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2"
Jul 16 00:02:32.772693 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:32.772542    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2" event={"ID":"08493492-880b-4588-aa30-9215cc5b2532","Type":"ContainerDied","Data":"ecdd3df5bf4639c5af05d0bac36e9a65e0109ffdc1c1d55767ce0b3e0044e23d"}
Jul 16 00:02:32.772693 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:32.772667    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2" event={"ID":"08493492-880b-4588-aa30-9215cc5b2532","Type":"ContainerDied","Data":"d522887295d85d136737f4e323c7106cb9f1debb92dbb40c6445eeceeccfbb3f"}
Jul 16 00:02:32.772693 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:32.772694    2576 scope.go:117] "RemoveContainer" containerID="ecdd3df5bf4639c5af05d0bac36e9a65e0109ffdc1c1d55767ce0b3e0044e23d"
Jul 16 00:02:32.781218 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:32.781203    2576 scope.go:117] "RemoveContainer" containerID="ecdd3df5bf4639c5af05d0bac36e9a65e0109ffdc1c1d55767ce0b3e0044e23d"
Jul 16 00:02:32.781488 ip-10-0-142-22 kubenswrapper[2576]: E0716 00:02:32.781470    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecdd3df5bf4639c5af05d0bac36e9a65e0109ffdc1c1d55767ce0b3e0044e23d\": container with ID starting with ecdd3df5bf4639c5af05d0bac36e9a65e0109ffdc1c1d55767ce0b3e0044e23d not found: ID does not exist" containerID="ecdd3df5bf4639c5af05d0bac36e9a65e0109ffdc1c1d55767ce0b3e0044e23d"
Jul 16 00:02:32.781542 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:32.781494    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecdd3df5bf4639c5af05d0bac36e9a65e0109ffdc1c1d55767ce0b3e0044e23d"} err="failed to get container status \"ecdd3df5bf4639c5af05d0bac36e9a65e0109ffdc1c1d55767ce0b3e0044e23d\": rpc error: code = NotFound desc = could not find container \"ecdd3df5bf4639c5af05d0bac36e9a65e0109ffdc1c1d55767ce0b3e0044e23d\": container with ID starting with ecdd3df5bf4639c5af05d0bac36e9a65e0109ffdc1c1d55767ce0b3e0044e23d not found: ID does not exist"
Jul 16 00:02:32.792556 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:32.792537    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2"]
Jul 16 00:02:32.795893 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:32.795875    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9d3c28-5767884669-dt4w2"]
Jul 16 00:02:33.969781 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:33.969748    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08493492-880b-4588-aa30-9215cc5b2532" path="/var/lib/kubelet/pods/08493492-880b-4588-aa30-9215cc5b2532/volumes"
Jul 16 00:02:43.887302 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:43.887267    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8"]
Jul 16 00:02:43.887670 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:43.887520    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8" podUID="e844837a-7d24-4458-b0ed-09d44adba4e8" containerName="maas-api" containerID="cri-o://eb76d791d548e36e44b4b586f5107f96f05bc0d8c1a38a27115f7cb2545204d0" gracePeriod=30
Jul 16 00:02:44.347921 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:44.347890    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8"
Jul 16 00:02:44.449288 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:44.449207    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e844837a-7d24-4458-b0ed-09d44adba4e8-maas-api-tls\") pod \"e844837a-7d24-4458-b0ed-09d44adba4e8\" (UID: \"e844837a-7d24-4458-b0ed-09d44adba4e8\") "
Jul 16 00:02:44.449423 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:44.449281    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg9qh\" (UniqueName: \"kubernetes.io/projected/e844837a-7d24-4458-b0ed-09d44adba4e8-kube-api-access-jg9qh\") pod \"e844837a-7d24-4458-b0ed-09d44adba4e8\" (UID: \"e844837a-7d24-4458-b0ed-09d44adba4e8\") "
Jul 16 00:02:44.449423 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:44.449334    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e844837a-7d24-4458-b0ed-09d44adba4e8-openshift-service-ca\") pod \"e844837a-7d24-4458-b0ed-09d44adba4e8\" (UID: \"e844837a-7d24-4458-b0ed-09d44adba4e8\") "
Jul 16 00:02:44.449787 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:44.449760    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e844837a-7d24-4458-b0ed-09d44adba4e8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e844837a-7d24-4458-b0ed-09d44adba4e8" (UID: "e844837a-7d24-4458-b0ed-09d44adba4e8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:02:44.451355 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:44.451331    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e844837a-7d24-4458-b0ed-09d44adba4e8-kube-api-access-jg9qh" (OuterVolumeSpecName: "kube-api-access-jg9qh") pod "e844837a-7d24-4458-b0ed-09d44adba4e8" (UID: "e844837a-7d24-4458-b0ed-09d44adba4e8"). InnerVolumeSpecName "kube-api-access-jg9qh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:02:44.451700 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:44.451679    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e844837a-7d24-4458-b0ed-09d44adba4e8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e844837a-7d24-4458-b0ed-09d44adba4e8" (UID: "e844837a-7d24-4458-b0ed-09d44adba4e8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:02:44.550834 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:44.550800    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e844837a-7d24-4458-b0ed-09d44adba4e8-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:02:44.550834 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:44.550833    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg9qh\" (UniqueName: \"kubernetes.io/projected/e844837a-7d24-4458-b0ed-09d44adba4e8-kube-api-access-jg9qh\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:02:44.550958 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:44.550847    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e844837a-7d24-4458-b0ed-09d44adba4e8-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:02:44.830731 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:44.830704    2576 generic.go:356] "Generic (PLEG): container finished" podID="e844837a-7d24-4458-b0ed-09d44adba4e8" containerID="eb76d791d548e36e44b4b586f5107f96f05bc0d8c1a38a27115f7cb2545204d0" exitCode=0
Jul 16 00:02:44.830842 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:44.830748    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8"
Jul 16 00:02:44.830842 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:44.830782    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8" event={"ID":"e844837a-7d24-4458-b0ed-09d44adba4e8","Type":"ContainerDied","Data":"eb76d791d548e36e44b4b586f5107f96f05bc0d8c1a38a27115f7cb2545204d0"}
Jul 16 00:02:44.830955 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:44.830851    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8" event={"ID":"e844837a-7d24-4458-b0ed-09d44adba4e8","Type":"ContainerDied","Data":"7fccf114c3f2e669a8fe3d966c4cbe1c584aa74aa955c6e67252cddc3b60b320"}
Jul 16 00:02:44.830955 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:44.830875    2576 scope.go:117] "RemoveContainer" containerID="eb76d791d548e36e44b4b586f5107f96f05bc0d8c1a38a27115f7cb2545204d0"
Jul 16 00:02:44.841094 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:44.841078    2576 scope.go:117] "RemoveContainer" containerID="eb76d791d548e36e44b4b586f5107f96f05bc0d8c1a38a27115f7cb2545204d0"
Jul 16 00:02:44.841402 ip-10-0-142-22 kubenswrapper[2576]: E0716 00:02:44.841383    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb76d791d548e36e44b4b586f5107f96f05bc0d8c1a38a27115f7cb2545204d0\": container with ID starting with eb76d791d548e36e44b4b586f5107f96f05bc0d8c1a38a27115f7cb2545204d0 not found: ID does not exist" containerID="eb76d791d548e36e44b4b586f5107f96f05bc0d8c1a38a27115f7cb2545204d0"
Jul 16 00:02:44.841467 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:44.841410    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb76d791d548e36e44b4b586f5107f96f05bc0d8c1a38a27115f7cb2545204d0"} err="failed to get container status \"eb76d791d548e36e44b4b586f5107f96f05bc0d8c1a38a27115f7cb2545204d0\": rpc error: code = NotFound desc = could not find container \"eb76d791d548e36e44b4b586f5107f96f05bc0d8c1a38a27115f7cb2545204d0\": container with ID starting with eb76d791d548e36e44b4b586f5107f96f05bc0d8c1a38a27115f7cb2545204d0 not found: ID does not exist"
Jul 16 00:02:44.851272 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:44.851252    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8"]
Jul 16 00:02:44.855393 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:44.855368    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2a1132-748c8c7c-hckt8"]
Jul 16 00:02:45.970974 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:45.970943    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e844837a-7d24-4458-b0ed-09d44adba4e8" path="/var/lib/kubelet/pods/e844837a-7d24-4458-b0ed-09d44adba4e8/volumes"
Jul 16 00:02:54.145372 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:54.145340    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn"]
Jul 16 00:02:54.145906 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:54.145873    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e844837a-7d24-4458-b0ed-09d44adba4e8" containerName="maas-api"
Jul 16 00:02:54.145906 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:54.145893    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e844837a-7d24-4458-b0ed-09d44adba4e8" containerName="maas-api"
Jul 16 00:02:54.146022 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:54.145914    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b97e9b8-f1c1-44fc-97fc-055a8c2af163" containerName="main"
Jul 16 00:02:54.146022 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:54.145922    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b97e9b8-f1c1-44fc-97fc-055a8c2af163" containerName="main"
Jul 16 00:02:54.146022 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:54.145935    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08493492-880b-4588-aa30-9215cc5b2532" containerName="maas-api"
Jul 16 00:02:54.146022 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:54.145944    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="08493492-880b-4588-aa30-9215cc5b2532" containerName="maas-api"
Jul 16 00:02:54.146209 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:54.146041    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="08493492-880b-4588-aa30-9215cc5b2532" containerName="maas-api"
Jul 16 00:02:54.146209 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:54.146054    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b97e9b8-f1c1-44fc-97fc-055a8c2af163" containerName="main"
Jul 16 00:02:54.146209 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:54.146066    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e844837a-7d24-4458-b0ed-09d44adba4e8" containerName="maas-api"
Jul 16 00:02:54.150644 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:54.150619    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn"
Jul 16 00:02:54.163786 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:54.163767    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-3cb745-serving-cert\""
Jul 16 00:02:54.176102 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:54.176079    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn"]
Jul 16 00:02:54.229610 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:54.229586    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/100e2584-3d30-4b44-965e-b5f2f63e542e-openshift-service-ca\") pod \"maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn\" (UID: \"100e2584-3d30-4b44-965e-b5f2f63e542e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn"
Jul 16 00:02:54.229720 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:54.229622    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cktsp\" (UniqueName: \"kubernetes.io/projected/100e2584-3d30-4b44-965e-b5f2f63e542e-kube-api-access-cktsp\") pod \"maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn\" (UID: \"100e2584-3d30-4b44-965e-b5f2f63e542e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn"
Jul 16 00:02:54.229766 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:54.229722    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/100e2584-3d30-4b44-965e-b5f2f63e542e-maas-api-tls\") pod \"maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn\" (UID: \"100e2584-3d30-4b44-965e-b5f2f63e542e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn"
Jul 16 00:02:54.330470 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:54.330445    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/100e2584-3d30-4b44-965e-b5f2f63e542e-maas-api-tls\") pod \"maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn\" (UID: \"100e2584-3d30-4b44-965e-b5f2f63e542e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn"
Jul 16 00:02:54.330559 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:54.330484    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/100e2584-3d30-4b44-965e-b5f2f63e542e-openshift-service-ca\") pod \"maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn\" (UID: \"100e2584-3d30-4b44-965e-b5f2f63e542e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn"
Jul 16 00:02:54.330616 ip-10-0-142-22 kubenswrapper[2576]: E0716 00:02:54.330602    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-serving-cert: secret "maas-api-e2e-api-a-3cb745-serving-cert" not found
Jul 16 00:02:54.330674 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:54.330617    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cktsp\" (UniqueName: \"kubernetes.io/projected/100e2584-3d30-4b44-965e-b5f2f63e542e-kube-api-access-cktsp\") pod \"maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn\" (UID: \"100e2584-3d30-4b44-965e-b5f2f63e542e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn"
Jul 16 00:02:54.330716 ip-10-0-142-22 kubenswrapper[2576]: E0716 00:02:54.330692    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/100e2584-3d30-4b44-965e-b5f2f63e542e-maas-api-tls podName:100e2584-3d30-4b44-965e-b5f2f63e542e nodeName:}" failed. No retries permitted until 2026-07-16 00:02:54.830668617 +0000 UTC m=+1997.374390963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/100e2584-3d30-4b44-965e-b5f2f63e542e-maas-api-tls") pod "maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn" (UID: "100e2584-3d30-4b44-965e-b5f2f63e542e") : secret "maas-api-e2e-api-a-3cb745-serving-cert" not found
Jul 16 00:02:54.331106 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:54.331087    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/100e2584-3d30-4b44-965e-b5f2f63e542e-openshift-service-ca\") pod \"maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn\" (UID: \"100e2584-3d30-4b44-965e-b5f2f63e542e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn"
Jul 16 00:02:54.346832 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:54.346804    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cktsp\" (UniqueName: \"kubernetes.io/projected/100e2584-3d30-4b44-965e-b5f2f63e542e-kube-api-access-cktsp\") pod \"maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn\" (UID: \"100e2584-3d30-4b44-965e-b5f2f63e542e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn"
Jul 16 00:02:54.835353 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:54.835322    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/100e2584-3d30-4b44-965e-b5f2f63e542e-maas-api-tls\") pod \"maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn\" (UID: \"100e2584-3d30-4b44-965e-b5f2f63e542e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn"
Jul 16 00:02:54.837845 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:54.837814    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/100e2584-3d30-4b44-965e-b5f2f63e542e-maas-api-tls\") pod \"maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn\" (UID: \"100e2584-3d30-4b44-965e-b5f2f63e542e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn"
Jul 16 00:02:55.062569 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:55.062539    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn"
Jul 16 00:02:55.220516 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:55.220488    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn"]
Jul 16 00:02:55.223859 ip-10-0-142-22 kubenswrapper[2576]: W0716 00:02:55.223834    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod100e2584_3d30_4b44_965e_b5f2f63e542e.slice/crio-bc6689401847bac40b284d5bc548d0532f1c5a005a2fd5c90ed34ccf53003e12 WatchSource:0}: Error finding container bc6689401847bac40b284d5bc548d0532f1c5a005a2fd5c90ed34ccf53003e12: Status 404 returned error can't find the container with id bc6689401847bac40b284d5bc548d0532f1c5a005a2fd5c90ed34ccf53003e12
Jul 16 00:02:55.225088 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:55.225070    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 00:02:55.884034 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:55.884008    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn" event={"ID":"100e2584-3d30-4b44-965e-b5f2f63e542e","Type":"ContainerStarted","Data":"bc6689401847bac40b284d5bc548d0532f1c5a005a2fd5c90ed34ccf53003e12"}
Jul 16 00:02:56.889842 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:56.889810    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn" event={"ID":"100e2584-3d30-4b44-965e-b5f2f63e542e","Type":"ContainerStarted","Data":"464681676b13b764d4217ea78f761a6df02567caec4b56e42f818e8515c38aba"}
Jul 16 00:02:56.890214 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:56.889873    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn"
Jul 16 00:02:56.906304 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:02:56.906259    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn" podStartSLOduration=2.277974149 podStartE2EDuration="2.906224373s" totalImagesPullingTime="628.250224ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:02:56.904536792 +0000 UTC m=+1999.448259147" watchObservedRunningTime="2026-07-16 00:02:56.906224373 +0000 UTC m=+1999.449946730"
Jul 16 00:03:02.100590 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:02.100559    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw"]
Jul 16 00:03:02.104097 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:02.104073    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw"
Jul 16 00:03:02.106348 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:02.106330    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-cb6fd1-serving-cert\""
Jul 16 00:03:02.130376 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:02.130357    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw"]
Jul 16 00:03:02.196210 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:02.196181    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47w7k\" (UniqueName: \"kubernetes.io/projected/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-kube-api-access-47w7k\") pod \"maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw\" (UID: \"94b07e3a-42bd-43ca-81d2-ff9d27b55a8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw"
Jul 16 00:03:02.196346 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:02.196220    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-maas-api-tls\") pod \"maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw\" (UID: \"94b07e3a-42bd-43ca-81d2-ff9d27b55a8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw"
Jul 16 00:03:02.196346 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:02.196336    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-openshift-service-ca\") pod \"maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw\" (UID: \"94b07e3a-42bd-43ca-81d2-ff9d27b55a8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw"
Jul 16 00:03:02.297510 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:02.297481    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-openshift-service-ca\") pod \"maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw\" (UID: \"94b07e3a-42bd-43ca-81d2-ff9d27b55a8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw"
Jul 16 00:03:02.297638 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:02.297530    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47w7k\" (UniqueName: \"kubernetes.io/projected/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-kube-api-access-47w7k\") pod \"maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw\" (UID: \"94b07e3a-42bd-43ca-81d2-ff9d27b55a8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw"
Jul 16 00:03:02.297638 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:02.297568    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-maas-api-tls\") pod \"maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw\" (UID: \"94b07e3a-42bd-43ca-81d2-ff9d27b55a8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw"
Jul 16 00:03:02.297712 ip-10-0-142-22 kubenswrapper[2576]: E0716 00:03:02.297647    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-serving-cert: secret "maas-api-e2e-api-b-cb6fd1-serving-cert" not found
Jul 16 00:03:02.297712 ip-10-0-142-22 kubenswrapper[2576]: E0716 00:03:02.297698    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-maas-api-tls podName:94b07e3a-42bd-43ca-81d2-ff9d27b55a8c nodeName:}" failed. No retries permitted until 2026-07-16 00:03:02.797681717 +0000 UTC m=+2005.341404048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-maas-api-tls") pod "maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw" (UID: "94b07e3a-42bd-43ca-81d2-ff9d27b55a8c") : secret "maas-api-e2e-api-b-cb6fd1-serving-cert" not found
Jul 16 00:03:02.298146 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:02.298129    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-openshift-service-ca\") pod \"maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw\" (UID: \"94b07e3a-42bd-43ca-81d2-ff9d27b55a8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw"
Jul 16 00:03:02.314975 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:02.314954    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47w7k\" (UniqueName: \"kubernetes.io/projected/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-kube-api-access-47w7k\") pod \"maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw\" (UID: \"94b07e3a-42bd-43ca-81d2-ff9d27b55a8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw"
Jul 16 00:03:02.802567 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:02.802536    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-maas-api-tls\") pod \"maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw\" (UID: \"94b07e3a-42bd-43ca-81d2-ff9d27b55a8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw"
Jul 16 00:03:02.802716 ip-10-0-142-22 kubenswrapper[2576]: E0716 00:03:02.802683    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-serving-cert: secret "maas-api-e2e-api-b-cb6fd1-serving-cert" not found
Jul 16 00:03:02.802757 ip-10-0-142-22 kubenswrapper[2576]: E0716 00:03:02.802744    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-maas-api-tls podName:94b07e3a-42bd-43ca-81d2-ff9d27b55a8c nodeName:}" failed. No retries permitted until 2026-07-16 00:03:03.802725532 +0000 UTC m=+2006.346447879 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-maas-api-tls") pod "maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw" (UID: "94b07e3a-42bd-43ca-81d2-ff9d27b55a8c") : secret "maas-api-e2e-api-b-cb6fd1-serving-cert" not found
Jul 16 00:03:02.900831 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:02.900807    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn"
Jul 16 00:03:03.810252 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:03.810197    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-maas-api-tls\") pod \"maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw\" (UID: \"94b07e3a-42bd-43ca-81d2-ff9d27b55a8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw"
Jul 16 00:03:03.812673 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:03.812647    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-maas-api-tls\") pod \"maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw\" (UID: \"94b07e3a-42bd-43ca-81d2-ff9d27b55a8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw"
Jul 16 00:03:03.914795 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:03.914759    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw"
Jul 16 00:03:04.049034 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:04.049003    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw"]
Jul 16 00:03:04.050306 ip-10-0-142-22 kubenswrapper[2576]: W0716 00:03:04.050279    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94b07e3a_42bd_43ca_81d2_ff9d27b55a8c.slice/crio-c184c4589d95b7d70ef058384ac73e18aad03cdd088c149d671010b0c8c08b53 WatchSource:0}: Error finding container c184c4589d95b7d70ef058384ac73e18aad03cdd088c149d671010b0c8c08b53: Status 404 returned error can't find the container with id c184c4589d95b7d70ef058384ac73e18aad03cdd088c149d671010b0c8c08b53
Jul 16 00:03:04.927366 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:04.927327    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw" event={"ID":"94b07e3a-42bd-43ca-81d2-ff9d27b55a8c","Type":"ContainerStarted","Data":"c184c4589d95b7d70ef058384ac73e18aad03cdd088c149d671010b0c8c08b53"}
Jul 16 00:03:06.941193 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:06.941157    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw" event={"ID":"94b07e3a-42bd-43ca-81d2-ff9d27b55a8c","Type":"ContainerStarted","Data":"4585aa6c6f38eef49eaeab0ea4347af84605449bdd3ac3ed8b5f8432057274cf"}
Jul 16 00:03:06.941595 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:06.941249    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw"
Jul 16 00:03:06.963136 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:06.963065    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw" podStartSLOduration=3.045724098 podStartE2EDuration="4.96305122s" totalImagesPullingTime="1.917327122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:03:06.961856525 +0000 UTC m=+2009.505578950" watchObservedRunningTime="2026-07-16 00:03:06.96305122 +0000 UTC m=+2009.506773620"
Jul 16 00:03:12.950653 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:12.950624    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw"
Jul 16 00:03:21.334552 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:21.334518    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn"]
Jul 16 00:03:21.335023 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:21.334792    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn" podUID="100e2584-3d30-4b44-965e-b5f2f63e542e" containerName="maas-api" containerID="cri-o://464681676b13b764d4217ea78f761a6df02567caec4b56e42f818e8515c38aba" gracePeriod=30
Jul 16 00:03:21.583151 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:21.583129    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn"
Jul 16 00:03:21.752196 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:21.752170    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/100e2584-3d30-4b44-965e-b5f2f63e542e-openshift-service-ca\") pod \"100e2584-3d30-4b44-965e-b5f2f63e542e\" (UID: \"100e2584-3d30-4b44-965e-b5f2f63e542e\") "
Jul 16 00:03:21.752403 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:21.752220    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cktsp\" (UniqueName: \"kubernetes.io/projected/100e2584-3d30-4b44-965e-b5f2f63e542e-kube-api-access-cktsp\") pod \"100e2584-3d30-4b44-965e-b5f2f63e542e\" (UID: \"100e2584-3d30-4b44-965e-b5f2f63e542e\") "
Jul 16 00:03:21.752403 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:21.752317    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/100e2584-3d30-4b44-965e-b5f2f63e542e-maas-api-tls\") pod \"100e2584-3d30-4b44-965e-b5f2f63e542e\" (UID: \"100e2584-3d30-4b44-965e-b5f2f63e542e\") "
Jul 16 00:03:21.752607 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:21.752578    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/100e2584-3d30-4b44-965e-b5f2f63e542e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "100e2584-3d30-4b44-965e-b5f2f63e542e" (UID: "100e2584-3d30-4b44-965e-b5f2f63e542e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:03:21.754355 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:21.754329    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/100e2584-3d30-4b44-965e-b5f2f63e542e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "100e2584-3d30-4b44-965e-b5f2f63e542e" (UID: "100e2584-3d30-4b44-965e-b5f2f63e542e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:03:21.754436 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:21.754414    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/100e2584-3d30-4b44-965e-b5f2f63e542e-kube-api-access-cktsp" (OuterVolumeSpecName: "kube-api-access-cktsp") pod "100e2584-3d30-4b44-965e-b5f2f63e542e" (UID: "100e2584-3d30-4b44-965e-b5f2f63e542e"). InnerVolumeSpecName "kube-api-access-cktsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:03:21.853602 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:21.853571    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/100e2584-3d30-4b44-965e-b5f2f63e542e-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:03:21.853681 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:21.853595    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/100e2584-3d30-4b44-965e-b5f2f63e542e-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:03:21.853681 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:21.853619    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cktsp\" (UniqueName: \"kubernetes.io/projected/100e2584-3d30-4b44-965e-b5f2f63e542e-kube-api-access-cktsp\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:03:22.013779 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:22.013703    2576 generic.go:356] "Generic (PLEG): container finished" podID="100e2584-3d30-4b44-965e-b5f2f63e542e" containerID="464681676b13b764d4217ea78f761a6df02567caec4b56e42f818e8515c38aba" exitCode=0
Jul 16 00:03:22.013779 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:22.013731    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn"
Jul 16 00:03:22.013942 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:22.013774    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn" event={"ID":"100e2584-3d30-4b44-965e-b5f2f63e542e","Type":"ContainerDied","Data":"464681676b13b764d4217ea78f761a6df02567caec4b56e42f818e8515c38aba"}
Jul 16 00:03:22.013942 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:22.013820    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn" event={"ID":"100e2584-3d30-4b44-965e-b5f2f63e542e","Type":"ContainerDied","Data":"bc6689401847bac40b284d5bc548d0532f1c5a005a2fd5c90ed34ccf53003e12"}
Jul 16 00:03:22.013942 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:22.013846    2576 scope.go:117] "RemoveContainer" containerID="464681676b13b764d4217ea78f761a6df02567caec4b56e42f818e8515c38aba"
Jul 16 00:03:22.023650 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:22.023631    2576 scope.go:117] "RemoveContainer" containerID="464681676b13b764d4217ea78f761a6df02567caec4b56e42f818e8515c38aba"
Jul 16 00:03:22.023933 ip-10-0-142-22 kubenswrapper[2576]: E0716 00:03:22.023910    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"464681676b13b764d4217ea78f761a6df02567caec4b56e42f818e8515c38aba\": container with ID starting with 464681676b13b764d4217ea78f761a6df02567caec4b56e42f818e8515c38aba not found: ID does not exist" containerID="464681676b13b764d4217ea78f761a6df02567caec4b56e42f818e8515c38aba"
Jul 16 00:03:22.024015 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:22.023941    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"464681676b13b764d4217ea78f761a6df02567caec4b56e42f818e8515c38aba"} err="failed to get container status \"464681676b13b764d4217ea78f761a6df02567caec4b56e42f818e8515c38aba\": rpc error: code = NotFound desc = could not find container \"464681676b13b764d4217ea78f761a6df02567caec4b56e42f818e8515c38aba\": container with ID starting with 464681676b13b764d4217ea78f761a6df02567caec4b56e42f818e8515c38aba not found: ID does not exist"
Jul 16 00:03:22.028304 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:22.028288    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn"]
Jul 16 00:03:22.030493 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:22.030470    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3cb745-74cc65c4dc-5xmkn"]
Jul 16 00:03:23.970516 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:23.970485    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="100e2584-3d30-4b44-965e-b5f2f63e542e" path="/var/lib/kubelet/pods/100e2584-3d30-4b44-965e-b5f2f63e542e/volumes"
Jul 16 00:03:33.601025 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:33.600995    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw"]
Jul 16 00:03:33.601582 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:33.601301    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw" podUID="94b07e3a-42bd-43ca-81d2-ff9d27b55a8c" containerName="maas-api" containerID="cri-o://4585aa6c6f38eef49eaeab0ea4347af84605449bdd3ac3ed8b5f8432057274cf" gracePeriod=30
Jul 16 00:03:33.845855 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:33.845830    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw"
Jul 16 00:03:33.849004 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:33.848987    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-maas-api-tls\") pod \"94b07e3a-42bd-43ca-81d2-ff9d27b55a8c\" (UID: \"94b07e3a-42bd-43ca-81d2-ff9d27b55a8c\") "
Jul 16 00:03:33.849079 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:33.849034    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47w7k\" (UniqueName: \"kubernetes.io/projected/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-kube-api-access-47w7k\") pod \"94b07e3a-42bd-43ca-81d2-ff9d27b55a8c\" (UID: \"94b07e3a-42bd-43ca-81d2-ff9d27b55a8c\") "
Jul 16 00:03:33.849079 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:33.849069    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-openshift-service-ca\") pod \"94b07e3a-42bd-43ca-81d2-ff9d27b55a8c\" (UID: \"94b07e3a-42bd-43ca-81d2-ff9d27b55a8c\") "
Jul 16 00:03:33.849485 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:33.849463    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "94b07e3a-42bd-43ca-81d2-ff9d27b55a8c" (UID: "94b07e3a-42bd-43ca-81d2-ff9d27b55a8c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:03:33.850918 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:33.850896    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "94b07e3a-42bd-43ca-81d2-ff9d27b55a8c" (UID: "94b07e3a-42bd-43ca-81d2-ff9d27b55a8c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:03:33.850997 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:33.850988    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-kube-api-access-47w7k" (OuterVolumeSpecName: "kube-api-access-47w7k") pod "94b07e3a-42bd-43ca-81d2-ff9d27b55a8c" (UID: "94b07e3a-42bd-43ca-81d2-ff9d27b55a8c"). InnerVolumeSpecName "kube-api-access-47w7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:03:33.950032 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:33.950008    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:03:33.950032 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:33.950031    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47w7k\" (UniqueName: \"kubernetes.io/projected/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-kube-api-access-47w7k\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:03:33.950189 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:33.950040    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:03:34.070301 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:34.070267    2576 generic.go:356] "Generic (PLEG): container finished" podID="94b07e3a-42bd-43ca-81d2-ff9d27b55a8c" containerID="4585aa6c6f38eef49eaeab0ea4347af84605449bdd3ac3ed8b5f8432057274cf" exitCode=0
Jul 16 00:03:34.070301 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:34.070297    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw"
Jul 16 00:03:34.070498 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:34.070349    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw" event={"ID":"94b07e3a-42bd-43ca-81d2-ff9d27b55a8c","Type":"ContainerDied","Data":"4585aa6c6f38eef49eaeab0ea4347af84605449bdd3ac3ed8b5f8432057274cf"}
Jul 16 00:03:34.070498 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:34.070404    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw" event={"ID":"94b07e3a-42bd-43ca-81d2-ff9d27b55a8c","Type":"ContainerDied","Data":"c184c4589d95b7d70ef058384ac73e18aad03cdd088c149d671010b0c8c08b53"}
Jul 16 00:03:34.070498 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:34.070433    2576 scope.go:117] "RemoveContainer" containerID="4585aa6c6f38eef49eaeab0ea4347af84605449bdd3ac3ed8b5f8432057274cf"
Jul 16 00:03:34.078972 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:34.078949    2576 scope.go:117] "RemoveContainer" containerID="4585aa6c6f38eef49eaeab0ea4347af84605449bdd3ac3ed8b5f8432057274cf"
Jul 16 00:03:34.079209 ip-10-0-142-22 kubenswrapper[2576]: E0716 00:03:34.079190    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4585aa6c6f38eef49eaeab0ea4347af84605449bdd3ac3ed8b5f8432057274cf\": container with ID starting with 4585aa6c6f38eef49eaeab0ea4347af84605449bdd3ac3ed8b5f8432057274cf not found: ID does not exist" containerID="4585aa6c6f38eef49eaeab0ea4347af84605449bdd3ac3ed8b5f8432057274cf"
Jul 16 00:03:34.079301 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:34.079217    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4585aa6c6f38eef49eaeab0ea4347af84605449bdd3ac3ed8b5f8432057274cf"} err="failed to get container status \"4585aa6c6f38eef49eaeab0ea4347af84605449bdd3ac3ed8b5f8432057274cf\": rpc error: code = NotFound desc = could not find container \"4585aa6c6f38eef49eaeab0ea4347af84605449bdd3ac3ed8b5f8432057274cf\": container with ID starting with 4585aa6c6f38eef49eaeab0ea4347af84605449bdd3ac3ed8b5f8432057274cf not found: ID does not exist"
Jul 16 00:03:34.083950 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:34.083929    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw"]
Jul 16 00:03:34.091278 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:34.091256    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cb6fd1-79c79cc7b4-jcxkw"]
Jul 16 00:03:35.970951 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:35.970914    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94b07e3a-42bd-43ca-81d2-ff9d27b55a8c" path="/var/lib/kubelet/pods/94b07e3a-42bd-43ca-81d2-ff9d27b55a8c/volumes"
Jul 16 00:03:43.329063 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:43.329035    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv"]
Jul 16 00:03:43.329459 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:43.329425    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94b07e3a-42bd-43ca-81d2-ff9d27b55a8c" containerName="maas-api"
Jul 16 00:03:43.329459 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:43.329437    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="94b07e3a-42bd-43ca-81d2-ff9d27b55a8c" containerName="maas-api"
Jul 16 00:03:43.329459 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:43.329450    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="100e2584-3d30-4b44-965e-b5f2f63e542e" containerName="maas-api"
Jul 16 00:03:43.329459 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:43.329458    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="100e2584-3d30-4b44-965e-b5f2f63e542e" containerName="maas-api"
Jul 16 00:03:43.329586 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:43.329532    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="100e2584-3d30-4b44-965e-b5f2f63e542e" containerName="maas-api"
Jul 16 00:03:43.329586 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:43.329542    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="94b07e3a-42bd-43ca-81d2-ff9d27b55a8c" containerName="maas-api"
Jul 16 00:03:43.332502 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:43.332480    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv"
Jul 16 00:03:43.334590 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:43.334568    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-079998-serving-cert\""
Jul 16 00:03:43.343662 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:43.343641    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv"]
Jul 16 00:03:43.419436 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:43.419411    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/016ac7b6-4e7d-41b2-9779-2b53c92de242-openshift-service-ca\") pod \"maas-api-e2e-shared-a-079998-95575546d-4wtfv\" (UID: \"016ac7b6-4e7d-41b2-9779-2b53c92de242\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv"
Jul 16 00:03:43.419550 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:43.419451    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/016ac7b6-4e7d-41b2-9779-2b53c92de242-maas-api-tls\") pod \"maas-api-e2e-shared-a-079998-95575546d-4wtfv\" (UID: \"016ac7b6-4e7d-41b2-9779-2b53c92de242\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv"
Jul 16 00:03:43.419550 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:43.419467    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fjd7\" (UniqueName: \"kubernetes.io/projected/016ac7b6-4e7d-41b2-9779-2b53c92de242-kube-api-access-6fjd7\") pod \"maas-api-e2e-shared-a-079998-95575546d-4wtfv\" (UID: \"016ac7b6-4e7d-41b2-9779-2b53c92de242\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv"
Jul 16 00:03:43.520457 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:43.520433    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/016ac7b6-4e7d-41b2-9779-2b53c92de242-openshift-service-ca\") pod \"maas-api-e2e-shared-a-079998-95575546d-4wtfv\" (UID: \"016ac7b6-4e7d-41b2-9779-2b53c92de242\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv"
Jul 16 00:03:43.520580 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:43.520471    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/016ac7b6-4e7d-41b2-9779-2b53c92de242-maas-api-tls\") pod \"maas-api-e2e-shared-a-079998-95575546d-4wtfv\" (UID: \"016ac7b6-4e7d-41b2-9779-2b53c92de242\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv"
Jul 16 00:03:43.520580 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:43.520494    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fjd7\" (UniqueName: \"kubernetes.io/projected/016ac7b6-4e7d-41b2-9779-2b53c92de242-kube-api-access-6fjd7\") pod \"maas-api-e2e-shared-a-079998-95575546d-4wtfv\" (UID: \"016ac7b6-4e7d-41b2-9779-2b53c92de242\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv"
Jul 16 00:03:43.521103 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:43.521086    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/016ac7b6-4e7d-41b2-9779-2b53c92de242-openshift-service-ca\") pod \"maas-api-e2e-shared-a-079998-95575546d-4wtfv\" (UID: \"016ac7b6-4e7d-41b2-9779-2b53c92de242\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv"
Jul 16 00:03:43.522847 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:43.522830    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/016ac7b6-4e7d-41b2-9779-2b53c92de242-maas-api-tls\") pod \"maas-api-e2e-shared-a-079998-95575546d-4wtfv\" (UID: \"016ac7b6-4e7d-41b2-9779-2b53c92de242\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv"
Jul 16 00:03:43.532000 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:43.531976    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fjd7\" (UniqueName: \"kubernetes.io/projected/016ac7b6-4e7d-41b2-9779-2b53c92de242-kube-api-access-6fjd7\") pod \"maas-api-e2e-shared-a-079998-95575546d-4wtfv\" (UID: \"016ac7b6-4e7d-41b2-9779-2b53c92de242\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv"
Jul 16 00:03:43.642821 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:43.642765    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv"
Jul 16 00:03:43.773095 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:43.773066    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv"]
Jul 16 00:03:43.776629 ip-10-0-142-22 kubenswrapper[2576]: W0716 00:03:43.776599    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod016ac7b6_4e7d_41b2_9779_2b53c92de242.slice/crio-d8593a8c7b147821d3d32f3486fb195c5b849477a63ca4fa12998616a9a0bd31 WatchSource:0}: Error finding container d8593a8c7b147821d3d32f3486fb195c5b849477a63ca4fa12998616a9a0bd31: Status 404 returned error can't find the container with id d8593a8c7b147821d3d32f3486fb195c5b849477a63ca4fa12998616a9a0bd31
Jul 16 00:03:44.119414 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:44.119379    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv" event={"ID":"016ac7b6-4e7d-41b2-9779-2b53c92de242","Type":"ContainerStarted","Data":"d8593a8c7b147821d3d32f3486fb195c5b849477a63ca4fa12998616a9a0bd31"}
Jul 16 00:03:46.130120 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:46.130079    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv" event={"ID":"016ac7b6-4e7d-41b2-9779-2b53c92de242","Type":"ContainerStarted","Data":"902e29e758489476b619dfe3ee911ef621e4fa2326ba1f62792102878f759cb1"}
Jul 16 00:03:46.130569 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:46.130139    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv"
Jul 16 00:03:46.145540 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:46.145492    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv" podStartSLOduration=1.7246585570000001 podStartE2EDuration="3.145475939s" totalImagesPullingTime="1.420817382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:03:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:03:46.144658185 +0000 UTC m=+2048.688380540" watchObservedRunningTime="2026-07-16 00:03:46.145475939 +0000 UTC m=+2048.689198293"
Jul 16 00:03:51.552374 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:51.552337    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt"]
Jul 16 00:03:51.556101 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:51.556083    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt"
Jul 16 00:03:51.558383 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:51.558363    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-91d115-serving-cert\""
Jul 16 00:03:51.567829 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:51.567808    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt"]
Jul 16 00:03:51.585816 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:51.585795    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt\" (UID: \"7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt"
Jul 16 00:03:51.585930 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:51.585829    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b-maas-api-tls\") pod \"maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt\" (UID: \"7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt"
Jul 16 00:03:51.585930 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:51.585876    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5lbs\" (UniqueName: \"kubernetes.io/projected/7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b-kube-api-access-n5lbs\") pod \"maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt\" (UID: \"7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt"
Jul 16 00:03:51.686726 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:51.686700    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b-maas-api-tls\") pod \"maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt\" (UID: \"7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt"
Jul 16 00:03:51.686874 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:51.686757    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5lbs\" (UniqueName: \"kubernetes.io/projected/7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b-kube-api-access-n5lbs\") pod \"maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt\" (UID: \"7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt"
Jul 16 00:03:51.686874 ip-10-0-142-22 kubenswrapper[2576]: E0716 00:03:51.686858    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-serving-cert: secret "maas-api-e2e-shared-b-91d115-serving-cert" not found
Jul 16 00:03:51.686994 ip-10-0-142-22 kubenswrapper[2576]: E0716 00:03:51.686922    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b-maas-api-tls podName:7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b nodeName:}" failed. No retries permitted until 2026-07-16 00:03:52.186900481 +0000 UTC m=+2054.730622815 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b-maas-api-tls") pod "maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt" (UID: "7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b") : secret "maas-api-e2e-shared-b-91d115-serving-cert" not found
Jul 16 00:03:51.686994 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:51.686945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt\" (UID: \"7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt"
Jul 16 00:03:51.687726 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:51.687703    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt\" (UID: \"7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt"
Jul 16 00:03:51.700488 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:51.700462    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5lbs\" (UniqueName: \"kubernetes.io/projected/7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b-kube-api-access-n5lbs\") pod \"maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt\" (UID: \"7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt"
Jul 16 00:03:52.141904 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:52.141873    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv"
Jul 16 00:03:52.191768 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:52.191737    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b-maas-api-tls\") pod \"maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt\" (UID: \"7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt"
Jul 16 00:03:52.194033 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:52.194001    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b-maas-api-tls\") pod \"maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt\" (UID: \"7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt"
Jul 16 00:03:52.469045 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:52.468967    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt"
Jul 16 00:03:52.607154 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:52.607132    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt"]
Jul 16 00:03:52.609355 ip-10-0-142-22 kubenswrapper[2576]: W0716 00:03:52.609328    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e6a43b7_6787_4898_91fd_5aa2ef9f8d3b.slice/crio-97ddd2d7b9a06a4e201cfc79c64e51c60586d2e140be3b7630efff385ab6e337 WatchSource:0}: Error finding container 97ddd2d7b9a06a4e201cfc79c64e51c60586d2e140be3b7630efff385ab6e337: Status 404 returned error can't find the container with id 97ddd2d7b9a06a4e201cfc79c64e51c60586d2e140be3b7630efff385ab6e337
Jul 16 00:03:53.173108 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:53.173074    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt" event={"ID":"7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b","Type":"ContainerStarted","Data":"97ddd2d7b9a06a4e201cfc79c64e51c60586d2e140be3b7630efff385ab6e337"}
Jul 16 00:03:54.179214 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:54.179174    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt" event={"ID":"7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b","Type":"ContainerStarted","Data":"96a151cad9bbcc57bc8f974a13081de5c580bda65e30f6490c22eb3232144094"}
Jul 16 00:03:54.179606 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:54.179271    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt"
Jul 16 00:03:54.199078 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:03:54.199035    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt" podStartSLOduration=2.542010863 podStartE2EDuration="3.199019586s" totalImagesPullingTime="657.008723ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:03:54.197296972 +0000 UTC m=+2056.741019326" watchObservedRunningTime="2026-07-16 00:03:54.199019586 +0000 UTC m=+2056.742741939"
Jul 16 00:04:00.188866 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:00.188785    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt"
Jul 16 00:04:38.058094 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:38.058042    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2wsc4_2678ca67-7c8a-42d0-a4fc-99b257a177a5/ovn-acl-logging/0.log"
Jul 16 00:04:38.064651 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:38.064634    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2wsc4_2678ca67-7c8a-42d0-a4fc-99b257a177a5/ovn-acl-logging/0.log"
Jul 16 00:04:38.928440 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:38.928410    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"]
Jul 16 00:04:38.934196 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:38.934169    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:04:38.937206 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:38.937180    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-91d115\"/\"default-dockercfg-jsbnd\""
Jul 16 00:04:38.937431 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:38.937184    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-91d115\"/\"auth-test-model-91d115-kserve-self-signed-certs\""
Jul 16 00:04:38.937595 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:38.937218    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-91d115\"/\"openshift-service-ca.crt\""
Jul 16 00:04:38.937729 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:38.937292    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-91d115\"/\"kube-root-ca.crt\""
Jul 16 00:04:38.940254 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:38.940217    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"]
Jul 16 00:04:39.051532 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:39.051502    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-model-cache\") pod \"auth-test-model-91d115-kserve-569b8645bc-m69gj\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") " pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:04:39.051681 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:39.051577    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-tmp-dir\") pod \"auth-test-model-91d115-kserve-569b8645bc-m69gj\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") " pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:04:39.051681 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:39.051601    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/068b89f3-4b20-46b7-947b-1774b29660d0-tls-certs\") pod \"auth-test-model-91d115-kserve-569b8645bc-m69gj\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") " pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:04:39.051681 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:39.051634    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smwxt\" (UniqueName: \"kubernetes.io/projected/068b89f3-4b20-46b7-947b-1774b29660d0-kube-api-access-smwxt\") pod \"auth-test-model-91d115-kserve-569b8645bc-m69gj\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") " pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:04:39.051783 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:39.051696    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-home\") pod \"auth-test-model-91d115-kserve-569b8645bc-m69gj\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") " pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:04:39.051783 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:39.051721    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-dshm\") pod \"auth-test-model-91d115-kserve-569b8645bc-m69gj\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") " pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:04:39.152145 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:39.152114    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-tmp-dir\") pod \"auth-test-model-91d115-kserve-569b8645bc-m69gj\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") " pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:04:39.152581 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:39.152156    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/068b89f3-4b20-46b7-947b-1774b29660d0-tls-certs\") pod \"auth-test-model-91d115-kserve-569b8645bc-m69gj\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") " pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:04:39.152581 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:39.152196    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smwxt\" (UniqueName: \"kubernetes.io/projected/068b89f3-4b20-46b7-947b-1774b29660d0-kube-api-access-smwxt\") pod \"auth-test-model-91d115-kserve-569b8645bc-m69gj\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") " pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:04:39.152581 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:39.152220    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-home\") pod \"auth-test-model-91d115-kserve-569b8645bc-m69gj\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") " pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:04:39.152581 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:39.152362    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-dshm\") pod \"auth-test-model-91d115-kserve-569b8645bc-m69gj\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") " pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:04:39.152581 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:39.152456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-model-cache\") pod \"auth-test-model-91d115-kserve-569b8645bc-m69gj\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") " pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:04:39.152581 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:39.152547    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-tmp-dir\") pod \"auth-test-model-91d115-kserve-569b8645bc-m69gj\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") " pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:04:39.152581 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:39.152579    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-home\") pod \"auth-test-model-91d115-kserve-569b8645bc-m69gj\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") " pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:04:39.153207 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:39.152746    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-model-cache\") pod \"auth-test-model-91d115-kserve-569b8645bc-m69gj\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") " pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:04:39.154448 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:39.154426    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-dshm\") pod \"auth-test-model-91d115-kserve-569b8645bc-m69gj\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") " pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:04:39.154647 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:39.154631    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/068b89f3-4b20-46b7-947b-1774b29660d0-tls-certs\") pod \"auth-test-model-91d115-kserve-569b8645bc-m69gj\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") " pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:04:39.159202 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:39.159181    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smwxt\" (UniqueName: \"kubernetes.io/projected/068b89f3-4b20-46b7-947b-1774b29660d0-kube-api-access-smwxt\") pod \"auth-test-model-91d115-kserve-569b8645bc-m69gj\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") " pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:04:39.245873 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:39.245847    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:04:39.372606 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:39.372582    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"]
Jul 16 00:04:39.374880 ip-10-0-142-22 kubenswrapper[2576]: W0716 00:04:39.374856    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod068b89f3_4b20_46b7_947b_1774b29660d0.slice/crio-dee3def124599e4f3d0c16befeec0edef4a727f428f3196c0eb588adf35d2f75 WatchSource:0}: Error finding container dee3def124599e4f3d0c16befeec0edef4a727f428f3196c0eb588adf35d2f75: Status 404 returned error can't find the container with id dee3def124599e4f3d0c16befeec0edef4a727f428f3196c0eb588adf35d2f75
Jul 16 00:04:39.383413 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:39.383389    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj" event={"ID":"068b89f3-4b20-46b7-947b-1774b29660d0","Type":"ContainerStarted","Data":"dee3def124599e4f3d0c16befeec0edef4a727f428f3196c0eb588adf35d2f75"}
Jul 16 00:04:40.389211 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:40.389174    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj" event={"ID":"068b89f3-4b20-46b7-947b-1774b29660d0","Type":"ContainerStarted","Data":"af6150d6606fb9784fdc30d894abcaaf6068a92743de126ed570eafe02196264"}
Jul 16 00:04:40.405631 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:40.405579    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj" podStartSLOduration=2.405560332 podStartE2EDuration="2.405560332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:04:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:04:40.404336321 +0000 UTC m=+2102.948058674" watchObservedRunningTime="2026-07-16 00:04:40.405560332 +0000 UTC m=+2102.949282687"
Jul 16 00:04:49.246479 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:49.246440    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:04:49.246892 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:49.246586    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:04:49.259014 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:49.258996    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:04:49.443379 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:04:49.443356    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:06:44.028677 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:06:44.028645    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"]
Jul 16 00:06:59.049112 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:06:59.049063    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj" podUID="068b89f3-4b20-46b7-947b-1774b29660d0" containerName="main" containerID="cri-o://af6150d6606fb9784fdc30d894abcaaf6068a92743de126ed570eafe02196264" gracePeriod=45
Jul 16 00:06:59.300008 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:06:59.299950    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:06:59.457160 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:06:59.457132    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-dshm\") pod \"068b89f3-4b20-46b7-947b-1774b29660d0\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") "
Jul 16 00:06:59.457336 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:06:59.457165    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-model-cache\") pod \"068b89f3-4b20-46b7-947b-1774b29660d0\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") "
Jul 16 00:06:59.457336 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:06:59.457190    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smwxt\" (UniqueName: \"kubernetes.io/projected/068b89f3-4b20-46b7-947b-1774b29660d0-kube-api-access-smwxt\") pod \"068b89f3-4b20-46b7-947b-1774b29660d0\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") "
Jul 16 00:06:59.457336 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:06:59.457226    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/068b89f3-4b20-46b7-947b-1774b29660d0-tls-certs\") pod \"068b89f3-4b20-46b7-947b-1774b29660d0\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") "
Jul 16 00:06:59.457336 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:06:59.457280    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-tmp-dir\") pod \"068b89f3-4b20-46b7-947b-1774b29660d0\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") "
Jul 16 00:06:59.457336 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:06:59.457315    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-home\") pod \"068b89f3-4b20-46b7-947b-1774b29660d0\" (UID: \"068b89f3-4b20-46b7-947b-1774b29660d0\") "
Jul 16 00:06:59.457618 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:06:59.457470    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-model-cache" (OuterVolumeSpecName: "model-cache") pod "068b89f3-4b20-46b7-947b-1774b29660d0" (UID: "068b89f3-4b20-46b7-947b-1774b29660d0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:06:59.457618 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:06:59.457561    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "068b89f3-4b20-46b7-947b-1774b29660d0" (UID: "068b89f3-4b20-46b7-947b-1774b29660d0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:06:59.457618 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:06:59.457609    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-model-cache\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:06:59.457733 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:06:59.457619    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-home" (OuterVolumeSpecName: "home") pod "068b89f3-4b20-46b7-947b-1774b29660d0" (UID: "068b89f3-4b20-46b7-947b-1774b29660d0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:06:59.459499 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:06:59.459477    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-dshm" (OuterVolumeSpecName: "dshm") pod "068b89f3-4b20-46b7-947b-1774b29660d0" (UID: "068b89f3-4b20-46b7-947b-1774b29660d0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:06:59.459638 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:06:59.459554    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/068b89f3-4b20-46b7-947b-1774b29660d0-kube-api-access-smwxt" (OuterVolumeSpecName: "kube-api-access-smwxt") pod "068b89f3-4b20-46b7-947b-1774b29660d0" (UID: "068b89f3-4b20-46b7-947b-1774b29660d0"). InnerVolumeSpecName "kube-api-access-smwxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:06:59.459638 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:06:59.459581    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/068b89f3-4b20-46b7-947b-1774b29660d0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "068b89f3-4b20-46b7-947b-1774b29660d0" (UID: "068b89f3-4b20-46b7-947b-1774b29660d0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:06:59.558474 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:06:59.558420    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-dshm\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:06:59.558474 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:06:59.558440    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smwxt\" (UniqueName: \"kubernetes.io/projected/068b89f3-4b20-46b7-947b-1774b29660d0-kube-api-access-smwxt\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:06:59.558474 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:06:59.558452    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/068b89f3-4b20-46b7-947b-1774b29660d0-tls-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:06:59.558474 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:06:59.558461    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-tmp-dir\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:06:59.558474 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:06:59.558468    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/068b89f3-4b20-46b7-947b-1774b29660d0-home\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:07:00.036162 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:00.036131    2576 generic.go:356] "Generic (PLEG): container finished" podID="068b89f3-4b20-46b7-947b-1774b29660d0" containerID="af6150d6606fb9784fdc30d894abcaaf6068a92743de126ed570eafe02196264" exitCode=0
Jul 16 00:07:00.036333 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:00.036167    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj" event={"ID":"068b89f3-4b20-46b7-947b-1774b29660d0","Type":"ContainerDied","Data":"af6150d6606fb9784fdc30d894abcaaf6068a92743de126ed570eafe02196264"}
Jul 16 00:07:00.036333 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:00.036189    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"
Jul 16 00:07:00.036333 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:00.036198    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj" event={"ID":"068b89f3-4b20-46b7-947b-1774b29660d0","Type":"ContainerDied","Data":"dee3def124599e4f3d0c16befeec0edef4a727f428f3196c0eb588adf35d2f75"}
Jul 16 00:07:00.036333 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:00.036221    2576 scope.go:117] "RemoveContainer" containerID="af6150d6606fb9784fdc30d894abcaaf6068a92743de126ed570eafe02196264"
Jul 16 00:07:00.044868 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:00.044842    2576 scope.go:117] "RemoveContainer" containerID="af6150d6606fb9784fdc30d894abcaaf6068a92743de126ed570eafe02196264"
Jul 16 00:07:00.045157 ip-10-0-142-22 kubenswrapper[2576]: E0716 00:07:00.045138    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af6150d6606fb9784fdc30d894abcaaf6068a92743de126ed570eafe02196264\": container with ID starting with af6150d6606fb9784fdc30d894abcaaf6068a92743de126ed570eafe02196264 not found: ID does not exist" containerID="af6150d6606fb9784fdc30d894abcaaf6068a92743de126ed570eafe02196264"
Jul 16 00:07:00.045217 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:00.045164    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af6150d6606fb9784fdc30d894abcaaf6068a92743de126ed570eafe02196264"} err="failed to get container status \"af6150d6606fb9784fdc30d894abcaaf6068a92743de126ed570eafe02196264\": rpc error: code = NotFound desc = could not find container \"af6150d6606fb9784fdc30d894abcaaf6068a92743de126ed570eafe02196264\": container with ID starting with af6150d6606fb9784fdc30d894abcaaf6068a92743de126ed570eafe02196264 not found: ID does not exist"
Jul 16 00:07:00.052713 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:00.052688    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"]
Jul 16 00:07:00.055938 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:00.055917    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-91d115/auth-test-model-91d115-kserve-569b8645bc-m69gj"]
Jul 16 00:07:01.971095 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:01.971061    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="068b89f3-4b20-46b7-947b-1774b29660d0" path="/var/lib/kubelet/pods/068b89f3-4b20-46b7-947b-1774b29660d0/volumes"
Jul 16 00:07:34.526979 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.526942    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"]
Jul 16 00:07:34.527516 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.527364    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="068b89f3-4b20-46b7-947b-1774b29660d0" containerName="main"
Jul 16 00:07:34.527516 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.527377    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="068b89f3-4b20-46b7-947b-1774b29660d0" containerName="main"
Jul 16 00:07:34.527516 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.527455    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="068b89f3-4b20-46b7-947b-1774b29660d0" containerName="main"
Jul 16 00:07:34.530703 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.530681    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:07:34.533161 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.533140    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-91d115\"/\"sub-test-model-91d115-kserve-self-signed-certs\""
Jul 16 00:07:34.533730 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.533709    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-91d115\"/\"openshift-service-ca.crt\""
Jul 16 00:07:34.533730 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.533723    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-91d115\"/\"default-dockercfg-jsbnd\""
Jul 16 00:07:34.534025 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.534004    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-91d115\"/\"kube-root-ca.crt\""
Jul 16 00:07:34.543611 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.543590    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"]
Jul 16 00:07:34.630411 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.630388    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-tmp-dir\") pod \"sub-test-model-91d115-kserve-6c6dbff685-zs2zf\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") " pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:07:34.630537 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.630434    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-model-cache\") pod \"sub-test-model-91d115-kserve-6c6dbff685-zs2zf\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") " pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:07:34.630537 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.630452    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-home\") pod \"sub-test-model-91d115-kserve-6c6dbff685-zs2zf\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") " pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:07:34.630661 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.630529    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-dshm\") pod \"sub-test-model-91d115-kserve-6c6dbff685-zs2zf\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") " pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:07:34.630661 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.630617    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q85z9\" (UniqueName: \"kubernetes.io/projected/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-kube-api-access-q85z9\") pod \"sub-test-model-91d115-kserve-6c6dbff685-zs2zf\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") " pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:07:34.630661 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.630651    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-tls-certs\") pod \"sub-test-model-91d115-kserve-6c6dbff685-zs2zf\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") " pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:07:34.731352 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.731316    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q85z9\" (UniqueName: \"kubernetes.io/projected/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-kube-api-access-q85z9\") pod \"sub-test-model-91d115-kserve-6c6dbff685-zs2zf\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") " pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:07:34.731352 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.731354    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-tls-certs\") pod \"sub-test-model-91d115-kserve-6c6dbff685-zs2zf\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") " pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:07:34.731548 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.731397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-tmp-dir\") pod \"sub-test-model-91d115-kserve-6c6dbff685-zs2zf\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") " pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:07:34.731548 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.731429    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-model-cache\") pod \"sub-test-model-91d115-kserve-6c6dbff685-zs2zf\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") " pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:07:34.731548 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.731449    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-home\") pod \"sub-test-model-91d115-kserve-6c6dbff685-zs2zf\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") " pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:07:34.731548 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.731465    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-dshm\") pod \"sub-test-model-91d115-kserve-6c6dbff685-zs2zf\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") " pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:07:34.731806 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.731786    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-tmp-dir\") pod \"sub-test-model-91d115-kserve-6c6dbff685-zs2zf\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") " pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:07:34.731871 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.731842    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-model-cache\") pod \"sub-test-model-91d115-kserve-6c6dbff685-zs2zf\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") " pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:07:34.731927 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.731897    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-home\") pod \"sub-test-model-91d115-kserve-6c6dbff685-zs2zf\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") " pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:07:34.733814 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.733781    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-dshm\") pod \"sub-test-model-91d115-kserve-6c6dbff685-zs2zf\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") " pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:07:34.734078 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.734056    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-tls-certs\") pod \"sub-test-model-91d115-kserve-6c6dbff685-zs2zf\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") " pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:07:34.739952 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.739932    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q85z9\" (UniqueName: \"kubernetes.io/projected/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-kube-api-access-q85z9\") pod \"sub-test-model-91d115-kserve-6c6dbff685-zs2zf\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") " pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:07:34.840818 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.840761    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:07:34.978955 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:34.978922    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"]
Jul 16 00:07:34.979548 ip-10-0-142-22 kubenswrapper[2576]: W0716 00:07:34.979523    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6e06a1e_6ca3_4aad_809b_474ad18e5d6b.slice/crio-c93748f6d42783d6c4a50b16c3ac7c4335251412b632026b13c564f2268fcd7d WatchSource:0}: Error finding container c93748f6d42783d6c4a50b16c3ac7c4335251412b632026b13c564f2268fcd7d: Status 404 returned error can't find the container with id c93748f6d42783d6c4a50b16c3ac7c4335251412b632026b13c564f2268fcd7d
Jul 16 00:07:35.202315 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:35.202214    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf" event={"ID":"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b","Type":"ContainerStarted","Data":"818291f2338d0e7e1baab63399bd55512a1c90de2168ffa60a8c4651d5844cbf"}
Jul 16 00:07:35.202315 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:35.202269    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf" event={"ID":"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b","Type":"ContainerStarted","Data":"c93748f6d42783d6c4a50b16c3ac7c4335251412b632026b13c564f2268fcd7d"}
Jul 16 00:07:35.219488 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:35.219443    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf" podStartSLOduration=1.219427172 podStartE2EDuration="1.219427172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:07:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:07:35.218823302 +0000 UTC m=+2277.762545657" watchObservedRunningTime="2026-07-16 00:07:35.219427172 +0000 UTC m=+2277.763149526"
Jul 16 00:07:44.841470 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:44.841432    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:07:44.842054 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:44.841484    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:07:44.854221 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:44.854197    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:07:45.262793 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:07:45.262763    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:08:08.605990 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:08.605956    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"]
Jul 16 00:08:23.626378 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:23.626321    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf" podUID="a6e06a1e-6ca3-4aad-809b-474ad18e5d6b" containerName="main" containerID="cri-o://818291f2338d0e7e1baab63399bd55512a1c90de2168ffa60a8c4651d5844cbf" gracePeriod=45
Jul 16 00:08:23.869174 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:23.869149    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:08:24.026552 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.026521    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-dshm\") pod \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") "
Jul 16 00:08:24.026720 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.026561    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q85z9\" (UniqueName: \"kubernetes.io/projected/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-kube-api-access-q85z9\") pod \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") "
Jul 16 00:08:24.026720 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.026590    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-tmp-dir\") pod \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") "
Jul 16 00:08:24.026720 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.026620    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-tls-certs\") pod \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") "
Jul 16 00:08:24.026720 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.026656    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-model-cache\") pod \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") "
Jul 16 00:08:24.026720 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.026721    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-home\") pod \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\" (UID: \"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b\") "
Jul 16 00:08:24.027003 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.026877    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a6e06a1e-6ca3-4aad-809b-474ad18e5d6b" (UID: "a6e06a1e-6ca3-4aad-809b-474ad18e5d6b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:08:24.027003 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.026982    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-model-cache" (OuterVolumeSpecName: "model-cache") pod "a6e06a1e-6ca3-4aad-809b-474ad18e5d6b" (UID: "a6e06a1e-6ca3-4aad-809b-474ad18e5d6b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:08:24.027101 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.027061    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-home" (OuterVolumeSpecName: "home") pod "a6e06a1e-6ca3-4aad-809b-474ad18e5d6b" (UID: "a6e06a1e-6ca3-4aad-809b-474ad18e5d6b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:08:24.027164 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.027113    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-tmp-dir\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:08:24.027164 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.027129    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-model-cache\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:08:24.028707 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.028680    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-kube-api-access-q85z9" (OuterVolumeSpecName: "kube-api-access-q85z9") pod "a6e06a1e-6ca3-4aad-809b-474ad18e5d6b" (UID: "a6e06a1e-6ca3-4aad-809b-474ad18e5d6b"). InnerVolumeSpecName "kube-api-access-q85z9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:08:24.028707 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.028701    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-dshm" (OuterVolumeSpecName: "dshm") pod "a6e06a1e-6ca3-4aad-809b-474ad18e5d6b" (UID: "a6e06a1e-6ca3-4aad-809b-474ad18e5d6b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:08:24.028888 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.028865    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a6e06a1e-6ca3-4aad-809b-474ad18e5d6b" (UID: "a6e06a1e-6ca3-4aad-809b-474ad18e5d6b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:08:24.127990 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.127962    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-home\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:08:24.127990 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.127988    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-dshm\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:08:24.128151 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.128002    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q85z9\" (UniqueName: \"kubernetes.io/projected/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-kube-api-access-q85z9\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:08:24.128151 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.128013    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b-tls-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:08:24.447814 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.447724    2576 generic.go:356] "Generic (PLEG): container finished" podID="a6e06a1e-6ca3-4aad-809b-474ad18e5d6b" containerID="818291f2338d0e7e1baab63399bd55512a1c90de2168ffa60a8c4651d5844cbf" exitCode=0
Jul 16 00:08:24.447814 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.447760    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"
Jul 16 00:08:24.448002 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.447807    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf" event={"ID":"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b","Type":"ContainerDied","Data":"818291f2338d0e7e1baab63399bd55512a1c90de2168ffa60a8c4651d5844cbf"}
Jul 16 00:08:24.448002 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.447850    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf" event={"ID":"a6e06a1e-6ca3-4aad-809b-474ad18e5d6b","Type":"ContainerDied","Data":"c93748f6d42783d6c4a50b16c3ac7c4335251412b632026b13c564f2268fcd7d"}
Jul 16 00:08:24.448002 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.447866    2576 scope.go:117] "RemoveContainer" containerID="818291f2338d0e7e1baab63399bd55512a1c90de2168ffa60a8c4651d5844cbf"
Jul 16 00:08:24.457566 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.457548    2576 scope.go:117] "RemoveContainer" containerID="818291f2338d0e7e1baab63399bd55512a1c90de2168ffa60a8c4651d5844cbf"
Jul 16 00:08:24.457816 ip-10-0-142-22 kubenswrapper[2576]: E0716 00:08:24.457798    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"818291f2338d0e7e1baab63399bd55512a1c90de2168ffa60a8c4651d5844cbf\": container with ID starting with 818291f2338d0e7e1baab63399bd55512a1c90de2168ffa60a8c4651d5844cbf not found: ID does not exist" containerID="818291f2338d0e7e1baab63399bd55512a1c90de2168ffa60a8c4651d5844cbf"
Jul 16 00:08:24.457908 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.457821    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"818291f2338d0e7e1baab63399bd55512a1c90de2168ffa60a8c4651d5844cbf"} err="failed to get container status \"818291f2338d0e7e1baab63399bd55512a1c90de2168ffa60a8c4651d5844cbf\": rpc error: code = NotFound desc = could not find container \"818291f2338d0e7e1baab63399bd55512a1c90de2168ffa60a8c4651d5844cbf\": container with ID starting with 818291f2338d0e7e1baab63399bd55512a1c90de2168ffa60a8c4651d5844cbf not found: ID does not exist"
Jul 16 00:08:24.469572 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.469550    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"]
Jul 16 00:08:24.471318 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:24.471297    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-91d115/sub-test-model-91d115-kserve-6c6dbff685-zs2zf"]
Jul 16 00:08:25.970896 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:25.970866    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6e06a1e-6ca3-4aad-809b-474ad18e5d6b" path="/var/lib/kubelet/pods/a6e06a1e-6ca3-4aad-809b-474ad18e5d6b/volumes"
Jul 16 00:08:45.829933 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.829902    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"]
Jul 16 00:08:45.830394 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.830311    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6e06a1e-6ca3-4aad-809b-474ad18e5d6b" containerName="main"
Jul 16 00:08:45.830394 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.830323    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6e06a1e-6ca3-4aad-809b-474ad18e5d6b" containerName="main"
Jul 16 00:08:45.830537 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.830413    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6e06a1e-6ca3-4aad-809b-474ad18e5d6b" containerName="main"
Jul 16 00:08:45.833441 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.833423    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:08:45.835319 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.835298    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-91d115\"/\"kube-root-ca.crt\""
Jul 16 00:08:45.835755 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.835733    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-91d115\"/\"default-dockercfg-jsbnd\""
Jul 16 00:08:45.835855 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.835756    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-91d115\"/\"openshift-service-ca.crt\""
Jul 16 00:08:45.835855 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.835770    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-91d115\"/\"rate-test-model-91d115-kserve-self-signed-certs\""
Jul 16 00:08:45.840956 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.840937    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"]
Jul 16 00:08:45.883714 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.883693    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-dshm\") pod \"rate-test-model-91d115-kserve-7b4bd585c5-4wmrr\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") " pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:08:45.883813 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.883729    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d95aa07-8adf-43a2-be8b-311a226948c0-tls-certs\") pod \"rate-test-model-91d115-kserve-7b4bd585c5-4wmrr\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") " pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:08:45.883813 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.883804    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-model-cache\") pod \"rate-test-model-91d115-kserve-7b4bd585c5-4wmrr\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") " pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:08:45.883907 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.883846    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-home\") pod \"rate-test-model-91d115-kserve-7b4bd585c5-4wmrr\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") " pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:08:45.883907 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.883883    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-tmp-dir\") pod \"rate-test-model-91d115-kserve-7b4bd585c5-4wmrr\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") " pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:08:45.883907 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.883899    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cb92\" (UniqueName: \"kubernetes.io/projected/5d95aa07-8adf-43a2-be8b-311a226948c0-kube-api-access-5cb92\") pod \"rate-test-model-91d115-kserve-7b4bd585c5-4wmrr\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") " pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:08:45.984565 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.984536    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-tmp-dir\") pod \"rate-test-model-91d115-kserve-7b4bd585c5-4wmrr\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") " pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:08:45.984565 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.984565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cb92\" (UniqueName: \"kubernetes.io/projected/5d95aa07-8adf-43a2-be8b-311a226948c0-kube-api-access-5cb92\") pod \"rate-test-model-91d115-kserve-7b4bd585c5-4wmrr\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") " pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:08:45.984770 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.984596    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-dshm\") pod \"rate-test-model-91d115-kserve-7b4bd585c5-4wmrr\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") " pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:08:45.984770 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.984632    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d95aa07-8adf-43a2-be8b-311a226948c0-tls-certs\") pod \"rate-test-model-91d115-kserve-7b4bd585c5-4wmrr\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") " pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:08:45.984770 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.984699    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-model-cache\") pod \"rate-test-model-91d115-kserve-7b4bd585c5-4wmrr\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") " pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:08:45.984770 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.984726    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-home\") pod \"rate-test-model-91d115-kserve-7b4bd585c5-4wmrr\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") " pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:08:45.984963 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.984922    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-tmp-dir\") pod \"rate-test-model-91d115-kserve-7b4bd585c5-4wmrr\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") " pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:08:45.985102 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.985084    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-home\") pod \"rate-test-model-91d115-kserve-7b4bd585c5-4wmrr\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") " pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:08:45.985165 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.985086    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-model-cache\") pod \"rate-test-model-91d115-kserve-7b4bd585c5-4wmrr\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") " pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:08:45.986927 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.986895    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-dshm\") pod \"rate-test-model-91d115-kserve-7b4bd585c5-4wmrr\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") " pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:08:45.987191 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.987169    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d95aa07-8adf-43a2-be8b-311a226948c0-tls-certs\") pod \"rate-test-model-91d115-kserve-7b4bd585c5-4wmrr\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") " pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:08:45.991381 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:45.991360    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cb92\" (UniqueName: \"kubernetes.io/projected/5d95aa07-8adf-43a2-be8b-311a226948c0-kube-api-access-5cb92\") pod \"rate-test-model-91d115-kserve-7b4bd585c5-4wmrr\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") " pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:08:46.142770 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:46.142710    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:08:46.272045 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:46.272020    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"]
Jul 16 00:08:46.274102 ip-10-0-142-22 kubenswrapper[2576]: W0716 00:08:46.274071    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d95aa07_8adf_43a2_be8b_311a226948c0.slice/crio-95b97a660132faceb098a470d40570f14c14014da026d335bac0abd7b53926d3 WatchSource:0}: Error finding container 95b97a660132faceb098a470d40570f14c14014da026d335bac0abd7b53926d3: Status 404 returned error can't find the container with id 95b97a660132faceb098a470d40570f14c14014da026d335bac0abd7b53926d3
Jul 16 00:08:46.551112 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:46.551072    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr" event={"ID":"5d95aa07-8adf-43a2-be8b-311a226948c0","Type":"ContainerStarted","Data":"5127d70d08068d590a0009136f3cd05e87f2f80dc5f9a91579b9c0956a8f702a"}
Jul 16 00:08:46.551112 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:46.551114    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr" event={"ID":"5d95aa07-8adf-43a2-be8b-311a226948c0","Type":"ContainerStarted","Data":"95b97a660132faceb098a470d40570f14c14014da026d335bac0abd7b53926d3"}
Jul 16 00:08:46.567571 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:46.567531    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr" podStartSLOduration=1.567515591 podStartE2EDuration="1.567515591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:08:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:08:46.56570108 +0000 UTC m=+2349.109423445" watchObservedRunningTime="2026-07-16 00:08:46.567515591 +0000 UTC m=+2349.111237945"
Jul 16 00:08:56.143039 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:56.143000    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:08:56.143547 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:56.143066    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:08:56.155953 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:56.155929    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:08:56.615806 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:08:56.615772    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:09:30.643699 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:30.643663    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"]
Jul 16 00:09:38.086049 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:38.086026    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2wsc4_2678ca67-7c8a-42d0-a4fc-99b257a177a5/ovn-acl-logging/0.log"
Jul 16 00:09:38.094275 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:38.094256    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2wsc4_2678ca67-7c8a-42d0-a4fc-99b257a177a5/ovn-acl-logging/0.log"
Jul 16 00:09:45.664417 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:45.664379    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr" podUID="5d95aa07-8adf-43a2-be8b-311a226948c0" containerName="main" containerID="cri-o://5127d70d08068d590a0009136f3cd05e87f2f80dc5f9a91579b9c0956a8f702a" gracePeriod=45
Jul 16 00:09:45.837467 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:45.837435    2576 generic.go:356] "Generic (PLEG): container finished" podID="5d95aa07-8adf-43a2-be8b-311a226948c0" containerID="5127d70d08068d590a0009136f3cd05e87f2f80dc5f9a91579b9c0956a8f702a" exitCode=0
Jul 16 00:09:45.837594 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:45.837505    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr" event={"ID":"5d95aa07-8adf-43a2-be8b-311a226948c0","Type":"ContainerDied","Data":"5127d70d08068d590a0009136f3cd05e87f2f80dc5f9a91579b9c0956a8f702a"}
Jul 16 00:09:45.921779 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:45.921730    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:09:46.071398 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:46.071374    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-dshm\") pod \"5d95aa07-8adf-43a2-be8b-311a226948c0\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") "
Jul 16 00:09:46.071565 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:46.071415    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-tmp-dir\") pod \"5d95aa07-8adf-43a2-be8b-311a226948c0\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") "
Jul 16 00:09:46.071565 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:46.071434    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cb92\" (UniqueName: \"kubernetes.io/projected/5d95aa07-8adf-43a2-be8b-311a226948c0-kube-api-access-5cb92\") pod \"5d95aa07-8adf-43a2-be8b-311a226948c0\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") "
Jul 16 00:09:46.071565 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:46.071471    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d95aa07-8adf-43a2-be8b-311a226948c0-tls-certs\") pod \"5d95aa07-8adf-43a2-be8b-311a226948c0\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") "
Jul 16 00:09:46.071565 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:46.071508    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-home\") pod \"5d95aa07-8adf-43a2-be8b-311a226948c0\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") "
Jul 16 00:09:46.071795 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:46.071577    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-model-cache\") pod \"5d95aa07-8adf-43a2-be8b-311a226948c0\" (UID: \"5d95aa07-8adf-43a2-be8b-311a226948c0\") "
Jul 16 00:09:46.071795 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:46.071722    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5d95aa07-8adf-43a2-be8b-311a226948c0" (UID: "5d95aa07-8adf-43a2-be8b-311a226948c0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:09:46.071795 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:46.071775    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-home" (OuterVolumeSpecName: "home") pod "5d95aa07-8adf-43a2-be8b-311a226948c0" (UID: "5d95aa07-8adf-43a2-be8b-311a226948c0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:09:46.071964 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:46.071818    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-model-cache" (OuterVolumeSpecName: "model-cache") pod "5d95aa07-8adf-43a2-be8b-311a226948c0" (UID: "5d95aa07-8adf-43a2-be8b-311a226948c0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:09:46.071964 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:46.071948    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-model-cache\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:09:46.071964 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:46.071965    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-tmp-dir\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:09:46.072121 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:46.071974    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-home\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:09:46.073634 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:46.073606    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-dshm" (OuterVolumeSpecName: "dshm") pod "5d95aa07-8adf-43a2-be8b-311a226948c0" (UID: "5d95aa07-8adf-43a2-be8b-311a226948c0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 00:09:46.073634 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:46.073606    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d95aa07-8adf-43a2-be8b-311a226948c0-kube-api-access-5cb92" (OuterVolumeSpecName: "kube-api-access-5cb92") pod "5d95aa07-8adf-43a2-be8b-311a226948c0" (UID: "5d95aa07-8adf-43a2-be8b-311a226948c0"). InnerVolumeSpecName "kube-api-access-5cb92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:09:46.073781 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:46.073657    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d95aa07-8adf-43a2-be8b-311a226948c0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5d95aa07-8adf-43a2-be8b-311a226948c0" (UID: "5d95aa07-8adf-43a2-be8b-311a226948c0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:09:46.173312 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:46.173245    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d95aa07-8adf-43a2-be8b-311a226948c0-tls-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:09:46.173312 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:46.173276    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d95aa07-8adf-43a2-be8b-311a226948c0-dshm\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:09:46.173312 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:46.173285    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cb92\" (UniqueName: \"kubernetes.io/projected/5d95aa07-8adf-43a2-be8b-311a226948c0-kube-api-access-5cb92\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:09:46.843053 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:46.843026    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"
Jul 16 00:09:46.843502 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:46.843017    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr" event={"ID":"5d95aa07-8adf-43a2-be8b-311a226948c0","Type":"ContainerDied","Data":"95b97a660132faceb098a470d40570f14c14014da026d335bac0abd7b53926d3"}
Jul 16 00:09:46.843502 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:46.843154    2576 scope.go:117] "RemoveContainer" containerID="5127d70d08068d590a0009136f3cd05e87f2f80dc5f9a91579b9c0956a8f702a"
Jul 16 00:09:46.862692 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:46.862661    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"]
Jul 16 00:09:46.865298 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:46.865274    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-91d115/rate-test-model-91d115-kserve-7b4bd585c5-4wmrr"]
Jul 16 00:09:47.970787 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:47.970745    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d95aa07-8adf-43a2-be8b-311a226948c0" path="/var/lib/kubelet/pods/5d95aa07-8adf-43a2-be8b-311a226948c0/volumes"
Jul 16 00:09:56.106064 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:56.106024    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv"]
Jul 16 00:09:56.106575 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:56.106321    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv" podUID="016ac7b6-4e7d-41b2-9779-2b53c92de242" containerName="maas-api" containerID="cri-o://902e29e758489476b619dfe3ee911ef621e4fa2326ba1f62792102878f759cb1" gracePeriod=30
Jul 16 00:09:56.551929 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:56.551906    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv"
Jul 16 00:09:56.655115 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:56.655049    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fjd7\" (UniqueName: \"kubernetes.io/projected/016ac7b6-4e7d-41b2-9779-2b53c92de242-kube-api-access-6fjd7\") pod \"016ac7b6-4e7d-41b2-9779-2b53c92de242\" (UID: \"016ac7b6-4e7d-41b2-9779-2b53c92de242\") "
Jul 16 00:09:56.655252 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:56.655134    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/016ac7b6-4e7d-41b2-9779-2b53c92de242-maas-api-tls\") pod \"016ac7b6-4e7d-41b2-9779-2b53c92de242\" (UID: \"016ac7b6-4e7d-41b2-9779-2b53c92de242\") "
Jul 16 00:09:56.655252 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:56.655191    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/016ac7b6-4e7d-41b2-9779-2b53c92de242-openshift-service-ca\") pod \"016ac7b6-4e7d-41b2-9779-2b53c92de242\" (UID: \"016ac7b6-4e7d-41b2-9779-2b53c92de242\") "
Jul 16 00:09:56.655617 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:56.655581    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/016ac7b6-4e7d-41b2-9779-2b53c92de242-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "016ac7b6-4e7d-41b2-9779-2b53c92de242" (UID: "016ac7b6-4e7d-41b2-9779-2b53c92de242"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:09:56.657203 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:56.657181    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/016ac7b6-4e7d-41b2-9779-2b53c92de242-kube-api-access-6fjd7" (OuterVolumeSpecName: "kube-api-access-6fjd7") pod "016ac7b6-4e7d-41b2-9779-2b53c92de242" (UID: "016ac7b6-4e7d-41b2-9779-2b53c92de242"). InnerVolumeSpecName "kube-api-access-6fjd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:09:56.657309 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:56.657203    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/016ac7b6-4e7d-41b2-9779-2b53c92de242-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "016ac7b6-4e7d-41b2-9779-2b53c92de242" (UID: "016ac7b6-4e7d-41b2-9779-2b53c92de242"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:09:56.755822 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:56.755798    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/016ac7b6-4e7d-41b2-9779-2b53c92de242-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:09:56.755822 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:56.755819    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fjd7\" (UniqueName: \"kubernetes.io/projected/016ac7b6-4e7d-41b2-9779-2b53c92de242-kube-api-access-6fjd7\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:09:56.755953 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:56.755828    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/016ac7b6-4e7d-41b2-9779-2b53c92de242-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:09:56.895412 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:56.895387    2576 generic.go:356] "Generic (PLEG): container finished" podID="016ac7b6-4e7d-41b2-9779-2b53c92de242" containerID="902e29e758489476b619dfe3ee911ef621e4fa2326ba1f62792102878f759cb1" exitCode=0
Jul 16 00:09:56.895509 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:56.895429    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv"
Jul 16 00:09:56.895509 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:56.895471    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv" event={"ID":"016ac7b6-4e7d-41b2-9779-2b53c92de242","Type":"ContainerDied","Data":"902e29e758489476b619dfe3ee911ef621e4fa2326ba1f62792102878f759cb1"}
Jul 16 00:09:56.895594 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:56.895521    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv" event={"ID":"016ac7b6-4e7d-41b2-9779-2b53c92de242","Type":"ContainerDied","Data":"d8593a8c7b147821d3d32f3486fb195c5b849477a63ca4fa12998616a9a0bd31"}
Jul 16 00:09:56.895594 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:56.895544    2576 scope.go:117] "RemoveContainer" containerID="902e29e758489476b619dfe3ee911ef621e4fa2326ba1f62792102878f759cb1"
Jul 16 00:09:56.905053 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:56.905038    2576 scope.go:117] "RemoveContainer" containerID="902e29e758489476b619dfe3ee911ef621e4fa2326ba1f62792102878f759cb1"
Jul 16 00:09:56.905366 ip-10-0-142-22 kubenswrapper[2576]: E0716 00:09:56.905313    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"902e29e758489476b619dfe3ee911ef621e4fa2326ba1f62792102878f759cb1\": container with ID starting with 902e29e758489476b619dfe3ee911ef621e4fa2326ba1f62792102878f759cb1 not found: ID does not exist" containerID="902e29e758489476b619dfe3ee911ef621e4fa2326ba1f62792102878f759cb1"
Jul 16 00:09:56.905366 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:56.905336    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"902e29e758489476b619dfe3ee911ef621e4fa2326ba1f62792102878f759cb1"} err="failed to get container status \"902e29e758489476b619dfe3ee911ef621e4fa2326ba1f62792102878f759cb1\": rpc error: code = NotFound desc = could not find container \"902e29e758489476b619dfe3ee911ef621e4fa2326ba1f62792102878f759cb1\": container with ID starting with 902e29e758489476b619dfe3ee911ef621e4fa2326ba1f62792102878f759cb1 not found: ID does not exist"
Jul 16 00:09:56.916182 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:56.916159    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv"]
Jul 16 00:09:56.917941 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:56.917923    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-079998-95575546d-4wtfv"]
Jul 16 00:09:57.969983 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:09:57.969952    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="016ac7b6-4e7d-41b2-9779-2b53c92de242" path="/var/lib/kubelet/pods/016ac7b6-4e7d-41b2-9779-2b53c92de242/volumes"
Jul 16 00:10:08.089445 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:08.089373    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt"]
Jul 16 00:10:08.089968 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:08.089578    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt" podUID="7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b" containerName="maas-api" containerID="cri-o://96a151cad9bbcc57bc8f974a13081de5c580bda65e30f6490c22eb3232144094" gracePeriod=30
Jul 16 00:10:08.536179 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:08.536148    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt"
Jul 16 00:10:08.656433 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:08.656347    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b-maas-api-tls\") pod \"7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b\" (UID: \"7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b\") "
Jul 16 00:10:08.656433 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:08.656407    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b-openshift-service-ca\") pod \"7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b\" (UID: \"7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b\") "
Jul 16 00:10:08.656630 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:08.656466    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5lbs\" (UniqueName: \"kubernetes.io/projected/7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b-kube-api-access-n5lbs\") pod \"7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b\" (UID: \"7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b\") "
Jul 16 00:10:08.656858 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:08.656829    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b" (UID: "7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 00:10:08.658684 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:08.658653    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b-kube-api-access-n5lbs" (OuterVolumeSpecName: "kube-api-access-n5lbs") pod "7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b" (UID: "7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b"). InnerVolumeSpecName "kube-api-access-n5lbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 00:10:08.658894 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:08.658874    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b" (UID: "7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 00:10:08.758046 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:08.758012    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:10:08.758046 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:08.758041    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:10:08.758222 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:08.758054    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5lbs\" (UniqueName: \"kubernetes.io/projected/7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b-kube-api-access-n5lbs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Jul 16 00:10:08.953553 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:08.953474    2576 generic.go:356] "Generic (PLEG): container finished" podID="7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b" containerID="96a151cad9bbcc57bc8f974a13081de5c580bda65e30f6490c22eb3232144094" exitCode=0
Jul 16 00:10:08.953553 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:08.953513    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt"
Jul 16 00:10:08.953720 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:08.953563    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt" event={"ID":"7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b","Type":"ContainerDied","Data":"96a151cad9bbcc57bc8f974a13081de5c580bda65e30f6490c22eb3232144094"}
Jul 16 00:10:08.953720 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:08.953611    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt" event={"ID":"7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b","Type":"ContainerDied","Data":"97ddd2d7b9a06a4e201cfc79c64e51c60586d2e140be3b7630efff385ab6e337"}
Jul 16 00:10:08.953720 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:08.953632    2576 scope.go:117] "RemoveContainer" containerID="96a151cad9bbcc57bc8f974a13081de5c580bda65e30f6490c22eb3232144094"
Jul 16 00:10:08.962579 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:08.962563    2576 scope.go:117] "RemoveContainer" containerID="96a151cad9bbcc57bc8f974a13081de5c580bda65e30f6490c22eb3232144094"
Jul 16 00:10:08.962839 ip-10-0-142-22 kubenswrapper[2576]: E0716 00:10:08.962809    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96a151cad9bbcc57bc8f974a13081de5c580bda65e30f6490c22eb3232144094\": container with ID starting with 96a151cad9bbcc57bc8f974a13081de5c580bda65e30f6490c22eb3232144094 not found: ID does not exist" containerID="96a151cad9bbcc57bc8f974a13081de5c580bda65e30f6490c22eb3232144094"
Jul 16 00:10:08.962985 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:08.962849    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96a151cad9bbcc57bc8f974a13081de5c580bda65e30f6490c22eb3232144094"} err="failed to get container status \"96a151cad9bbcc57bc8f974a13081de5c580bda65e30f6490c22eb3232144094\": rpc error: code = NotFound desc = could not find container \"96a151cad9bbcc57bc8f974a13081de5c580bda65e30f6490c22eb3232144094\": container with ID starting with 96a151cad9bbcc57bc8f974a13081de5c580bda65e30f6490c22eb3232144094 not found: ID does not exist"
Jul 16 00:10:08.972027 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:08.972008    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt"]
Jul 16 00:10:08.975790 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:08.975772    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-91d115-5c5d6474cd-f75bt"]
Jul 16 00:10:09.969835 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:09.969805    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b" path="/var/lib/kubelet/pods/7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b/volumes"
Jul 16 00:10:21.380648 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:21.380618    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ccf6fdd4-w8h88_551dc737-8443-4379-ba2f-13d7b3066ff9/copy-manifests/0.log"
Jul 16 00:10:21.386271 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:21.386249    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ccf6fdd4-w8h88_551dc737-8443-4379-ba2f-13d7b3066ff9/manager/0.log"
Jul 16 00:10:21.722118 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:21.722052    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6f7f9b8ff8-sb6m5_85774ef4-b047-4c7d-8ef1-79cbcdeab63b/maas-api/0.log"
Jul 16 00:10:21.838056 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:21.838032    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735985-txllx_8ac559b3-9e52-4706-bc71-fbfbbfff5a3e/cleanup/0.log"
Jul 16 00:10:21.947997 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:21.947978    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29736000-nzzmn_e4acfa0e-4617-4d80-8170-1555253742bd/cleanup/0.log"
Jul 16 00:10:22.054843 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:22.054820    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-6f8v7_b0e52bba-7b74-4335-94fc-ff26cb78aa1b/postgres/0.log"
Jul 16 00:10:23.579821 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:23.579796    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mvtfw_d11915e9-1615-4182-a5e3-74dfe33488c4/manager/0.log"
Jul 16 00:10:23.686686 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:23.686658    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zltmd_583a7908-5618-4315-bc8b-17ee4abc1300/kuadrant-console-plugin/0.log"
Jul 16 00:10:23.925490 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:23.925422    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mphlg_c65906a1-12d5-4f31-ade2-ea90f56c085a/manager/0.log"
Jul 16 00:10:24.870430 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:24.870397    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bddb6d9b-k8czw_b4227919-8c1f-49fe-9d54-7ba139823de9/kube-auth-proxy/0.log"
Jul 16 00:10:25.117316 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:25.117281    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-bmsq7_920f7ba0-96e2-4a6a-aa34-e5ae322bf4be/payload-pre-processing/0.log"
Jul 16 00:10:25.231707 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:25.231640    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-pfjwg_d5c1742f-1db1-4a9a-bca9-ced160cd4e9b/payload-processing/0.log"
Jul 16 00:10:25.682939 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:25.682908    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-g6rfg_3e90cd12-e8ee-4976-8f31-47147b925cb5/main/0.log"
Jul 16 00:10:35.093749 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:35.093719    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s9w89_943763e4-c636-494b-ac1f-b63c8e43a744/global-pull-secret-syncer/0.log"
Jul 16 00:10:35.242611 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:35.242588    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wg4tf_1664a246-dfb4-41f9-b051-19dbbd5a4781/konnectivity-agent/0.log"
Jul 16 00:10:35.282002 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:35.281979    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-22.ec2.internal_a5413ecf371cffe8dd9dab2a6b7557f0/haproxy/0.log"
Jul 16 00:10:40.804535 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:40.804498    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mvtfw_d11915e9-1615-4182-a5e3-74dfe33488c4/manager/0.log"
Jul 16 00:10:40.838841 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:40.838822    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zltmd_583a7908-5618-4315-bc8b-17ee4abc1300/kuadrant-console-plugin/0.log"
Jul 16 00:10:40.995776 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:40.995754    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mphlg_c65906a1-12d5-4f31-ade2-ea90f56c085a/manager/0.log"
Jul 16 00:10:42.910054 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:42.910031    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-r9gdz_63e974da-1418-40b8-a9f2-8b07406a824b/cluster-monitoring-operator/0.log"
Jul 16 00:10:43.222593 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:43.222526    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-twjdt_6b187e6a-05e7-4d28-9b57-79f48444d4c6/node-exporter/0.log"
Jul 16 00:10:43.241562 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:43.241544    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-twjdt_6b187e6a-05e7-4d28-9b57-79f48444d4c6/kube-rbac-proxy/0.log"
Jul 16 00:10:43.261058 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:43.261037    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-twjdt_6b187e6a-05e7-4d28-9b57-79f48444d4c6/init-textfile/0.log"
Jul 16 00:10:43.361854 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:43.361827    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_02c1febd-07f0-4c9d-99a9-aaa753f9d69c/prometheus/0.log"
Jul 16 00:10:43.386721 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:43.386700    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_02c1febd-07f0-4c9d-99a9-aaa753f9d69c/config-reloader/0.log"
Jul 16 00:10:43.404207 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:43.404191    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_02c1febd-07f0-4c9d-99a9-aaa753f9d69c/thanos-sidecar/0.log"
Jul 16 00:10:43.417965 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:43.417948    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_02c1febd-07f0-4c9d-99a9-aaa753f9d69c/kube-rbac-proxy-web/0.log"
Jul 16 00:10:43.435456 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:43.435441    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_02c1febd-07f0-4c9d-99a9-aaa753f9d69c/kube-rbac-proxy/0.log"
Jul 16 00:10:43.453619 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:43.453594    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_02c1febd-07f0-4c9d-99a9-aaa753f9d69c/kube-rbac-proxy-thanos/0.log"
Jul 16 00:10:43.471574 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:43.471560    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_02c1febd-07f0-4c9d-99a9-aaa753f9d69c/init-config-reloader/0.log"
Jul 16 00:10:43.498770 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:43.498749    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-9sv5k_cd8ca0be-afb0-46df-910c-7190fbd9b7ef/prometheus-operator/0.log"
Jul 16 00:10:43.514302 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:43.514289    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-9sv5k_cd8ca0be-afb0-46df-910c-7190fbd9b7ef/kube-rbac-proxy/0.log"
Jul 16 00:10:43.640781 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:43.640752    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58fcb7865b-thllv_7e47522d-a3ee-4a28-9590-f64d33289a98/thanos-query/0.log"
Jul 16 00:10:43.660344 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:43.660306    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58fcb7865b-thllv_7e47522d-a3ee-4a28-9590-f64d33289a98/kube-rbac-proxy-web/0.log"
Jul 16 00:10:43.677038 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:43.677020    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58fcb7865b-thllv_7e47522d-a3ee-4a28-9590-f64d33289a98/kube-rbac-proxy/0.log"
Jul 16 00:10:43.693985 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:43.693966    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58fcb7865b-thllv_7e47522d-a3ee-4a28-9590-f64d33289a98/prom-label-proxy/0.log"
Jul 16 00:10:43.716010 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:43.715992    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58fcb7865b-thllv_7e47522d-a3ee-4a28-9590-f64d33289a98/kube-rbac-proxy-rules/0.log"
Jul 16 00:10:43.733794 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:43.733776    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58fcb7865b-thllv_7e47522d-a3ee-4a28-9590-f64d33289a98/kube-rbac-proxy-metrics/0.log"
Jul 16 00:10:45.573399 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.573363    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4"]
Jul 16 00:10:45.573754 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.573737    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b" containerName="maas-api"
Jul 16 00:10:45.573754 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.573749    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b" containerName="maas-api"
Jul 16 00:10:45.573844 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.573772    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="016ac7b6-4e7d-41b2-9779-2b53c92de242" containerName="maas-api"
Jul 16 00:10:45.573844 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.573778    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="016ac7b6-4e7d-41b2-9779-2b53c92de242" containerName="maas-api"
Jul 16 00:10:45.573844 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.573789    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d95aa07-8adf-43a2-be8b-311a226948c0" containerName="main"
Jul 16 00:10:45.573844 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.573795    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d95aa07-8adf-43a2-be8b-311a226948c0" containerName="main"
Jul 16 00:10:45.574003 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.573854    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="016ac7b6-4e7d-41b2-9779-2b53c92de242" containerName="maas-api"
Jul 16 00:10:45.574003 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.573864    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d95aa07-8adf-43a2-be8b-311a226948c0" containerName="main"
Jul 16 00:10:45.574003 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.573872    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e6a43b7-6787-4898-91fd-5aa2ef9f8d3b" containerName="maas-api"
Jul 16 00:10:45.576917 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.576894    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4"
Jul 16 00:10:45.578740 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.578721    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-66nch\"/\"kube-root-ca.crt\""
Jul 16 00:10:45.579082 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.579065    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-66nch\"/\"openshift-service-ca.crt\""
Jul 16 00:10:45.579128 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.579065    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-66nch\"/\"default-dockercfg-kjq8g\""
Jul 16 00:10:45.584910 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.584886    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4"]
Jul 16 00:10:45.737805 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.737775    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66956917-87fa-4c4a-bcf3-32f8202f666a-proc\") pod \"perf-node-gather-daemonset-n9qj4\" (UID: \"66956917-87fa-4c4a-bcf3-32f8202f666a\") " pod="openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4"
Jul 16 00:10:45.737949 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.737822    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66956917-87fa-4c4a-bcf3-32f8202f666a-sys\") pod \"perf-node-gather-daemonset-n9qj4\" (UID: \"66956917-87fa-4c4a-bcf3-32f8202f666a\") " pod="openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4"
Jul 16 00:10:45.737949 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.737850    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgt29\" (UniqueName: \"kubernetes.io/projected/66956917-87fa-4c4a-bcf3-32f8202f666a-kube-api-access-jgt29\") pod \"perf-node-gather-daemonset-n9qj4\" (UID: \"66956917-87fa-4c4a-bcf3-32f8202f666a\") " pod="openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4"
Jul 16 00:10:45.738040 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.737966    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66956917-87fa-4c4a-bcf3-32f8202f666a-lib-modules\") pod \"perf-node-gather-daemonset-n9qj4\" (UID: \"66956917-87fa-4c4a-bcf3-32f8202f666a\") " pod="openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4"
Jul 16 00:10:45.738040 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.738012    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66956917-87fa-4c4a-bcf3-32f8202f666a-podres\") pod \"perf-node-gather-daemonset-n9qj4\" (UID: \"66956917-87fa-4c4a-bcf3-32f8202f666a\") " pod="openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4"
Jul 16 00:10:45.839261 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.839166    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66956917-87fa-4c4a-bcf3-32f8202f666a-lib-modules\") pod \"perf-node-gather-daemonset-n9qj4\" (UID: \"66956917-87fa-4c4a-bcf3-32f8202f666a\") " pod="openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4"
Jul 16 00:10:45.839261 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.839210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66956917-87fa-4c4a-bcf3-32f8202f666a-podres\") pod \"perf-node-gather-daemonset-n9qj4\" (UID: \"66956917-87fa-4c4a-bcf3-32f8202f666a\") " pod="openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4"
Jul 16 00:10:45.839441 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.839271    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66956917-87fa-4c4a-bcf3-32f8202f666a-proc\") pod \"perf-node-gather-daemonset-n9qj4\" (UID: \"66956917-87fa-4c4a-bcf3-32f8202f666a\") " pod="openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4"
Jul 16 00:10:45.839441 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.839311    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66956917-87fa-4c4a-bcf3-32f8202f666a-sys\") pod \"perf-node-gather-daemonset-n9qj4\" (UID: \"66956917-87fa-4c4a-bcf3-32f8202f666a\") " pod="openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4"
Jul 16 00:10:45.839441 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.839333    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgt29\" (UniqueName: \"kubernetes.io/projected/66956917-87fa-4c4a-bcf3-32f8202f666a-kube-api-access-jgt29\") pod \"perf-node-gather-daemonset-n9qj4\" (UID: \"66956917-87fa-4c4a-bcf3-32f8202f666a\") " pod="openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4"
Jul 16 00:10:45.839441 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.839352    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66956917-87fa-4c4a-bcf3-32f8202f666a-lib-modules\") pod \"perf-node-gather-daemonset-n9qj4\" (UID: \"66956917-87fa-4c4a-bcf3-32f8202f666a\") " pod="openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4"
Jul 16 00:10:45.839441 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.839384    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66956917-87fa-4c4a-bcf3-32f8202f666a-sys\") pod \"perf-node-gather-daemonset-n9qj4\" (UID: \"66956917-87fa-4c4a-bcf3-32f8202f666a\") " pod="openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4"
Jul 16 00:10:45.839441 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.839398    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66956917-87fa-4c4a-bcf3-32f8202f666a-podres\") pod \"perf-node-gather-daemonset-n9qj4\" (UID: \"66956917-87fa-4c4a-bcf3-32f8202f666a\") " pod="openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4"
Jul 16 00:10:45.839441 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.839384    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66956917-87fa-4c4a-bcf3-32f8202f666a-proc\") pod \"perf-node-gather-daemonset-n9qj4\" (UID: \"66956917-87fa-4c4a-bcf3-32f8202f666a\") " pod="openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4"
Jul 16 00:10:45.846883 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.846863    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgt29\" (UniqueName: \"kubernetes.io/projected/66956917-87fa-4c4a-bcf3-32f8202f666a-kube-api-access-jgt29\") pod \"perf-node-gather-daemonset-n9qj4\" (UID: \"66956917-87fa-4c4a-bcf3-32f8202f666a\") " pod="openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4"
Jul 16 00:10:45.887474 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:45.887444    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4"
Jul 16 00:10:46.014947 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:46.014924    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4"]
Jul 16 00:10:46.017085 ip-10-0-142-22 kubenswrapper[2576]: W0716 00:10:46.017054    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod66956917_87fa_4c4a_bcf3_32f8202f666a.slice/crio-f81765b45efceb1456aca50ce5f0a47657f429a6adeffe099d446b5259170e83 WatchSource:0}: Error finding container f81765b45efceb1456aca50ce5f0a47657f429a6adeffe099d446b5259170e83: Status 404 returned error can't find the container with id f81765b45efceb1456aca50ce5f0a47657f429a6adeffe099d446b5259170e83
Jul 16 00:10:46.126383 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:46.126325    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4" event={"ID":"66956917-87fa-4c4a-bcf3-32f8202f666a","Type":"ContainerStarted","Data":"f81765b45efceb1456aca50ce5f0a47657f429a6adeffe099d446b5259170e83"}
Jul 16 00:10:46.233277 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:46.233243    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-5dr64_71c24f93-ca51-4491-a5d2-b9270f9330f6/download-server/0.log"
Jul 16 00:10:47.131842 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:47.131809    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4" event={"ID":"66956917-87fa-4c4a-bcf3-32f8202f666a","Type":"ContainerStarted","Data":"ce624f8b18789aa1d14dff508e9b2fbaf221b1954aea2e4e5f0deb14563dae7d"}
Jul 16 00:10:47.132210 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:47.131868    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4"
Jul 16 00:10:47.147391 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:47.147349    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4" podStartSLOduration=2.147334771 podStartE2EDuration="2.147334771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:10:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:10:47.145502628 +0000 UTC m=+2469.689224985" watchObservedRunningTime="2026-07-16 00:10:47.147334771 +0000 UTC m=+2469.691057124"
Jul 16 00:10:47.801543 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:47.801522    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-chmd4_4a5e7446-d01c-4487-8450-b853f451b6f0/dns/0.log"
Jul 16 00:10:47.819917 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:47.819899    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-chmd4_4a5e7446-d01c-4487-8450-b853f451b6f0/kube-rbac-proxy/0.log"
Jul 16 00:10:47.942181 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:47.942153    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h4fg7_9c1eb0ec-907d-4e1b-9397-0336edac638d/dns-node-resolver/0.log"
Jul 16 00:10:48.573827 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:48.573803    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t8kxt_49685317-16b6-4fc9-be9d-30b2f82d1967/node-ca/0.log"
Jul 16 00:10:49.737622 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:49.737587    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bddb6d9b-k8czw_b4227919-8c1f-49fe-9d54-7ba139823de9/kube-auth-proxy/0.log"
Jul 16 00:10:49.851041 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:49.851016    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-bmsq7_920f7ba0-96e2-4a6a-aa34-e5ae322bf4be/payload-pre-processing/0.log"
Jul 16 00:10:49.875834 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:49.875810    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-pfjwg_d5c1742f-1db1-4a9a-bca9-ced160cd4e9b/payload-processing/0.log"
Jul 16 00:10:50.569631 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:50.569600    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n2bfn_a82e22d2-37b0-47c0-bf61-e97be360aea0/serve-healthcheck-canary/0.log"
Jul 16 00:10:51.128028 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:51.127998    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q7p4w_f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f/kube-rbac-proxy/0.log"
Jul 16 00:10:51.144505 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:51.144484    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q7p4w_f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f/exporter/0.log"
Jul 16 00:10:51.162522 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:51.162504    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q7p4w_f4ebf79d-eeb3-40b5-afa5-74ddb5ca060f/extractor/0.log"
Jul 16 00:10:53.145536 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:53.145507    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-66nch/perf-node-gather-daemonset-n9qj4"
Jul 16 00:10:53.944244 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:53.944212    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ccf6fdd4-w8h88_551dc737-8443-4379-ba2f-13d7b3066ff9/manager/0.log"
Jul 16 00:10:53.996875 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:53.996853    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ccf6fdd4-w8h88_551dc737-8443-4379-ba2f-13d7b3066ff9/copy-manifests/0.log"
Jul 16 00:10:55.479331 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:55.479308    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-cd598598b-pkw5s_05be4595-447b-4314-a8a0-0e2bc261ce49/manager/0.log"
Jul 16 00:10:57.138793 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:57.138722    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bddb6d9b-k8czw_b4227919-8c1f-49fe-9d54-7ba139823de9/kube-auth-proxy/0.log"
Jul 16 00:10:57.238845 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:57.238820    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-bmsq7_920f7ba0-96e2-4a6a-aa34-e5ae322bf4be/payload-pre-processing/0.log"
Jul 16 00:10:57.260165 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:57.260143    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-pfjwg_d5c1742f-1db1-4a9a-bca9-ced160cd4e9b/payload-processing/0.log"
Jul 16 00:10:58.748070 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:58.748042    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bddb6d9b-k8czw_b4227919-8c1f-49fe-9d54-7ba139823de9/kube-auth-proxy/0.log"
Jul 16 00:10:58.854488 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:58.854463    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-bmsq7_920f7ba0-96e2-4a6a-aa34-e5ae322bf4be/payload-pre-processing/0.log"
Jul 16 00:10:58.874019 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:10:58.873995    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-pfjwg_d5c1742f-1db1-4a9a-bca9-ced160cd4e9b/payload-processing/0.log"
Jul 16 00:11:00.801418 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:11:00.801388    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-2592g_c1390dd1-fb99-4f5d-a2ee-205c999d8e9c/migrator/0.log"
Jul 16 00:11:00.822053 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:11:00.822026    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-2592g_c1390dd1-fb99-4f5d-a2ee-205c999d8e9c/graceful-termination/0.log"
Jul 16 00:11:02.459702 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:11:02.459668    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xn8nk_625740e0-2602-472b-9a17-fd616cddb5fc/kube-multus-additional-cni-plugins/0.log"
Jul 16 00:11:02.476959 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:11:02.476934    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xn8nk_625740e0-2602-472b-9a17-fd616cddb5fc/egress-router-binary-copy/0.log"
Jul 16 00:11:02.494785 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:11:02.494768    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xn8nk_625740e0-2602-472b-9a17-fd616cddb5fc/cni-plugins/0.log"
Jul 16 00:11:02.511545 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:11:02.511526    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xn8nk_625740e0-2602-472b-9a17-fd616cddb5fc/bond-cni-plugin/0.log"
Jul 16 00:11:02.527626 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:11:02.527609    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xn8nk_625740e0-2602-472b-9a17-fd616cddb5fc/routeoverride-cni/0.log"
Jul 16 00:11:02.543942 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:11:02.543926    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xn8nk_625740e0-2602-472b-9a17-fd616cddb5fc/whereabouts-cni-bincopy/0.log"
Jul 16 00:11:02.561511 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:11:02.561492    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xn8nk_625740e0-2602-472b-9a17-fd616cddb5fc/whereabouts-cni/0.log"
Jul 16 00:11:02.590648 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:11:02.590633    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jbldt_be523a77-0668-4774-9cdb-e16840e092db/kube-multus/0.log"
Jul 16 00:11:02.719967 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:11:02.719908    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v68p6_469dc602-e468-466b-84e4-3504671a58c2/network-metrics-daemon/0.log"
Jul 16 00:11:02.735645 ip-10-0-142-22 kubenswrapper[2576]: I0716 00:11:02.735631    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v68p6_469dc602-e468-466b-84e4-3504671a58c2/kube-rbac-proxy/0.log"