Jul 20 22:23:06.599916 ip-10-0-133-74 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 22:23:06.942507 ip-10-0-133-74 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 22:23:06.942507 ip-10-0-133-74 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 22:23:06.942507 ip-10-0-133-74 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 22:23:06.942507 ip-10-0-133-74 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 22:23:06.942507 ip-10-0-133-74 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 22:23:06.943452 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.943335    2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 22:23:06.948801 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948781    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 22:23:06.948801 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948798    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 22:23:06.948801 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948802    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 22:23:06.948893 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948806    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 22:23:06.948893 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948812    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 22:23:06.948893 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948816    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 22:23:06.948893 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948819    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 22:23:06.948893 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948823    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 22:23:06.948893 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948826    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 22:23:06.948893 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948829    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 22:23:06.948893 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948832    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 22:23:06.948893 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948834    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 22:23:06.948893 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948837    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 22:23:06.948893 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948840    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 22:23:06.948893 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948843    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 22:23:06.948893 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948846    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 22:23:06.948893 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948848    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 22:23:06.948893 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948853    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 22:23:06.948893 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948856    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 22:23:06.948893 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948859    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 22:23:06.948893 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948862    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 22:23:06.948893 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948865    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 22:23:06.949330 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948867    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 22:23:06.949330 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948870    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 22:23:06.949330 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948873    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 22:23:06.949330 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948876    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 22:23:06.949330 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948879    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 22:23:06.949330 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948882    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 22:23:06.949330 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948884    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 22:23:06.949330 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948887    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 22:23:06.949330 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948890    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 22:23:06.949330 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948892    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 22:23:06.949330 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948895    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 22:23:06.949330 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948898    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 22:23:06.949330 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948901    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 22:23:06.949330 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948904    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 22:23:06.949330 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948907    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 22:23:06.949330 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948909    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 22:23:06.949330 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948912    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 22:23:06.949330 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948914    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 22:23:06.949330 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948917    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 22:23:06.949330 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948920    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 22:23:06.949821 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948923    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 22:23:06.949821 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948925    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 22:23:06.949821 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948928    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 22:23:06.949821 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948931    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 22:23:06.949821 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948935    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 22:23:06.949821 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948938    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 22:23:06.949821 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948941    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 22:23:06.949821 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948945    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 22:23:06.949821 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948948    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 22:23:06.949821 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948951    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 22:23:06.949821 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948953    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 22:23:06.949821 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948956    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 22:23:06.949821 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948959    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 22:23:06.949821 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948962    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 22:23:06.949821 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948965    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 22:23:06.949821 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948968    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 22:23:06.949821 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948971    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 22:23:06.949821 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948973    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 22:23:06.949821 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948976    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 22:23:06.950271 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948978    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 22:23:06.950271 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948981    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 22:23:06.950271 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948984    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 22:23:06.950271 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948986    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 22:23:06.950271 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948989    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 22:23:06.950271 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948991    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 22:23:06.950271 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948995    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 22:23:06.950271 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.948997    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 22:23:06.950271 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949000    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 22:23:06.950271 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949002    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 22:23:06.950271 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949005    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 22:23:06.950271 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949008    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 22:23:06.950271 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949011    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 22:23:06.950271 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949014    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 22:23:06.950271 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949018    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 22:23:06.950271 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949021    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 22:23:06.950271 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949023    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 22:23:06.950271 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949026    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 22:23:06.950271 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949029    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 22:23:06.950728 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949031    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 22:23:06.950728 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949034    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 22:23:06.950728 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949036    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 22:23:06.950728 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949039    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 22:23:06.950728 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949042    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 22:23:06.950728 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949044    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 22:23:06.950728 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949047    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 22:23:06.950728 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949051    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 22:23:06.950728 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949054    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 22:23:06.950728 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949056    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 22:23:06.950728 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949059    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 22:23:06.950728 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949062    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 22:23:06.950728 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949065    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 22:23:06.950728 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949068    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 22:23:06.950728 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949070    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 22:23:06.950728 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949073    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 22:23:06.950728 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949076    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 22:23:06.950728 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949078    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 22:23:06.950728 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949081    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 22:23:06.950728 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949811    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 22:23:06.951208 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949818    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 22:23:06.951208 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949821    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 22:23:06.951208 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949825    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 22:23:06.951208 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949828    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 22:23:06.951208 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949831    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 22:23:06.951208 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949834    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 22:23:06.951208 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949837    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 22:23:06.951208 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949840    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 22:23:06.951208 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949843    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 22:23:06.951208 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949846    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 22:23:06.951208 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949849    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 22:23:06.951208 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949852    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 22:23:06.951208 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949854    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 22:23:06.951208 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949857    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 22:23:06.951208 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949860    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 22:23:06.951208 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949862    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 22:23:06.951208 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949864    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 22:23:06.951208 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949867    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 22:23:06.951208 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949870    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 22:23:06.951208 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949874    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 22:23:06.951721 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949877    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 22:23:06.951721 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949880    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 22:23:06.951721 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949882    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 22:23:06.951721 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949885    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 22:23:06.951721 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949889    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 22:23:06.951721 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949892    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 22:23:06.951721 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949895    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 22:23:06.951721 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949897    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 22:23:06.951721 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949900    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 22:23:06.951721 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949902    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 22:23:06.951721 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949905    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 22:23:06.951721 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949907    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 22:23:06.951721 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949909    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 22:23:06.951721 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949912    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 22:23:06.951721 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949914    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 22:23:06.951721 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949917    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 22:23:06.951721 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949919    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 22:23:06.951721 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949922    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 22:23:06.951721 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949925    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 22:23:06.951721 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949927    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 22:23:06.952211 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949930    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 22:23:06.952211 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949936    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 22:23:06.952211 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949939    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 22:23:06.952211 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949941    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 22:23:06.952211 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949944    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 22:23:06.952211 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949946    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 22:23:06.952211 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949949    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 22:23:06.952211 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949952    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 22:23:06.952211 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949955    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 22:23:06.952211 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949957    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 22:23:06.952211 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949960    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 22:23:06.952211 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949962    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 22:23:06.952211 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949965    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 22:23:06.952211 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949968    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 22:23:06.952211 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949970    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 22:23:06.952211 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949973    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 22:23:06.952211 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949975    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 22:23:06.952211 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949978    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 22:23:06.952211 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949981    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 22:23:06.952211 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949983    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 22:23:06.952722 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949986    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 22:23:06.952722 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949988    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 22:23:06.952722 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949991    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 22:23:06.952722 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.949997    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 22:23:06.952722 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950000    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 22:23:06.952722 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950004    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 22:23:06.952722 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950009    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 22:23:06.952722 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950012    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 22:23:06.952722 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950015    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 22:23:06.952722 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950018    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 22:23:06.952722 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950020    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 22:23:06.952722 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950023    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 22:23:06.952722 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950026    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 22:23:06.952722 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950028    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 22:23:06.952722 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950032    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 22:23:06.952722 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950035    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 22:23:06.952722 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950038    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 22:23:06.952722 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950041    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 22:23:06.952722 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950043    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 22:23:06.953184 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950046    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 22:23:06.953184 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950048    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 22:23:06.953184 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950051    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 22:23:06.953184 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950055    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 22:23:06.953184 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950059    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 22:23:06.953184 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950062    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 22:23:06.953184 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950065    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 22:23:06.953184 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950067    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 22:23:06.953184 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950070    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 22:23:06.953184 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950072    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 22:23:06.953184 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950075    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 22:23:06.953184 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950077    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 22:23:06.953184 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950080    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 22:23:06.953184 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950082    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 22:23:06.953184 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950085    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 22:23:06.953184 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950087    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 22:23:06.953184 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950090    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 22:23:06.953184 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950092    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 22:23:06.953184 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950095    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 22:23:06.953184 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950509    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 22:23:06.953683 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950515    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 22:23:06.953683 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950518    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 22:23:06.953683 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950520    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 22:23:06.953683 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950523    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 22:23:06.953683 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950526    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 22:23:06.953683 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950529    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 22:23:06.953683 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950531    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 22:23:06.953683 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950539    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 22:23:06.953683 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950541    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 22:23:06.953683 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950544    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 22:23:06.953683 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950547    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 22:23:06.953683 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950550    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 22:23:06.953683 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950552    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 22:23:06.953683 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950555    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 22:23:06.953683 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950558    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 22:23:06.953683 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950560    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 22:23:06.953683 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950564    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 22:23:06.953683 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950567    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 22:23:06.953683 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950569    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 22:23:06.953683 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950572    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 22:23:06.954185 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950575    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 22:23:06.954185 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950577    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 22:23:06.954185 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950580    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 22:23:06.954185 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950582    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 22:23:06.954185 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950585    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 22:23:06.954185 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950588    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 22:23:06.954185 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950590    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 22:23:06.954185 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950593    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 22:23:06.954185 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950595    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 22:23:06.954185 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950598    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 22:23:06.954185 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950600    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 22:23:06.954185 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950603    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 22:23:06.954185 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950620    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 22:23:06.954185 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950623    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 22:23:06.954185 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950626    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 22:23:06.954185 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950628    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 22:23:06.954185 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950631    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 22:23:06.954185 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950634    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 22:23:06.954185 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950638    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 22:23:06.954670 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950644    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 22:23:06.954670 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950648    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 22:23:06.954670 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950651    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 22:23:06.954670 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950655    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 22:23:06.954670 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950657    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 22:23:06.954670 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950661    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 22:23:06.954670 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950665    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 22:23:06.954670 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950668    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 22:23:06.954670 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950671    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 22:23:06.954670 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950675    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 22:23:06.954670 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950677    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 22:23:06.954670 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950680    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 22:23:06.954670 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950683    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 22:23:06.954670 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950686    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 22:23:06.954670 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950690    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 22:23:06.954670 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950693    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 22:23:06.954670 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950695    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 22:23:06.954670 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950698    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 22:23:06.954670 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950700    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 22:23:06.955128 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950703    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 22:23:06.955128 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950706    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 22:23:06.955128 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950708    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 22:23:06.955128 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950711    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 22:23:06.955128 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950713    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 22:23:06.955128 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950716    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 22:23:06.955128 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950719    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 22:23:06.955128 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950721    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 22:23:06.955128 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950724    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 22:23:06.955128 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950726    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 22:23:06.955128 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950730    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 22:23:06.955128 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950734    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 22:23:06.955128 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950737    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 22:23:06.955128 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950742    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 22:23:06.955128 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950745    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 22:23:06.955128 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950748    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 22:23:06.955128 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950751    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 22:23:06.955128 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950754    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 22:23:06.955128 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950756    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 22:23:06.955697 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950759    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 22:23:06.955697 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950761    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 22:23:06.955697 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950764    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 22:23:06.955697 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950767    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 22:23:06.955697 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950769    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 22:23:06.955697 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950772    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 22:23:06.955697 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950774    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 22:23:06.955697 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950777    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 22:23:06.955697 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950779    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 22:23:06.955697 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950782    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 22:23:06.955697 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950785    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 22:23:06.955697 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950787    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 22:23:06.955697 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950790    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 22:23:06.955697 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950793    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 22:23:06.955697 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950795    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 22:23:06.955697 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950798    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 22:23:06.955697 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950800    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 22:23:06.955697 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950803    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 22:23:06.955697 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950805    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 22:23:06.955697 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950808    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.950810    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950895    2556 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950905    2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950913    2556 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950920    2556 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950926    2556 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950932    2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950937    2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950941    2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950945    2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950948    2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950952    2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950956    2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950959    2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950962    2556 flags.go:64] FLAG: --cgroup-root=""
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950965    2556 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950969    2556 flags.go:64] FLAG: --client-ca-file=""
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950972    2556 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950975    2556 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950980    2556 flags.go:64] FLAG: --cluster-domain=""
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950983    2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950986    2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950989    2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 22:23:06.956172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950992    2556 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950996    2556 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.950999    2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951003    2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951006    2556 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951009    2556 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951012    2556 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951015    2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951018    2556 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951021    2556 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951025    2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951028    2556 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951031    2556 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951034    2556 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951037    2556 flags.go:64] FLAG: --enable-server="true"
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951042    2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951046    2556 flags.go:64] FLAG: --event-burst="100"
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951050    2556 flags.go:64] FLAG: --event-qps="50"
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951053    2556 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951056    2556 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951060    2556 flags.go:64] FLAG: --eviction-hard=""
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951063    2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951066    2556 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951070    2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951073    2556 flags.go:64] FLAG: --eviction-soft=""
Jul 20 22:23:06.956795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951076    2556 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 22:23:06.957398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951079    2556 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 22:23:06.957398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951082    2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 22:23:06.957398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951084    2556 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 22:23:06.957398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951087    2556 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 22:23:06.957398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951090    2556 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 22:23:06.957398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951093    2556 flags.go:64] FLAG: --feature-gates=""
Jul 20 22:23:06.957398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951097    2556 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 22:23:06.957398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951100    2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 22:23:06.957398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951103    2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 22:23:06.957398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951106    2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 22:23:06.957398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951109    2556 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 22:23:06.957398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951112    2556 flags.go:64] FLAG: --help="false"
Jul 20 22:23:06.957398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951115    2556 flags.go:64] FLAG: --hostname-override="ip-10-0-133-74.ec2.internal"
Jul 20 22:23:06.957398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951118    2556 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 22:23:06.957398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951121    2556 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 22:23:06.957398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951124    2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 22:23:06.957398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951128    2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 22:23:06.957398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951131    2556 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 22:23:06.957398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951134    2556 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 22:23:06.957398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951137    2556 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 22:23:06.957398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951140    2556 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 22:23:06.957398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951146    2556 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 22:23:06.957398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951149    2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951152    2556 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951155    2556 flags.go:64] FLAG: --kube-reserved=""
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951159    2556 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951162    2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951165    2556 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951168    2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951171    2556 flags.go:64] FLAG: --lock-file=""
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951174    2556 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951177    2556 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951180    2556 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951185    2556 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951188    2556 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951191    2556 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951193    2556 flags.go:64] FLAG: --logging-format="text"
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951196    2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951200    2556 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951202    2556 flags.go:64] FLAG: --manifest-url=""
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951205    2556 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951210    2556 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951213    2556 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951217    2556 flags.go:64] FLAG: --max-pods="110"
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951220    2556 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951224    2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951227    2556 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 22:23:06.958103 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951230    2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951233    2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951236    2556 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951239    2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951247    2556 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951250    2556 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951255    2556 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951258    2556 flags.go:64] FLAG: --pod-cidr=""
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951261    2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951267    2556 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951270    2556 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951275    2556 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951280    2556 flags.go:64] FLAG: --port="10250"
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951285    2556 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951314    2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08ef7913b7a770f67"
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951337    2556 flags.go:64] FLAG: --qos-reserved=""
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951343    2556 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951348    2556 flags.go:64] FLAG: --register-node="true"
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951351    2556 flags.go:64] FLAG: --register-with-taints=""
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951357    2556 flags.go:64] FLAG: --registry-burst="10"
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951361    2556 flags.go:64] FLAG: --registry-qps="5"
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951364    2556 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951368    2556 flags.go:64] FLAG: --reserved-memory=""
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951371    2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951375    2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 22:23:06.958720 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951378    2556 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951381    2556 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951384    2556 flags.go:64] FLAG: --runonce="false"
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951387    2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951391    2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951394    2556 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951397    2556 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951401    2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951404    2556 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951407    2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951411    2556 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951414    2556 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951417    2556 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951419    2556 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951422    2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951426    2556 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951429    2556 flags.go:64] FLAG: --system-cgroups=""
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951432    2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951444    2556 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951448    2556 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951451    2556 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951457    2556 flags.go:64] FLAG: --tls-min-version=""
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951461    2556 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951465    2556 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951468    2556 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 22:23:06.959326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951471    2556 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 22:23:06.959955 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951474    2556 flags.go:64] FLAG: --v="2"
Jul 20 22:23:06.959955 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951479    2556 flags.go:64] FLAG: --version="false"
Jul 20 22:23:06.959955 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951483    2556 flags.go:64] FLAG: --vmodule=""
Jul 20 22:23:06.959955 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951487    2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 22:23:06.959955 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.951491    2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 22:23:06.959955 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951641    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 22:23:06.959955 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951647    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 22:23:06.959955 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951650    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 22:23:06.959955 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951653    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 22:23:06.959955 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951656    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 22:23:06.959955 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951659    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 22:23:06.959955 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951662    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 22:23:06.959955 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951664    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 22:23:06.959955 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951667    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 22:23:06.959955 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951670    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 22:23:06.959955 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951673    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 22:23:06.959955 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951676    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 22:23:06.959955 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951679    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 22:23:06.959955 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951682    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 22:23:06.959955 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951684    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 22:23:06.959955 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951687    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 22:23:06.960497 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951690    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 22:23:06.960497 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951693    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 22:23:06.960497 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951695    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 22:23:06.960497 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951699    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 22:23:06.960497 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951701    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 22:23:06.960497 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951704    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 22:23:06.960497 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951707    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 22:23:06.960497 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951710    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 22:23:06.960497 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951713    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 22:23:06.960497 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951716    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 22:23:06.960497 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951719    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 22:23:06.960497 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951722    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 22:23:06.960497 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951725    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 22:23:06.960497 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951727    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 22:23:06.960497 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951730    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 22:23:06.960497 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951733    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 22:23:06.960497 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951735    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 22:23:06.960497 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951740    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 22:23:06.960497 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951745    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 22:23:06.960497 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951748    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 22:23:06.961019 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951751    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 22:23:06.961019 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951754    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 22:23:06.961019 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951757    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 22:23:06.961019 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951760    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 22:23:06.961019 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951763    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 22:23:06.961019 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951766    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 22:23:06.961019 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951769    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 22:23:06.961019 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951771    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 22:23:06.961019 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951774    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 22:23:06.961019 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951777    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 22:23:06.961019 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951781    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 22:23:06.961019 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951785    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 22:23:06.961019 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951789    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 22:23:06.961019 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951792    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 22:23:06.961019 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951796    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 22:23:06.961019 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951799    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 22:23:06.961019 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951802    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 22:23:06.961019 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951805    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 22:23:06.961019 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951808    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 22:23:06.961483 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951811    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 22:23:06.961483 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951814    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 22:23:06.961483 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951817    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 22:23:06.961483 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951820    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 22:23:06.961483 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951823    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 22:23:06.961483 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951825    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 22:23:06.961483 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951828    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 22:23:06.961483 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951831    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 22:23:06.961483 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951833    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 22:23:06.961483 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951836    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 22:23:06.961483 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951839    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 22:23:06.961483 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951841    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 22:23:06.961483 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951844    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 22:23:06.961483 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951846    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 22:23:06.961483 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951849    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 22:23:06.961483 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951852    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 22:23:06.961483 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951855    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 22:23:06.961483 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951857    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 22:23:06.961483 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951860    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 22:23:06.961964 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951863    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 22:23:06.961964 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951865    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 22:23:06.961964 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951868    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 22:23:06.961964 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951870    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 22:23:06.961964 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951873    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 22:23:06.961964 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951878    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 22:23:06.961964 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951881    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 22:23:06.961964 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951884    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 22:23:06.961964 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951887    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 22:23:06.961964 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951889    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 22:23:06.961964 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951892    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 22:23:06.961964 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951896    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 22:23:06.961964 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951898    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 22:23:06.961964 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951901    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 22:23:06.961964 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951904    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 22:23:06.961964 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951906    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 22:23:06.961964 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951910    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 22:23:06.961964 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951913    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 22:23:06.961964 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951915    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 22:23:06.961964 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951918    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 22:23:06.962437 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951920    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 22:23:06.962437 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951923    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 22:23:06.962437 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951926    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 22:23:06.962437 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951928    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 22:23:06.962437 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.951931    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 22:23:06.962437 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.952409    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 22:23:06.962437 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.958952    2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 22:23:06.962437 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.958969    2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 22:23:06.962437 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.959690    2556 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 22:23:06.962437 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.959701    2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 22:23:06.962437 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959758    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 22:23:06.962437 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959763    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 22:23:06.962437 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959767    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 22:23:06.962437 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959770    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 22:23:06.962437 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959773    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 22:23:06.962816 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959776    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 22:23:06.962816 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959779    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 22:23:06.962816 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959782    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 22:23:06.962816 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959785    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 22:23:06.962816 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959788    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 22:23:06.962816 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959791    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 22:23:06.962816 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959794    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 22:23:06.962816 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959797    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 22:23:06.962816 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959799    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 22:23:06.962816 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959802    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 22:23:06.962816 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959805    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 22:23:06.962816 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959809    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 22:23:06.962816 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959813    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 22:23:06.962816 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959816    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 22:23:06.962816 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959819    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 22:23:06.962816 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959822    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 22:23:06.962816 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959825    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 22:23:06.962816 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959828    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 22:23:06.962816 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959831    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 22:23:06.963267 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959834    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 22:23:06.963267 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959836    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 22:23:06.963267 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959839    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 22:23:06.963267 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959843    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 22:23:06.963267 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959846    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 22:23:06.963267 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959849    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 22:23:06.963267 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959853    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 22:23:06.963267 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959855    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 22:23:06.963267 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959858    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 22:23:06.963267 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959861    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 22:23:06.963267 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959863    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 22:23:06.963267 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959866    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 22:23:06.963267 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959868    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 22:23:06.963267 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959871    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 22:23:06.963267 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959873    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 22:23:06.963267 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959876    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 22:23:06.963267 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959879    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 22:23:06.963267 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959881    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 22:23:06.963267 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959884    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 22:23:06.963267 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959886    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 22:23:06.963873 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959889    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 22:23:06.963873 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959891    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 22:23:06.963873 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959894    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 22:23:06.963873 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959896    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 22:23:06.963873 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959899    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 22:23:06.963873 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959901    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 22:23:06.963873 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959904    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 22:23:06.963873 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959907    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 22:23:06.963873 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959909    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 22:23:06.963873 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959911    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 22:23:06.963873 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959914    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 22:23:06.963873 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959917    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 22:23:06.963873 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959919    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 22:23:06.963873 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959922    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 22:23:06.963873 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959924    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 22:23:06.963873 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959927    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 22:23:06.963873 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959930    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 22:23:06.963873 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959933    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 22:23:06.963873 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959936    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 22:23:06.963873 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959939    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 22:23:06.964359 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959941    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 22:23:06.964359 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959944    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 22:23:06.964359 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959946    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 22:23:06.964359 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959949    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 22:23:06.964359 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959951    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 22:23:06.964359 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959954    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 22:23:06.964359 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959956    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 22:23:06.964359 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959959    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 22:23:06.964359 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959962    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 22:23:06.964359 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959965    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 22:23:06.964359 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959968    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 22:23:06.964359 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959970    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 22:23:06.964359 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959973    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 22:23:06.964359 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959975    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 22:23:06.964359 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959978    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 22:23:06.964359 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959981    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 22:23:06.964359 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959983    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 22:23:06.964359 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959986    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 22:23:06.964359 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959988    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 22:23:06.964359 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959991    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 22:23:06.964867 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959995    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 22:23:06.964867 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.959998    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 22:23:06.964867 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960002    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 22:23:06.964867 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960006    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 22:23:06.964867 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960010    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 22:23:06.964867 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960013    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 22:23:06.964867 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960016    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 22:23:06.964867 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960019    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 22:23:06.964867 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960022    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 22:23:06.964867 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960025    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 22:23:06.964867 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960028    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 22:23:06.964867 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960031    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 22:23:06.964867 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960033    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 22:23:06.964867 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960036    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 22:23:06.964867 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960038    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 22:23:06.965223 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.960043    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 22:23:06.965223 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960160    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 22:23:06.965223 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960164    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 22:23:06.965223 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960168    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 22:23:06.965223 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960171    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 22:23:06.965223 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960173    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 22:23:06.965223 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960176    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 22:23:06.965223 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960179    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 22:23:06.965223 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960182    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 22:23:06.965223 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960185    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 22:23:06.965223 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960188    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 22:23:06.965223 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960191    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 22:23:06.965223 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960194    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 22:23:06.965223 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960197    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 22:23:06.965567 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960200    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 22:23:06.965567 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960203    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 22:23:06.965567 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960205    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 22:23:06.965567 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960208    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 22:23:06.965567 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960210    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 22:23:06.965567 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960213    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 22:23:06.965567 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960215    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 22:23:06.965567 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960218    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 22:23:06.965567 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960220    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 22:23:06.965567 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960223    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 22:23:06.965567 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960226    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 22:23:06.965567 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960228    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 22:23:06.965567 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960232    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 22:23:06.965567 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960237    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 22:23:06.965567 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960240    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 22:23:06.965567 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960243    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 22:23:06.965567 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960245    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 22:23:06.965567 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960248    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 22:23:06.965567 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960251    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 22:23:06.966033 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960253    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 22:23:06.966033 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960256    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 22:23:06.966033 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960260    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 22:23:06.966033 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960263    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 22:23:06.966033 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960266    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 22:23:06.966033 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960269    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 22:23:06.966033 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960272    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 22:23:06.966033 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960274    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 22:23:06.966033 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960277    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 22:23:06.966033 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960279    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 22:23:06.966033 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960282    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 22:23:06.966033 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960285    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 22:23:06.966033 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960287    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 22:23:06.966033 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960290    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 22:23:06.966033 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960292    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 22:23:06.966033 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960295    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 22:23:06.966033 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960297    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 22:23:06.966033 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960300    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 22:23:06.966033 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960302    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 22:23:06.966484 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960305    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 22:23:06.966484 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960307    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 22:23:06.966484 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960309    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 22:23:06.966484 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960312    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 22:23:06.966484 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960315    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 22:23:06.966484 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960317    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 22:23:06.966484 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960320    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 22:23:06.966484 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960323    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 22:23:06.966484 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960326    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 22:23:06.966484 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960329    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 22:23:06.966484 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960332    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 22:23:06.966484 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960343    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 22:23:06.966484 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960346    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 22:23:06.966484 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960349    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 22:23:06.966484 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960351    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 22:23:06.966484 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960354    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 22:23:06.966484 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960357    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 22:23:06.966484 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960359    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 22:23:06.966484 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960362    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 22:23:06.966484 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960364    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 22:23:06.966980 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960367    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 22:23:06.966980 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960369    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 22:23:06.966980 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960372    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 22:23:06.966980 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960374    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 22:23:06.966980 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960377    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 22:23:06.966980 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960379    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 22:23:06.966980 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960382    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 22:23:06.966980 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960385    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 22:23:06.966980 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960387    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 22:23:06.966980 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960390    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 22:23:06.966980 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960392    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 22:23:06.966980 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960395    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 22:23:06.966980 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960397    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 22:23:06.966980 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960399    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 22:23:06.966980 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960402    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 22:23:06.966980 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960405    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 22:23:06.966980 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960408    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 22:23:06.966980 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960410    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 22:23:06.966980 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960413    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 22:23:06.966980 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960416    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 22:23:06.967444 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960419    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 22:23:06.967444 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960422    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 22:23:06.967444 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960425    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 22:23:06.967444 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960428    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 22:23:06.967444 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960430    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 22:23:06.967444 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960433    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 22:23:06.967444 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960435    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 22:23:06.967444 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:06.960439    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 22:23:06.967444 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.960445    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 22:23:06.967444 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.960562    2556 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 22:23:06.967444 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.964250    2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 22:23:06.967444 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.965373    2556 server.go:1019] "Starting client certificate rotation"
Jul 20 22:23:06.967444 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.965476    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 22:23:06.967783 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.965518    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 22:23:06.967783 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.967503    2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 22:23:06.970931 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.970912    2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 22:23:06.980737 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.980716    2556 log.go:25] "Validated CRI v1 runtime API"
Jul 20 22:23:06.982687 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.982672    2556 log.go:25] "Validated CRI v1 image API"
Jul 20 22:23:06.984777 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.984755    2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 22:23:06.987023 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.987002    2556 fs.go:135] Filesystem UUIDs: map[1cc642c4-abdf-40ba-a8cd-fecbf2c50be5:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7d48a37f-6c0e-4df5-a838-d5c986b7aab2:/dev/nvme0n1p4]
Jul 20 22:23:06.987109 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.987021    2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 22:23:06.991983 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.991865    2556 manager.go:216] Machine: {Timestamp:2026-07-20 22:23:06.990646463 +0000 UTC m=+0.288863044 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097371 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2587c1cdddd8d67cf68118f25e3a2d SystemUUID:ec2587c1-cddd-d8d6-7cf6-8118f25e3a2d BootID:a3c8c198-4bee-41fc-9f87-e9d4010d1b79 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cb:24:02:ed:c9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cb:24:02:ed:c9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:28:e0:73:de:72 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 22:23:06.991983 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.991978    2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 22:23:06.992087 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.992067    2556 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 22:23:06.994752 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.994724    2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 22:23:06.994892 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.994756    2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-74.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 22:23:06.995199 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.995185    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 22:23:06.995376 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.995365    2556 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 22:23:06.995408 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.995379    2556 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 22:23:06.995408 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.995387    2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 22:23:06.995971 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.995960    2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 22:23:06.997117 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:06.997107    2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 22:23:07.000122 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.000111    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 22:23:07.000242 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.000232    2556 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 22:23:07.000287 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.000261    2556 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 22:23:07.000287 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.000271    2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 22:23:07.000287 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.000284    2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 22:23:07.000415 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.000293    2556 kubelet.go:398] "Adding apiserver pod source"
Jul 20 22:23:07.000415 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.000303    2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 22:23:07.000717 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.000704    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 22:23:07.000785 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.000727    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 22:23:07.002644 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.002582    2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 22:23:07.004355 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.004332    2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 22:23:07.004420 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.004370    2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 22:23:07.005280 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.005266    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 22:23:07.005326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.005286    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 22:23:07.005326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.005292    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 22:23:07.005326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.005297    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 22:23:07.005326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.005306    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 22:23:07.005326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.005311    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 22:23:07.005326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.005319    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 22:23:07.005326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.005325    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 22:23:07.005514 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.005332    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 22:23:07.005514 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.005338    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 22:23:07.005514 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.005346    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 22:23:07.005514 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.005351    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 22:23:07.006684 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.006662    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 22:23:07.006684 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.006685    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 22:23:07.009965 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.009950    2556 server.go:1268] "Started kubelet"
Jul 20 22:23:07.010092 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.010055    2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 22:23:07.010181 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.010059    2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 22:23:07.010422 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.010408    2556 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 22:23:07.011462 ip-10-0-133-74 systemd[1]: Started Kubernetes Kubelet.
Jul 20 22:23:07.012193 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.012175    2556 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 22:23:07.012292 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.012204    2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 22:23:07.014854 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:07.014533    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 22:23:07.015225 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:07.015182    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-74.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 22:23:07.016253 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.015782    2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-74.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 22:23:07.017511 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:07.017479    2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 22:23:07.018602 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:07.016422    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-74.ec2.internal.18c41fae93cb9809  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-74.ec2.internal,UID:ip-10-0-133-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-74.ec2.internal,},FirstTimestamp:2026-07-20 22:23:07.009923081 +0000 UTC m=+0.308139642,LastTimestamp:2026-07-20 22:23:07.009923081 +0000 UTC m=+0.308139642,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-74.ec2.internal,}"
Jul 20 22:23:07.019786 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.019768    2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 22:23:07.019846 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.019782    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 22:23:07.019900 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:07.019864    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-74.ec2.internal\" not found"
Jul 20 22:23:07.020658 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.020330    2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 22:23:07.021189 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.021162    2556 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 22:23:07.021189 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.021190    2556 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 22:23:07.021362 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.021347    2556 factory.go:55] Registering systemd factory
Jul 20 22:23:07.021972 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.021956    2556 factory.go:223] Registration of the systemd container factory successfully
Jul 20 22:23:07.022097 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.021846    2556 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 22:23:07.022222 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.022172    2556 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 22:23:07.022519 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.022427    2556 factory.go:153] Registering CRI-O factory
Jul 20 22:23:07.022519 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.022443    2556 factory.go:223] Registration of the crio container factory successfully
Jul 20 22:23:07.022519 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.022506    2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 22:23:07.022676 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.022565    2556 factory.go:103] Registering Raw factory
Jul 20 22:23:07.022676 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.022581    2556 manager.go:1196] Started watching for new ooms in manager
Jul 20 22:23:07.023343 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.023329    2556 manager.go:349] Starting recovery of all containers
Jul 20 22:23:07.024440 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:07.024403    2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-74.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 20 22:23:07.024440 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:07.024420    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 20 22:23:07.030113 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.030063    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 22:23:07.031775 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.031626    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nf68q"
Jul 20 22:23:07.033763 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.033595    2556 manager.go:354] Recovery completed
Jul 20 22:23:07.037784 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.037767    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 22:23:07.037901 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.037885    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nf68q"
Jul 20 22:23:07.041082 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.041059    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 22:23:07.041175 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.041100    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 22:23:07.041175 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.041112    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientPID"
Jul 20 22:23:07.041618 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.041588    2556 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 22:23:07.041685 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.041622    2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 22:23:07.041685 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.041640    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 22:23:07.041685 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.041643    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 22:23:07.042729 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.042715    2556 policy_none.go:49] "None policy: Start"
Jul 20 22:23:07.042787 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.042736    2556 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 22:23:07.042787 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.042749    2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 22:23:07.043306 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:07.043243    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-74.ec2.internal.18c41fae95a7082b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-74.ec2.internal,UID:ip-10-0-133-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-74.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-74.ec2.internal,},FirstTimestamp:2026-07-20 22:23:07.041081387 +0000 UTC m=+0.339297955,LastTimestamp:2026-07-20 22:23:07.041081387 +0000 UTC m=+0.339297955,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-74.ec2.internal,}"
Jul 20 22:23:07.043675 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.043663    2556 policy_none.go:47] "Start"
Jul 20 22:23:07.044233 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.044217    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 22:23:07.044233 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.044242    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 22:23:07.044367 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.044252    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientPID"
Jul 20 22:23:07.081211 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.081188    2556 manager.go:337] "Starting Device Plugin manager"
Jul 20 22:23:07.081319 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:07.081221    2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 22:23:07.081319 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.081231    2556 server.go:87] "Starting device plugin registration server"
Jul 20 22:23:07.081516 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.081505    2556 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 22:23:07.081554 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.081520    2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 22:23:07.081673 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.081652    2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 22:23:07.081793 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.081741    2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 22:23:07.081793 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.081748    2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 22:23:07.082307 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:07.082282    2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 22:23:07.082354 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:07.082337    2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-74.ec2.internal\" not found"
Jul 20 22:23:07.182204 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.182166    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 22:23:07.183854 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.183178    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 22:23:07.183854 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.183206    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 22:23:07.183854 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.183217    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientPID"
Jul 20 22:23:07.183854 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.183251    2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-74.ec2.internal"
Jul 20 22:23:07.191741 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.191722    2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-74.ec2.internal"
Jul 20 22:23:07.191786 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:07.191749    2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-74.ec2.internal\": node \"ip-10-0-133-74.ec2.internal\" not found"
Jul 20 22:23:07.200090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.200024    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 22:23:07.200090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.200070    2556 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 22:23:07.200252 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.200093    2556 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 22:23:07.200252 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:07.200135    2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 22:23:07.201970 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.201952    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 22:23:07.209371 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:07.209353    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-74.ec2.internal\" not found"
Jul 20 22:23:07.300705 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.300662    2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-74.ec2.internal"]
Jul 20 22:23:07.300884 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.300794    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 22:23:07.301832 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.301803    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 22:23:07.301945 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.301838    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 22:23:07.301945 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.301856    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientPID"
Jul 20 22:23:07.303679 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.303667    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 22:23:07.303842 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.303827    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal"
Jul 20 22:23:07.303882 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.303861    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 22:23:07.304423 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.304405    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 22:23:07.304527 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.304426    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 22:23:07.304527 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.304436    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 22:23:07.304527 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.304451    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientPID"
Jul 20 22:23:07.304527 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.304452    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 22:23:07.304527 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.304470    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientPID"
Jul 20 22:23:07.306224 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.306207    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-74.ec2.internal"
Jul 20 22:23:07.306309 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.306237    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 22:23:07.306912 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.306891    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 22:23:07.306998 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.306921    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 22:23:07.306998 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.306935    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeHasSufficientPID"
Jul 20 22:23:07.309488 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:07.309475    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-74.ec2.internal\" not found"
Jul 20 22:23:07.324692 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.324668    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a82db344e86a6ac15add14bc18023b45-config\") pod \"kube-apiserver-proxy-ip-10-0-133-74.ec2.internal\" (UID: \"a82db344e86a6ac15add14bc18023b45\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-74.ec2.internal"
Jul 20 22:23:07.324806 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.324694    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d7523d4f36035ceb479de8b93d22fb2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal\" (UID: \"9d7523d4f36035ceb479de8b93d22fb2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal"
Jul 20 22:23:07.324806 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.324713    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d7523d4f36035ceb479de8b93d22fb2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal\" (UID: \"9d7523d4f36035ceb479de8b93d22fb2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal"
Jul 20 22:23:07.334548 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:07.334525    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-74.ec2.internal\" not found" node="ip-10-0-133-74.ec2.internal"
Jul 20 22:23:07.339079 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:07.339061    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-74.ec2.internal\" not found" node="ip-10-0-133-74.ec2.internal"
Jul 20 22:23:07.409599 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:07.409557    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-74.ec2.internal\" not found"
Jul 20 22:23:07.425680 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.425648    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d7523d4f36035ceb479de8b93d22fb2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal\" (UID: \"9d7523d4f36035ceb479de8b93d22fb2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal"
Jul 20 22:23:07.425680 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.425680    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d7523d4f36035ceb479de8b93d22fb2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal\" (UID: \"9d7523d4f36035ceb479de8b93d22fb2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal"
Jul 20 22:23:07.425837 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.425697    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a82db344e86a6ac15add14bc18023b45-config\") pod \"kube-apiserver-proxy-ip-10-0-133-74.ec2.internal\" (UID: \"a82db344e86a6ac15add14bc18023b45\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-74.ec2.internal"
Jul 20 22:23:07.425837 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.425742    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a82db344e86a6ac15add14bc18023b45-config\") pod \"kube-apiserver-proxy-ip-10-0-133-74.ec2.internal\" (UID: \"a82db344e86a6ac15add14bc18023b45\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-74.ec2.internal"
Jul 20 22:23:07.425837 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.425776    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d7523d4f36035ceb479de8b93d22fb2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal\" (UID: \"9d7523d4f36035ceb479de8b93d22fb2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal"
Jul 20 22:23:07.425837 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.425776    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d7523d4f36035ceb479de8b93d22fb2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal\" (UID: \"9d7523d4f36035ceb479de8b93d22fb2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal"
Jul 20 22:23:07.510275 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:07.510188    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-74.ec2.internal\" not found"
Jul 20 22:23:07.610742 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:07.610712    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-74.ec2.internal\" not found"
Jul 20 22:23:07.637195 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.637158    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal"
Jul 20 22:23:07.641740 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.641556    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-74.ec2.internal"
Jul 20 22:23:07.711029 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:07.710991    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-74.ec2.internal\" not found"
Jul 20 22:23:07.811652 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:07.811552    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-74.ec2.internal\" not found"
Jul 20 22:23:07.880258 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.880229    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 22:23:07.920125 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.920094    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-74.ec2.internal"
Jul 20 22:23:07.932641 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.932619    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 22:23:07.934396 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.934382    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal"
Jul 20 22:23:07.946555 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.946536    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 22:23:07.964715 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.964691    2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 22:23:07.964869 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.964839    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 22:23:07.964981 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:07.964875    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 22:23:08.001041 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.001013    2556 apiserver.go:52] "Watching apiserver"
Jul 20 22:23:08.018055 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.018030    2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 22:23:08.018360 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.018339    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-dl7kw","kube-system/kube-apiserver-proxy-ip-10-0-133-74.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k","openshift-cluster-node-tuning-operator/tuned-2ll4h","openshift-dns/node-resolver-llqcs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal","openshift-multus/multus-additional-cni-plugins-8clnl","openshift-multus/network-metrics-daemon-f5458","openshift-network-diagnostics/network-check-target-295rv","kube-system/global-pull-secret-syncer-465x2","kube-system/konnectivity-agent-drz7d","openshift-image-registry/node-ca-55kwx","openshift-multus/multus-fm4hh","openshift-network-operator/iptables-alerter-fkbrm"]
Jul 20 22:23:08.020493 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.020467    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 22:23:08.020622 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.020574    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-drz7d"
Jul 20 22:23:08.022839 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.022819    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fkbrm"
Jul 20 22:23:08.023141 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.023118    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 22:23:08.023203 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.023185    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 22:23:08.023242 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.023203    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r257t\""
Jul 20 22:23:08.024790 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.024768    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k"
Jul 20 22:23:08.025957 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.025891    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 22:23:08.026117 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.026087    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8lk9t\""
Jul 20 22:23:08.026207 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.026146    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 22:23:08.026589 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.026559    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 22:23:08.028185 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.028165    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.028436 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.028288    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 22:23:08.028436 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.028392    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97ba3d80-72ae-44da-aef4-4b89d829cfa7-host-slash\") pod \"iptables-alerter-fkbrm\" (UID: \"97ba3d80-72ae-44da-aef4-4b89d829cfa7\") " pod="openshift-network-operator/iptables-alerter-fkbrm"
Jul 20 22:23:08.028436 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.028428    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxgc6\" (UniqueName: \"kubernetes.io/projected/97ba3d80-72ae-44da-aef4-4b89d829cfa7-kube-api-access-kxgc6\") pod \"iptables-alerter-fkbrm\" (UID: \"97ba3d80-72ae-44da-aef4-4b89d829cfa7\") " pod="openshift-network-operator/iptables-alerter-fkbrm"
Jul 20 22:23:08.028642 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.028460    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e744ff96-be0e-4270-8947-0410e17b97fd-agent-certs\") pod \"konnectivity-agent-drz7d\" (UID: \"e744ff96-be0e-4270-8947-0410e17b97fd\") " pod="kube-system/konnectivity-agent-drz7d"
Jul 20 22:23:08.028642 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.028486    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e744ff96-be0e-4270-8947-0410e17b97fd-konnectivity-ca\") pod \"konnectivity-agent-drz7d\" (UID: \"e744ff96-be0e-4270-8947-0410e17b97fd\") " pod="kube-system/konnectivity-agent-drz7d"
Jul 20 22:23:08.028642 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.028512    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97ba3d80-72ae-44da-aef4-4b89d829cfa7-iptables-alerter-script\") pod \"iptables-alerter-fkbrm\" (UID: \"97ba3d80-72ae-44da-aef4-4b89d829cfa7\") " pod="openshift-network-operator/iptables-alerter-fkbrm"
Jul 20 22:23:08.029388 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.029371    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 22:23:08.029498 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.029484    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-njxxd\""
Jul 20 22:23:08.030280 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.030266    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-llqcs"
Jul 20 22:23:08.032219 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.032203    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.032443 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.032420    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 22:23:08.032660 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.032645    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 22:23:08.032740 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.032683    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 22:23:08.032890 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.032877    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 22:23:08.032930 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.032906    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 22:23:08.034190 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.034173    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.036208 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.036190    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:08.036299 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:08.036271    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:08.037282 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.036916    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 22:23:08.037282 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.036962    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 22:23:08.037282 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.036966    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v8ljg\""
Jul 20 22:23:08.037282 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.037140    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 22:23:08.037282 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.037215    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 22:23:08.037517 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.037394    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 22:23:08.037517 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.037445    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8k49j\""
Jul 20 22:23:08.037517 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.037459    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 22:23:08.037517 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.037448    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 22:23:08.037739 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.037394    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q9bz7\""
Jul 20 22:23:08.037818 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.037801    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tpc5w\""
Jul 20 22:23:08.037873 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.037809    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 22:23:08.037873 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.037855    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 22:23:08.037873 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.037870    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 22:23:08.038321 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.038306    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-55kwx"
Jul 20 22:23:08.039030 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.039013    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 22:23:08.040473 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.040455    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k4rjq\""
Jul 20 22:23:08.040578 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.040523    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 22:23:08.040676 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.040588    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 22:23:08.040676 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.040649    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.040927 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.040911    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 22:23:08.041657 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.041599    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 22:18:07 +0000 UTC" deadline="2028-03-14 22:09:21.293608405 +0000 UTC"
Jul 20 22:23:08.041711 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.041657    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14471h46m13.251953861s"
Jul 20 22:23:08.042546 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.042525    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 22:23:08.042762 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.042748    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 22:23:08.042831 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.042819    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-k8c86\""
Jul 20 22:23:08.042971 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.042958    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:08.043049 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:08.043030    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:08.044891 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.044876    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:08.044957 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:08.044927    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:08.059804 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.059786    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5kgkm"
Jul 20 22:23:08.067836 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.067794    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5kgkm"
Jul 20 22:23:08.121690 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.121665    2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 22:23:08.128691 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.128662    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv6s4\" (UniqueName: \"kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4\") pod \"network-check-target-295rv\" (UID: \"da300f87-f427-4da6-b75c-9acd5d86b32f\") " pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:08.128813 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.128709    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxgc6\" (UniqueName: \"kubernetes.io/projected/97ba3d80-72ae-44da-aef4-4b89d829cfa7-kube-api-access-kxgc6\") pod \"iptables-alerter-fkbrm\" (UID: \"97ba3d80-72ae-44da-aef4-4b89d829cfa7\") " pod="openshift-network-operator/iptables-alerter-fkbrm"
Jul 20 22:23:08.128813 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.128738    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-host-kubelet\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.128813 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.128785    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.128935 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.128824    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-ovnkube-script-lib\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.128935 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.128854    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-etc-kubernetes\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.128935 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.128882    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d260a4c0-32d5-44b7-8c4e-bd71ee42e34e-device-dir\") pod \"aws-ebs-csi-driver-node-9hh8k\" (UID: \"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k"
Jul 20 22:23:08.128935 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.128910    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-etc-openvswitch\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.129080 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.128938    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dtxf\" (UniqueName: \"kubernetes.io/projected/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-kube-api-access-2dtxf\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.129080 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.128966    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-host-run-k8s-cni-cncf-io\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.129080 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.128993    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-host-run-netns\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.129080 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129019    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-host-var-lib-cni-bin\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.129080 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129062    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-var-lib-kubelet\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.129282 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129100    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d260a4c0-32d5-44b7-8c4e-bd71ee42e34e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9hh8k\" (UID: \"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k"
Jul 20 22:23:08.129282 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129124    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d260a4c0-32d5-44b7-8c4e-bd71ee42e34e-socket-dir\") pod \"aws-ebs-csi-driver-node-9hh8k\" (UID: \"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k"
Jul 20 22:23:08.129282 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129150    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-ovnkube-config\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.129282 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129186    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-etc-systemd\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.129282 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129220    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d260a4c0-32d5-44b7-8c4e-bd71ee42e34e-etc-selinux\") pod \"aws-ebs-csi-driver-node-9hh8k\" (UID: \"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k"
Jul 20 22:23:08.129282 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129249    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sng5t\" (UniqueName: \"kubernetes.io/projected/cbfdd4e1-476f-4dbb-b7de-51d307901a3f-kube-api-access-sng5t\") pod \"node-resolver-llqcs\" (UID: \"cbfdd4e1-476f-4dbb-b7de-51d307901a3f\") " pod="openshift-dns/node-resolver-llqcs"
Jul 20 22:23:08.129282 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129277    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db2f1fd2-ec2a-4826-95de-24577a40fdf0-kubelet-config\") pod \"global-pull-secret-syncer-465x2\" (UID: \"db2f1fd2-ec2a-4826-95de-24577a40fdf0\") " pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:08.129562 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129310    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret\") pod \"global-pull-secret-syncer-465x2\" (UID: \"db2f1fd2-ec2a-4826-95de-24577a40fdf0\") " pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:08.129562 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129347    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-host-run-netns\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.129562 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129384    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-run-openvswitch\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.129562 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129412    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.129562 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129436    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee8ea194-33c5-4952-ad19-541828d1c720-tmp\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.129562 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129458    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsvwz\" (UniqueName: \"kubernetes.io/projected/ee8ea194-33c5-4952-ad19-541828d1c720-kube-api-access-lsvwz\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.129562 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129497    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-var-lib-openvswitch\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.129562 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129516    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.129562 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129549    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97ba3d80-72ae-44da-aef4-4b89d829cfa7-iptables-alerter-script\") pod \"iptables-alerter-fkbrm\" (UID: \"97ba3d80-72ae-44da-aef4-4b89d829cfa7\") " pod="openshift-network-operator/iptables-alerter-fkbrm"
Jul 20 22:23:08.129927 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129577    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-multus-conf-dir\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.129927 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129599    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-host-run-multus-certs\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.129927 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129635    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-etc-sysctl-d\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.129927 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129656    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-run\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.129927 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129711    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-host\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.129927 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129743    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbfdd4e1-476f-4dbb-b7de-51d307901a3f-tmp-dir\") pod \"node-resolver-llqcs\" (UID: \"cbfdd4e1-476f-4dbb-b7de-51d307901a3f\") " pod="openshift-dns/node-resolver-llqcs"
Jul 20 22:23:08.129927 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129766    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-cnibin\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.129927 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129789    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a37a744-9bdb-4257-99b9-dccada162ae2-multus-daemon-config\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.129927 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129817    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e744ff96-be0e-4270-8947-0410e17b97fd-konnectivity-ca\") pod \"konnectivity-agent-drz7d\" (UID: \"e744ff96-be0e-4270-8947-0410e17b97fd\") " pod="kube-system/konnectivity-agent-drz7d"
Jul 20 22:23:08.129927 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129840    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-system-cni-dir\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.129927 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129893    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-host-var-lib-cni-multus\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.129927 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129931    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d260a4c0-32d5-44b7-8c4e-bd71ee42e34e-sys-fs\") pod \"aws-ebs-csi-driver-node-9hh8k\" (UID: \"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k"
Jul 20 22:23:08.130540 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129960    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-node-log\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.130540 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.129995    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-host-cni-netd\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.130540 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130031    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d89g\" (UniqueName: \"kubernetes.io/projected/5a37a744-9bdb-4257-99b9-dccada162ae2-kube-api-access-4d89g\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.130540 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130057    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-cnibin\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.130540 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130074    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cbfdd4e1-476f-4dbb-b7de-51d307901a3f-hosts-file\") pod \"node-resolver-llqcs\" (UID: \"cbfdd4e1-476f-4dbb-b7de-51d307901a3f\") " pod="openshift-dns/node-resolver-llqcs"
Jul 20 22:23:08.130540 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130101    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-multus-socket-dir-parent\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.130540 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130129    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcr4m\" (UniqueName: \"kubernetes.io/projected/7628eb97-7435-415a-bfa4-6cb8bbede73b-kube-api-access-tcr4m\") pod \"node-ca-55kwx\" (UID: \"7628eb97-7435-415a-bfa4-6cb8bbede73b\") " pod="openshift-image-registry/node-ca-55kwx"
Jul 20 22:23:08.130540 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130144    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-etc-modprobe-d\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.130540 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130159    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-etc-sysconfig\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.130540 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130159    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97ba3d80-72ae-44da-aef4-4b89d829cfa7-iptables-alerter-script\") pod \"iptables-alerter-fkbrm\" (UID: \"97ba3d80-72ae-44da-aef4-4b89d829cfa7\") " pod="openshift-network-operator/iptables-alerter-fkbrm"
Jul 20 22:23:08.130540 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130172    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-systemd-units\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.130540 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130188    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-run-ovn\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.130540 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130202    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-env-overrides\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.130540 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130237    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.130540 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130265    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e744ff96-be0e-4270-8947-0410e17b97fd-agent-certs\") pod \"konnectivity-agent-drz7d\" (UID: \"e744ff96-be0e-4270-8947-0410e17b97fd\") " pod="kube-system/konnectivity-agent-drz7d"
Jul 20 22:23:08.130540 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130287    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-log-socket\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.130540 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130354    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e744ff96-be0e-4270-8947-0410e17b97fd-konnectivity-ca\") pod \"konnectivity-agent-drz7d\" (UID: \"e744ff96-be0e-4270-8947-0410e17b97fd\") " pod="kube-system/konnectivity-agent-drz7d"
Jul 20 22:23:08.131231 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130369    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-multus-cni-dir\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.131231 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130389    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-os-release\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.131231 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130422    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-os-release\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.131231 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130449    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-lib-modules\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.131231 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130466    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-host-run-ovn-kubernetes\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.131231 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130488    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-ovn-node-metrics-cert\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.131231 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130506    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-hostroot\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.131231 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130522    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7628eb97-7435-415a-bfa4-6cb8bbede73b-host\") pod \"node-ca-55kwx\" (UID: \"7628eb97-7435-415a-bfa4-6cb8bbede73b\") " pod="openshift-image-registry/node-ca-55kwx"
Jul 20 22:23:08.131231 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130532    2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 22:23:08.131231 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130539    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-host-slash\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.131231 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130571    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-host-var-lib-kubelet\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.131231 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130585    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-etc-kubernetes\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.131231 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130623    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8zlq\" (UniqueName: \"kubernetes.io/projected/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-kube-api-access-s8zlq\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.131231 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130647    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-sys\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.131231 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130681    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ee8ea194-33c5-4952-ad19-541828d1c720-etc-tuned\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.131231 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130719    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d260a4c0-32d5-44b7-8c4e-bd71ee42e34e-registration-dir\") pod \"aws-ebs-csi-driver-node-9hh8k\" (UID: \"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k"
Jul 20 22:23:08.131231 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130735    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db2f1fd2-ec2a-4826-95de-24577a40fdf0-dbus\") pod \"global-pull-secret-syncer-465x2\" (UID: \"db2f1fd2-ec2a-4826-95de-24577a40fdf0\") " pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:08.131813 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130756    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97ba3d80-72ae-44da-aef4-4b89d829cfa7-host-slash\") pod \"iptables-alerter-fkbrm\" (UID: \"97ba3d80-72ae-44da-aef4-4b89d829cfa7\") " pod="openshift-network-operator/iptables-alerter-fkbrm"
Jul 20 22:23:08.131813 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130771    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-run-systemd\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.131813 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130809    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97ba3d80-72ae-44da-aef4-4b89d829cfa7-host-slash\") pod \"iptables-alerter-fkbrm\" (UID: \"97ba3d80-72ae-44da-aef4-4b89d829cfa7\") " pod="openshift-network-operator/iptables-alerter-fkbrm"
Jul 20 22:23:08.131813 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130808    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-host-cni-bin\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.131813 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130836    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a37a744-9bdb-4257-99b9-dccada162ae2-cni-binary-copy\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.131813 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130872    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-cni-binary-copy\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.131813 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130898    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-etc-sysctl-conf\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.131813 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130928    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlqwx\" (UniqueName: \"kubernetes.io/projected/d260a4c0-32d5-44b7-8c4e-bd71ee42e34e-kube-api-access-xlqwx\") pod \"aws-ebs-csi-driver-node-9hh8k\" (UID: \"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k"
Jul 20 22:23:08.131813 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130968    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs\") pod \"network-metrics-daemon-f5458\" (UID: \"5aa2732a-c080-4b95-af51-91052aeb9be2\") " pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:08.131813 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.130995    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-system-cni-dir\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.131813 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.131019    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7628eb97-7435-415a-bfa4-6cb8bbede73b-serviceca\") pod \"node-ca-55kwx\" (UID: \"7628eb97-7435-415a-bfa4-6cb8bbede73b\") " pod="openshift-image-registry/node-ca-55kwx"
Jul 20 22:23:08.131813 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.131053    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d28r\" (UniqueName: \"kubernetes.io/projected/5aa2732a-c080-4b95-af51-91052aeb9be2-kube-api-access-7d28r\") pod \"network-metrics-daemon-f5458\" (UID: \"5aa2732a-c080-4b95-af51-91052aeb9be2\") " pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:08.133474 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.133460    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e744ff96-be0e-4270-8947-0410e17b97fd-agent-certs\") pod \"konnectivity-agent-drz7d\" (UID: \"e744ff96-be0e-4270-8947-0410e17b97fd\") " pod="kube-system/konnectivity-agent-drz7d"
Jul 20 22:23:08.136369 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.136353    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxgc6\" (UniqueName: \"kubernetes.io/projected/97ba3d80-72ae-44da-aef4-4b89d829cfa7-kube-api-access-kxgc6\") pod \"iptables-alerter-fkbrm\" (UID: \"97ba3d80-72ae-44da-aef4-4b89d829cfa7\") " pod="openshift-network-operator/iptables-alerter-fkbrm"
Jul 20 22:23:08.232254 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232227    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d260a4c0-32d5-44b7-8c4e-bd71ee42e34e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9hh8k\" (UID: \"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k"
Jul 20 22:23:08.232254 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232258    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d260a4c0-32d5-44b7-8c4e-bd71ee42e34e-socket-dir\") pod \"aws-ebs-csi-driver-node-9hh8k\" (UID: \"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k"
Jul 20 22:23:08.232490 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232283    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-ovnkube-config\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.232490 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232326    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-etc-systemd\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.232490 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232354    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d260a4c0-32d5-44b7-8c4e-bd71ee42e34e-etc-selinux\") pod \"aws-ebs-csi-driver-node-9hh8k\" (UID: \"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k"
Jul 20 22:23:08.232490 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232373    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sng5t\" (UniqueName: \"kubernetes.io/projected/cbfdd4e1-476f-4dbb-b7de-51d307901a3f-kube-api-access-sng5t\") pod \"node-resolver-llqcs\" (UID: \"cbfdd4e1-476f-4dbb-b7de-51d307901a3f\") " pod="openshift-dns/node-resolver-llqcs"
Jul 20 22:23:08.232490 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232390    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db2f1fd2-ec2a-4826-95de-24577a40fdf0-kubelet-config\") pod \"global-pull-secret-syncer-465x2\" (UID: \"db2f1fd2-ec2a-4826-95de-24577a40fdf0\") " pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:08.232490 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232405    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret\") pod \"global-pull-secret-syncer-465x2\" (UID: \"db2f1fd2-ec2a-4826-95de-24577a40fdf0\") " pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:08.232490 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232425    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-host-run-netns\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.232490 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232431    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d260a4c0-32d5-44b7-8c4e-bd71ee42e34e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9hh8k\" (UID: \"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k"
Jul 20 22:23:08.232490 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232457    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d260a4c0-32d5-44b7-8c4e-bd71ee42e34e-socket-dir\") pod \"aws-ebs-csi-driver-node-9hh8k\" (UID: \"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k"
Jul 20 22:23:08.232490 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232442    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-etc-systemd\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.232490 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232478    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d260a4c0-32d5-44b7-8c4e-bd71ee42e34e-etc-selinux\") pod \"aws-ebs-csi-driver-node-9hh8k\" (UID: \"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k"
Jul 20 22:23:08.232925 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232495    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db2f1fd2-ec2a-4826-95de-24577a40fdf0-kubelet-config\") pod \"global-pull-secret-syncer-465x2\" (UID: \"db2f1fd2-ec2a-4826-95de-24577a40fdf0\") " pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:08.232925 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232580    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-host-run-netns\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.232925 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:08.232584    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:08.232925 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232628    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-run-openvswitch\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.232925 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232657    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.232925 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232695    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-run-openvswitch\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.232925 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:08.232702    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret podName:db2f1fd2-ec2a-4826-95de-24577a40fdf0 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:08.732664745 +0000 UTC m=+2.030881318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret") pod "global-pull-secret-syncer-465x2" (UID: "db2f1fd2-ec2a-4826-95de-24577a40fdf0") : object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:08.232925 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232785    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.232925 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232786    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee8ea194-33c5-4952-ad19-541828d1c720-tmp\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.232925 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232829    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvwz\" (UniqueName: \"kubernetes.io/projected/ee8ea194-33c5-4952-ad19-541828d1c720-kube-api-access-lsvwz\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.232925 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232855    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-var-lib-openvswitch\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.232925 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232879    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.232925 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232906    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-multus-conf-dir\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.232925 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232934    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-host-run-multus-certs\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.233637 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232938    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-var-lib-openvswitch\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.233637 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232956    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-etc-sysctl-d\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.233637 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.232998    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-multus-conf-dir\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.233637 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233013    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-host-run-multus-certs\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.233637 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233026    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-ovnkube-config\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.233637 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233029    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-run\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.233637 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233054    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-etc-sysctl-d\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.233637 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233074    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-host\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.233637 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233084    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-run\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.233637 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233098    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbfdd4e1-476f-4dbb-b7de-51d307901a3f-tmp-dir\") pod \"node-resolver-llqcs\" (UID: \"cbfdd4e1-476f-4dbb-b7de-51d307901a3f\") " pod="openshift-dns/node-resolver-llqcs"
Jul 20 22:23:08.233637 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233117    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-cnibin\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.233637 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233139    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a37a744-9bdb-4257-99b9-dccada162ae2-multus-daemon-config\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.233637 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233131    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-host\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.233637 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233179    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-system-cni-dir\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.233637 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233220    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-host-var-lib-cni-multus\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.233637 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233242    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d260a4c0-32d5-44b7-8c4e-bd71ee42e34e-sys-fs\") pod \"aws-ebs-csi-driver-node-9hh8k\" (UID: \"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k"
Jul 20 22:23:08.233637 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233265    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-node-log\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.233637 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233281    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-system-cni-dir\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.234465 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233283    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-host-cni-netd\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.234465 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233313    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-host-cni-netd\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.234465 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233326    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d89g\" (UniqueName: \"kubernetes.io/projected/5a37a744-9bdb-4257-99b9-dccada162ae2-kube-api-access-4d89g\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.234465 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233338    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d260a4c0-32d5-44b7-8c4e-bd71ee42e34e-sys-fs\") pod \"aws-ebs-csi-driver-node-9hh8k\" (UID: \"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k"
Jul 20 22:23:08.234465 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233280    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-host-var-lib-cni-multus\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.234465 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233353    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-cnibin\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.234465 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233349    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-node-log\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.234465 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233379    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cbfdd4e1-476f-4dbb-b7de-51d307901a3f-hosts-file\") pod \"node-resolver-llqcs\" (UID: \"cbfdd4e1-476f-4dbb-b7de-51d307901a3f\") " pod="openshift-dns/node-resolver-llqcs"
Jul 20 22:23:08.234465 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233401    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbfdd4e1-476f-4dbb-b7de-51d307901a3f-tmp-dir\") pod \"node-resolver-llqcs\" (UID: \"cbfdd4e1-476f-4dbb-b7de-51d307901a3f\") " pod="openshift-dns/node-resolver-llqcs"
Jul 20 22:23:08.234465 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233418    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-multus-socket-dir-parent\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.234465 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233445    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcr4m\" (UniqueName: \"kubernetes.io/projected/7628eb97-7435-415a-bfa4-6cb8bbede73b-kube-api-access-tcr4m\") pod \"node-ca-55kwx\" (UID: \"7628eb97-7435-415a-bfa4-6cb8bbede73b\") " pod="openshift-image-registry/node-ca-55kwx"
Jul 20 22:23:08.234465 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233449    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cbfdd4e1-476f-4dbb-b7de-51d307901a3f-hosts-file\") pod \"node-resolver-llqcs\" (UID: \"cbfdd4e1-476f-4dbb-b7de-51d307901a3f\") " pod="openshift-dns/node-resolver-llqcs"
Jul 20 22:23:08.234465 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233483    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-etc-modprobe-d\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.234465 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233406    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-cnibin\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.234465 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233504    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-multus-socket-dir-parent\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.234465 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233512    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-etc-sysconfig\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.234465 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233480    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.234465 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233537    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-systemd-units\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.235412 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233576    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-etc-modprobe-d\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.235412 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233580    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-run-ovn\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.235412 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233632    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-etc-sysconfig\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.235412 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233636    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-env-overrides\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.235412 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233575    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-systemd-units\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.235412 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233643    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-run-ovn\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.235412 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233679    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.235412 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233716    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-log-socket\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.235412 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233709    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-cnibin\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.235412 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233739    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-multus-cni-dir\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.235412 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233769    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-os-release\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.235412 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233784    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-log-socket\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.235412 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233792    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-os-release\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.235412 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233816    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-lib-modules\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.235412 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233839    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-host-run-ovn-kubernetes\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.235412 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233843    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-os-release\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.235412 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233863    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-ovn-node-metrics-cert\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.235412 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233887    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-hostroot\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.236090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233910    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-multus-cni-dir\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.236090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233927    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7628eb97-7435-415a-bfa4-6cb8bbede73b-host\") pod \"node-ca-55kwx\" (UID: \"7628eb97-7435-415a-bfa4-6cb8bbede73b\") " pod="openshift-image-registry/node-ca-55kwx"
Jul 20 22:23:08.236090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233950    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-host-slash\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.236090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.233937    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-lib-modules\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.236090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234034    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-host-run-ovn-kubernetes\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.236090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234093    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7628eb97-7435-415a-bfa4-6cb8bbede73b-host\") pod \"node-ca-55kwx\" (UID: \"7628eb97-7435-415a-bfa4-6cb8bbede73b\") " pod="openshift-image-registry/node-ca-55kwx"
Jul 20 22:23:08.236090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234093    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-hostroot\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.236090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234113    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-host-var-lib-kubelet\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.236090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234142    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-etc-kubernetes\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.236090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234150    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-os-release\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.236090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234191    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-etc-kubernetes\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.236090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234196    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-host-slash\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.236090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234183    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-env-overrides\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.236090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234218    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a37a744-9bdb-4257-99b9-dccada162ae2-multus-daemon-config\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.236090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234201    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.236090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234227    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-host-var-lib-kubelet\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.236090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234236    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8zlq\" (UniqueName: \"kubernetes.io/projected/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-kube-api-access-s8zlq\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.236090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234261    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-sys\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.236594 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234288    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ee8ea194-33c5-4952-ad19-541828d1c720-etc-tuned\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.236594 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234301    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-sys\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.236594 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234320    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d260a4c0-32d5-44b7-8c4e-bd71ee42e34e-registration-dir\") pod \"aws-ebs-csi-driver-node-9hh8k\" (UID: \"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k"
Jul 20 22:23:08.236594 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234367    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d260a4c0-32d5-44b7-8c4e-bd71ee42e34e-registration-dir\") pod \"aws-ebs-csi-driver-node-9hh8k\" (UID: \"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k"
Jul 20 22:23:08.236594 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234398    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db2f1fd2-ec2a-4826-95de-24577a40fdf0-dbus\") pod \"global-pull-secret-syncer-465x2\" (UID: \"db2f1fd2-ec2a-4826-95de-24577a40fdf0\") " pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:08.236594 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234477    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-run-systemd\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.236594 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234496    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db2f1fd2-ec2a-4826-95de-24577a40fdf0-dbus\") pod \"global-pull-secret-syncer-465x2\" (UID: \"db2f1fd2-ec2a-4826-95de-24577a40fdf0\") " pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:08.236594 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234503    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-host-cni-bin\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.236594 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234542    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-host-cni-bin\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.236594 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234543    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a37a744-9bdb-4257-99b9-dccada162ae2-cni-binary-copy\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.236594 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234590    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-cni-binary-copy\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.236594 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234633    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-etc-sysctl-conf\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.236594 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234658    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlqwx\" (UniqueName: \"kubernetes.io/projected/d260a4c0-32d5-44b7-8c4e-bd71ee42e34e-kube-api-access-xlqwx\") pod \"aws-ebs-csi-driver-node-9hh8k\" (UID: \"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k"
Jul 20 22:23:08.236594 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234680    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs\") pod \"network-metrics-daemon-f5458\" (UID: \"5aa2732a-c080-4b95-af51-91052aeb9be2\") " pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:08.236594 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234703    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-system-cni-dir\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.236594 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234727    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7628eb97-7435-415a-bfa4-6cb8bbede73b-serviceca\") pod \"node-ca-55kwx\" (UID: \"7628eb97-7435-415a-bfa4-6cb8bbede73b\") " pod="openshift-image-registry/node-ca-55kwx"
Jul 20 22:23:08.236594 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234753    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d28r\" (UniqueName: \"kubernetes.io/projected/5aa2732a-c080-4b95-af51-91052aeb9be2-kube-api-access-7d28r\") pod \"network-metrics-daemon-f5458\" (UID: \"5aa2732a-c080-4b95-af51-91052aeb9be2\") " pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:08.237080 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234779    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv6s4\" (UniqueName: \"kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4\") pod \"network-check-target-295rv\" (UID: \"da300f87-f427-4da6-b75c-9acd5d86b32f\") " pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:08.237080 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234808    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-host-kubelet\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.237080 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234835    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.237080 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234857    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-ovnkube-script-lib\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.237080 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234879    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-etc-kubernetes\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.237080 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234901    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d260a4c0-32d5-44b7-8c4e-bd71ee42e34e-device-dir\") pod \"aws-ebs-csi-driver-node-9hh8k\" (UID: \"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k"
Jul 20 22:23:08.237080 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234929    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-etc-openvswitch\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.237080 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234952    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dtxf\" (UniqueName: \"kubernetes.io/projected/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-kube-api-access-2dtxf\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.237080 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234977    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-host-run-k8s-cni-cncf-io\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.237080 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234990    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a37a744-9bdb-4257-99b9-dccada162ae2-cni-binary-copy\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.237080 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.235003    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-host-run-netns\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.237080 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.235043    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-host-var-lib-cni-bin\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.237080 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.235050    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-host-run-netns\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.237080 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.235072    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-var-lib-kubelet\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.237080 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.235101    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-system-cni-dir\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.237080 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.235127    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-host-var-lib-cni-bin\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.237080 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.234887    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-etc-sysctl-conf\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.237539 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.235151    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-var-lib-kubelet\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.237539 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.235158    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-cni-binary-copy\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.237539 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.235203    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee8ea194-33c5-4952-ad19-541828d1c720-etc-kubernetes\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.237539 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.235219    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-etc-openvswitch\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.237539 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.235249    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d260a4c0-32d5-44b7-8c4e-bd71ee42e34e-device-dir\") pod \"aws-ebs-csi-driver-node-9hh8k\" (UID: \"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k"
Jul 20 22:23:08.237539 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.235263    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-run-systemd\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.237539 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.235301    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a37a744-9bdb-4257-99b9-dccada162ae2-host-run-k8s-cni-cncf-io\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.237539 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.235407    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-host-kubelet\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.237539 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:08.235480    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:08.237539 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:08.235526    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs podName:5aa2732a-c080-4b95-af51-91052aeb9be2 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:08.73550962 +0000 UTC m=+2.033726168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs") pod "network-metrics-daemon-f5458" (UID: "5aa2732a-c080-4b95-af51-91052aeb9be2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:08.237539 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.235589    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.237539 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.235732    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7628eb97-7435-415a-bfa4-6cb8bbede73b-serviceca\") pod \"node-ca-55kwx\" (UID: \"7628eb97-7435-415a-bfa4-6cb8bbede73b\") " pod="openshift-image-registry/node-ca-55kwx"
Jul 20 22:23:08.237539 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.235858    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee8ea194-33c5-4952-ad19-541828d1c720-tmp\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.237539 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.236160    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-ovn-node-metrics-cert\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.237539 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.236158    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-ovnkube-script-lib\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.237539 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.236541    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ee8ea194-33c5-4952-ad19-541828d1c720-etc-tuned\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.244587 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:08.244552    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 22:23:08.244771 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:08.244591    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 22:23:08.244771 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:08.244625    2556 projected.go:196] Error preparing data for projected volume kube-api-access-sv6s4 for pod openshift-network-diagnostics/network-check-target-295rv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:08.244771 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:08.244699    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4 podName:da300f87-f427-4da6-b75c-9acd5d86b32f nodeName:}" failed. No retries permitted until 2026-07-20 22:23:08.744681834 +0000 UTC m=+2.042898396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sv6s4" (UniqueName: "kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4") pod "network-check-target-295rv" (UID: "da300f87-f427-4da6-b75c-9acd5d86b32f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:08.246007 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.245978    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlqwx\" (UniqueName: \"kubernetes.io/projected/d260a4c0-32d5-44b7-8c4e-bd71ee42e34e-kube-api-access-xlqwx\") pod \"aws-ebs-csi-driver-node-9hh8k\" (UID: \"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k"
Jul 20 22:23:08.247497 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.247476    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sng5t\" (UniqueName: \"kubernetes.io/projected/cbfdd4e1-476f-4dbb-b7de-51d307901a3f-kube-api-access-sng5t\") pod \"node-resolver-llqcs\" (UID: \"cbfdd4e1-476f-4dbb-b7de-51d307901a3f\") " pod="openshift-dns/node-resolver-llqcs"
Jul 20 22:23:08.247591 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.247517    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d89g\" (UniqueName: \"kubernetes.io/projected/5a37a744-9bdb-4257-99b9-dccada162ae2-kube-api-access-4d89g\") pod \"multus-fm4hh\" (UID: \"5a37a744-9bdb-4257-99b9-dccada162ae2\") " pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.247994 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.247970    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d28r\" (UniqueName: \"kubernetes.io/projected/5aa2732a-c080-4b95-af51-91052aeb9be2-kube-api-access-7d28r\") pod \"network-metrics-daemon-f5458\" (UID: \"5aa2732a-c080-4b95-af51-91052aeb9be2\") " pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:08.248233 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.248213    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8zlq\" (UniqueName: \"kubernetes.io/projected/fafbbaf1-20bc-4827-9ff8-30d34f880dbd-kube-api-access-s8zlq\") pod \"multus-additional-cni-plugins-8clnl\" (UID: \"fafbbaf1-20bc-4827-9ff8-30d34f880dbd\") " pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.248417 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.248388    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dtxf\" (UniqueName: \"kubernetes.io/projected/74e2adba-9c9c-4c73-b9a5-99caf4bb1dac-kube-api-access-2dtxf\") pod \"ovnkube-node-dl7kw\" (UID: \"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac\") " pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.248601 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.248585    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcr4m\" (UniqueName: \"kubernetes.io/projected/7628eb97-7435-415a-bfa4-6cb8bbede73b-kube-api-access-tcr4m\") pod \"node-ca-55kwx\" (UID: \"7628eb97-7435-415a-bfa4-6cb8bbede73b\") " pod="openshift-image-registry/node-ca-55kwx"
Jul 20 22:23:08.248878 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.248862    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsvwz\" (UniqueName: \"kubernetes.io/projected/ee8ea194-33c5-4952-ad19-541828d1c720-kube-api-access-lsvwz\") pod \"tuned-2ll4h\" (UID: \"ee8ea194-33c5-4952-ad19-541828d1c720\") " pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.260935 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:08.260910    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d7523d4f36035ceb479de8b93d22fb2.slice/crio-5b348c508d2dccc206f4802d7da416494320d3d5604ca5f6f001c4df74b92dda WatchSource:0}: Error finding container 5b348c508d2dccc206f4802d7da416494320d3d5604ca5f6f001c4df74b92dda: Status 404 returned error can't find the container with id 5b348c508d2dccc206f4802d7da416494320d3d5604ca5f6f001c4df74b92dda
Jul 20 22:23:08.261393 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:08.261375    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda82db344e86a6ac15add14bc18023b45.slice/crio-d6df3bf3e03d949927d2609589e9973fe4b4d74c8f3355d0ec3c8c256c5ba3cf WatchSource:0}: Error finding container d6df3bf3e03d949927d2609589e9973fe4b4d74c8f3355d0ec3c8c256c5ba3cf: Status 404 returned error can't find the container with id d6df3bf3e03d949927d2609589e9973fe4b4d74c8f3355d0ec3c8c256c5ba3cf
Jul 20 22:23:08.266620 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.266594    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 22:23:08.274159 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.274140    2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 22:23:08.351232 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.351139    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-drz7d"
Jul 20 22:23:08.358408 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.358382    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fkbrm"
Jul 20 22:23:08.361053 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:08.361024    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode744ff96_be0e_4270_8947_0410e17b97fd.slice/crio-ed69b24add8b9fdb696da682c76bd0a71642a91328db153231c76d84b4262e79 WatchSource:0}: Error finding container ed69b24add8b9fdb696da682c76bd0a71642a91328db153231c76d84b4262e79: Status 404 returned error can't find the container with id ed69b24add8b9fdb696da682c76bd0a71642a91328db153231c76d84b4262e79
Jul 20 22:23:08.366348 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:08.366322    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97ba3d80_72ae_44da_aef4_4b89d829cfa7.slice/crio-32f8dd0d79e8d0cd3623c4a4ad313df132d06e0c28ac0c5e7e837583db1adf00 WatchSource:0}: Error finding container 32f8dd0d79e8d0cd3623c4a4ad313df132d06e0c28ac0c5e7e837583db1adf00: Status 404 returned error can't find the container with id 32f8dd0d79e8d0cd3623c4a4ad313df132d06e0c28ac0c5e7e837583db1adf00
Jul 20 22:23:08.377912 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.377888    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k"
Jul 20 22:23:08.381390 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.381372    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:08.388138 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:08.388109    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd260a4c0_32d5_44b7_8c4e_bd71ee42e34e.slice/crio-3a1d157c26b5b8b33096e9da10d7a8220b94db06919fdc1f7565a57b5dd095c9 WatchSource:0}: Error finding container 3a1d157c26b5b8b33096e9da10d7a8220b94db06919fdc1f7565a57b5dd095c9: Status 404 returned error can't find the container with id 3a1d157c26b5b8b33096e9da10d7a8220b94db06919fdc1f7565a57b5dd095c9
Jul 20 22:23:08.390515 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:08.390480    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74e2adba_9c9c_4c73_b9a5_99caf4bb1dac.slice/crio-84c29fa07237f86649e52c149f1c61dd7cf9ada37e0de38f4e32b595c0ee7095 WatchSource:0}: Error finding container 84c29fa07237f86649e52c149f1c61dd7cf9ada37e0de38f4e32b595c0ee7095: Status 404 returned error can't find the container with id 84c29fa07237f86649e52c149f1c61dd7cf9ada37e0de38f4e32b595c0ee7095
Jul 20 22:23:08.403352 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.403332    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-llqcs"
Jul 20 22:23:08.412909 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:08.412885    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbfdd4e1_476f_4dbb_b7de_51d307901a3f.slice/crio-8103e7fd4f47b26a68adf96fd847df93be67363ecc819f67d4597d0cc4eeac7e WatchSource:0}: Error finding container 8103e7fd4f47b26a68adf96fd847df93be67363ecc819f67d4597d0cc4eeac7e: Status 404 returned error can't find the container with id 8103e7fd4f47b26a68adf96fd847df93be67363ecc819f67d4597d0cc4eeac7e
Jul 20 22:23:08.420419 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.420401    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fm4hh"
Jul 20 22:23:08.426213 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.426199    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8clnl"
Jul 20 22:23:08.428466 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:08.428442    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a37a744_9bdb_4257_99b9_dccada162ae2.slice/crio-3297e6da72fd6b599184dc252c3e2666be9db7952c0bba04b4b9e778c618289e WatchSource:0}: Error finding container 3297e6da72fd6b599184dc252c3e2666be9db7952c0bba04b4b9e778c618289e: Status 404 returned error can't find the container with id 3297e6da72fd6b599184dc252c3e2666be9db7952c0bba04b4b9e778c618289e
Jul 20 22:23:08.434313 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:08.434291    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfafbbaf1_20bc_4827_9ff8_30d34f880dbd.slice/crio-ac96236cff78d422e7d5586dc9efe7ee50fde90903253a6c576f9a0304898f3e WatchSource:0}: Error finding container ac96236cff78d422e7d5586dc9efe7ee50fde90903253a6c576f9a0304898f3e: Status 404 returned error can't find the container with id ac96236cff78d422e7d5586dc9efe7ee50fde90903253a6c576f9a0304898f3e
Jul 20 22:23:08.447400 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.447381    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-55kwx"
Jul 20 22:23:08.453123 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.453100    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2ll4h"
Jul 20 22:23:08.456844 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:08.456824    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7628eb97_7435_415a_bfa4_6cb8bbede73b.slice/crio-226e434cddb2e8819146e13ea4215a14d4c831645d8a8796a9dd58dd5e812347 WatchSource:0}: Error finding container 226e434cddb2e8819146e13ea4215a14d4c831645d8a8796a9dd58dd5e812347: Status 404 returned error can't find the container with id 226e434cddb2e8819146e13ea4215a14d4c831645d8a8796a9dd58dd5e812347
Jul 20 22:23:08.461388 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:23:08.461370    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee8ea194_33c5_4952_ad19_541828d1c720.slice/crio-fed9b7626df00fe4744915021e1c09b768145bff634a0f254ad2eb1e6e1e907b WatchSource:0}: Error finding container fed9b7626df00fe4744915021e1c09b768145bff634a0f254ad2eb1e6e1e907b: Status 404 returned error can't find the container with id fed9b7626df00fe4744915021e1c09b768145bff634a0f254ad2eb1e6e1e907b
Jul 20 22:23:08.462905 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:08.462887    2556 kuberuntime_manager.go:1459] "Unhandled Error" err="container tuned start failed in pod tuned-2ll4h_openshift-cluster-node-tuning-operator(ee8ea194-33c5-4952-ad19-541828d1c720): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 20 22:23:08.462969 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:08.462921    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"tuned\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-cluster-node-tuning-operator/tuned-2ll4h" podUID="ee8ea194-33c5-4952-ad19-541828d1c720"
Jul 20 22:23:08.537581 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.537556    2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 22:23:08.738604 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.738574    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs\") pod \"network-metrics-daemon-f5458\" (UID: \"5aa2732a-c080-4b95-af51-91052aeb9be2\") " pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:08.738791 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.738648    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret\") pod \"global-pull-secret-syncer-465x2\" (UID: \"db2f1fd2-ec2a-4826-95de-24577a40fdf0\") " pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:08.738791 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:08.738742    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:08.738791 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:08.738755    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:08.739008 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:08.738810    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs podName:5aa2732a-c080-4b95-af51-91052aeb9be2 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:09.738792285 +0000 UTC m=+3.037008854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs") pod "network-metrics-daemon-f5458" (UID: "5aa2732a-c080-4b95-af51-91052aeb9be2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:08.739008 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:08.738833    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret podName:db2f1fd2-ec2a-4826-95de-24577a40fdf0 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:09.738822982 +0000 UTC m=+3.037039539 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret") pod "global-pull-secret-syncer-465x2" (UID: "db2f1fd2-ec2a-4826-95de-24577a40fdf0") : object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:08.840011 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:08.839978    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv6s4\" (UniqueName: \"kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4\") pod \"network-check-target-295rv\" (UID: \"da300f87-f427-4da6-b75c-9acd5d86b32f\") " pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:08.840213 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:08.840165    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 22:23:08.840213 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:08.840195    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 22:23:08.840213 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:08.840210    2556 projected.go:196] Error preparing data for projected volume kube-api-access-sv6s4 for pod openshift-network-diagnostics/network-check-target-295rv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:08.840395 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:08.840270    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4 podName:da300f87-f427-4da6-b75c-9acd5d86b32f nodeName:}" failed. No retries permitted until 2026-07-20 22:23:09.840248705 +0000 UTC m=+3.138465260 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sv6s4" (UniqueName: "kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4") pod "network-check-target-295rv" (UID: "da300f87-f427-4da6-b75c-9acd5d86b32f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:09.070438 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:09.070262    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 22:18:08 +0000 UTC" deadline="2027-12-30 06:58:46.974187372 +0000 UTC"
Jul 20 22:23:09.070438 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:09.070332    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12656h35m37.903860494s"
Jul 20 22:23:09.225173 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:09.224143    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-llqcs" event={"ID":"cbfdd4e1-476f-4dbb-b7de-51d307901a3f","Type":"ContainerStarted","Data":"8103e7fd4f47b26a68adf96fd847df93be67363ecc819f67d4597d0cc4eeac7e"}
Jul 20 22:23:09.243706 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:09.243501    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k" event={"ID":"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e","Type":"ContainerStarted","Data":"3a1d157c26b5b8b33096e9da10d7a8220b94db06919fdc1f7565a57b5dd095c9"}
Jul 20 22:23:09.261106 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:09.261062    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-drz7d" event={"ID":"e744ff96-be0e-4270-8947-0410e17b97fd","Type":"ContainerStarted","Data":"ed69b24add8b9fdb696da682c76bd0a71642a91328db153231c76d84b4262e79"}
Jul 20 22:23:09.273254 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:09.273045    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 22:23:09.289767 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:09.286855    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal" event={"ID":"9d7523d4f36035ceb479de8b93d22fb2","Type":"ContainerStarted","Data":"5b348c508d2dccc206f4802d7da416494320d3d5604ca5f6f001c4df74b92dda"}
Jul 20 22:23:09.300938 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:09.300897    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-55kwx" event={"ID":"7628eb97-7435-415a-bfa4-6cb8bbede73b","Type":"ContainerStarted","Data":"226e434cddb2e8819146e13ea4215a14d4c831645d8a8796a9dd58dd5e812347"}
Jul 20 22:23:09.317884 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:09.317846    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8clnl" event={"ID":"fafbbaf1-20bc-4827-9ff8-30d34f880dbd","Type":"ContainerStarted","Data":"ac96236cff78d422e7d5586dc9efe7ee50fde90903253a6c576f9a0304898f3e"}
Jul 20 22:23:09.336341 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:09.336155    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw" event={"ID":"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac","Type":"ContainerStarted","Data":"84c29fa07237f86649e52c149f1c61dd7cf9ada37e0de38f4e32b595c0ee7095"}
Jul 20 22:23:09.357909 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:09.357802    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fkbrm" event={"ID":"97ba3d80-72ae-44da-aef4-4b89d829cfa7","Type":"ContainerStarted","Data":"32f8dd0d79e8d0cd3623c4a4ad313df132d06e0c28ac0c5e7e837583db1adf00"}
Jul 20 22:23:09.365673 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:09.365637    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-74.ec2.internal" event={"ID":"a82db344e86a6ac15add14bc18023b45","Type":"ContainerStarted","Data":"d6df3bf3e03d949927d2609589e9973fe4b4d74c8f3355d0ec3c8c256c5ba3cf"}
Jul 20 22:23:09.379917 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:09.378992    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2ll4h" event={"ID":"ee8ea194-33c5-4952-ad19-541828d1c720","Type":"ContainerStarted","Data":"fed9b7626df00fe4744915021e1c09b768145bff634a0f254ad2eb1e6e1e907b"}
Jul 20 22:23:09.387017 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:09.386938    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"tuned\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bde4d3e6601b1a43249dcefbf210ae783590d4ff5957380d16c78b4d391ee9eb\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-cluster-node-tuning-operator/tuned-2ll4h" podUID="ee8ea194-33c5-4952-ad19-541828d1c720"
Jul 20 22:23:09.391519 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:09.391488    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fm4hh" event={"ID":"5a37a744-9bdb-4257-99b9-dccada162ae2","Type":"ContainerStarted","Data":"3297e6da72fd6b599184dc252c3e2666be9db7952c0bba04b4b9e778c618289e"}
Jul 20 22:23:09.746913 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:09.746783    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret\") pod \"global-pull-secret-syncer-465x2\" (UID: \"db2f1fd2-ec2a-4826-95de-24577a40fdf0\") " pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:09.746913 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:09.746903    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs\") pod \"network-metrics-daemon-f5458\" (UID: \"5aa2732a-c080-4b95-af51-91052aeb9be2\") " pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:09.747199 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:09.746962    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:09.747199 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:09.747038    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:09.747199 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:09.747045    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret podName:db2f1fd2-ec2a-4826-95de-24577a40fdf0 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:11.74702303 +0000 UTC m=+5.045239608 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret") pod "global-pull-secret-syncer-465x2" (UID: "db2f1fd2-ec2a-4826-95de-24577a40fdf0") : object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:09.747199 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:09.747095    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs podName:5aa2732a-c080-4b95-af51-91052aeb9be2 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:11.747077884 +0000 UTC m=+5.045294438 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs") pod "network-metrics-daemon-f5458" (UID: "5aa2732a-c080-4b95-af51-91052aeb9be2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:09.847965 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:09.847925    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv6s4\" (UniqueName: \"kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4\") pod \"network-check-target-295rv\" (UID: \"da300f87-f427-4da6-b75c-9acd5d86b32f\") " pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:09.848136 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:09.848124    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 22:23:09.848210 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:09.848146    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 22:23:09.848210 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:09.848160    2556 projected.go:196] Error preparing data for projected volume kube-api-access-sv6s4 for pod openshift-network-diagnostics/network-check-target-295rv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:09.848320 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:09.848221    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4 podName:da300f87-f427-4da6-b75c-9acd5d86b32f nodeName:}" failed. No retries permitted until 2026-07-20 22:23:11.848201626 +0000 UTC m=+5.146418179 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sv6s4" (UniqueName: "kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4") pod "network-check-target-295rv" (UID: "da300f87-f427-4da6-b75c-9acd5d86b32f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:10.061331 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:10.061043    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 22:23:10.070587 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:10.070520    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 22:18:08 +0000 UTC" deadline="2028-02-04 06:09:56.459143009 +0000 UTC"
Jul 20 22:23:10.070587 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:10.070554    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13519h46m46.38859512s"
Jul 20 22:23:10.202140 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:10.201058    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:10.202140 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:10.201234    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:10.202140 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:10.201704    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:10.202140 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:10.201820    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:10.202140 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:10.201904    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:10.202140 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:10.201985    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:11.765906 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:11.765860    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs\") pod \"network-metrics-daemon-f5458\" (UID: \"5aa2732a-c080-4b95-af51-91052aeb9be2\") " pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:11.766543 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:11.766007    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret\") pod \"global-pull-secret-syncer-465x2\" (UID: \"db2f1fd2-ec2a-4826-95de-24577a40fdf0\") " pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:11.766543 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:11.766184    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:11.766543 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:11.766212    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:11.766543 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:11.766278    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret podName:db2f1fd2-ec2a-4826-95de-24577a40fdf0 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:15.766255641 +0000 UTC m=+9.064472191 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret") pod "global-pull-secret-syncer-465x2" (UID: "db2f1fd2-ec2a-4826-95de-24577a40fdf0") : object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:11.766543 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:11.766304    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs podName:5aa2732a-c080-4b95-af51-91052aeb9be2 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:15.766292078 +0000 UTC m=+9.064508653 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs") pod "network-metrics-daemon-f5458" (UID: "5aa2732a-c080-4b95-af51-91052aeb9be2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:11.867117 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:11.867066    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv6s4\" (UniqueName: \"kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4\") pod \"network-check-target-295rv\" (UID: \"da300f87-f427-4da6-b75c-9acd5d86b32f\") " pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:11.867812 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:11.867288    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 22:23:11.867812 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:11.867324    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 22:23:11.867812 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:11.867340    2556 projected.go:196] Error preparing data for projected volume kube-api-access-sv6s4 for pod openshift-network-diagnostics/network-check-target-295rv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:11.867812 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:11.867412    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4 podName:da300f87-f427-4da6-b75c-9acd5d86b32f nodeName:}" failed. No retries permitted until 2026-07-20 22:23:15.867389008 +0000 UTC m=+9.165605576 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sv6s4" (UniqueName: "kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4") pod "network-check-target-295rv" (UID: "da300f87-f427-4da6-b75c-9acd5d86b32f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:12.200542 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:12.200389    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:12.200542 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:12.200402    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:12.200808 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:12.200551    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:12.200808 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:12.200530    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:12.200808 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:12.200673    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:12.200808 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:12.200774    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:14.201775 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:14.201278    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:14.201775 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:14.201420    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:14.201775 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:14.201718    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:14.202346 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:14.201831    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:14.202346 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:14.201883    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:14.202346 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:14.202001    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:15.801783 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:15.801744    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret\") pod \"global-pull-secret-syncer-465x2\" (UID: \"db2f1fd2-ec2a-4826-95de-24577a40fdf0\") " pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:15.802215 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:15.801836    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs\") pod \"network-metrics-daemon-f5458\" (UID: \"5aa2732a-c080-4b95-af51-91052aeb9be2\") " pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:15.802215 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:15.801899    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:15.802215 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:15.801974    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret podName:db2f1fd2-ec2a-4826-95de-24577a40fdf0 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:23.801958327 +0000 UTC m=+17.100174879 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret") pod "global-pull-secret-syncer-465x2" (UID: "db2f1fd2-ec2a-4826-95de-24577a40fdf0") : object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:15.802215 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:15.801981    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:15.802215 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:15.802040    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs podName:5aa2732a-c080-4b95-af51-91052aeb9be2 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:23.802022596 +0000 UTC m=+17.100239161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs") pod "network-metrics-daemon-f5458" (UID: "5aa2732a-c080-4b95-af51-91052aeb9be2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:15.902637 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:15.902586    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv6s4\" (UniqueName: \"kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4\") pod \"network-check-target-295rv\" (UID: \"da300f87-f427-4da6-b75c-9acd5d86b32f\") " pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:15.902813 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:15.902758    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 22:23:15.902813 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:15.902785    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 22:23:15.902813 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:15.902799    2556 projected.go:196] Error preparing data for projected volume kube-api-access-sv6s4 for pod openshift-network-diagnostics/network-check-target-295rv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:15.902969 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:15.902859    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4 podName:da300f87-f427-4da6-b75c-9acd5d86b32f nodeName:}" failed. No retries permitted until 2026-07-20 22:23:23.902840498 +0000 UTC m=+17.201057064 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sv6s4" (UniqueName: "kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4") pod "network-check-target-295rv" (UID: "da300f87-f427-4da6-b75c-9acd5d86b32f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:16.200986 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:16.200453    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:16.200986 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:16.200503    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:16.200986 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:16.200576    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:16.200986 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:16.200659    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:16.200986 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:16.200757    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:16.200986 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:16.200843    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:18.200808 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:18.200722    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:18.201292 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:18.200722    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:18.201292 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:18.200862    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:18.201292 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:18.200962    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:18.201292 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:18.200722    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:18.201292 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:18.201033    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:20.200768 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:20.200725    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:20.200768 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:20.200749    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:20.200768 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:20.200749    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:20.201230 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:20.200858    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:20.201230 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:20.200933    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:20.201230 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:20.200989    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:22.201227 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:22.201192    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:22.201695 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:22.201239    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:22.201695 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:22.201296    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:22.201695 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:22.201310    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:22.201695 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:22.201374    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:22.201695 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:22.201448    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:23.859299 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:23.859256    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret\") pod \"global-pull-secret-syncer-465x2\" (UID: \"db2f1fd2-ec2a-4826-95de-24577a40fdf0\") " pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:23.859793 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:23.859336    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs\") pod \"network-metrics-daemon-f5458\" (UID: \"5aa2732a-c080-4b95-af51-91052aeb9be2\") " pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:23.859793 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:23.859388    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:23.859793 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:23.859447    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:23.859793 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:23.859491    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret podName:db2f1fd2-ec2a-4826-95de-24577a40fdf0 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:39.859472331 +0000 UTC m=+33.157688879 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret") pod "global-pull-secret-syncer-465x2" (UID: "db2f1fd2-ec2a-4826-95de-24577a40fdf0") : object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:23.859793 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:23.859512    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs podName:5aa2732a-c080-4b95-af51-91052aeb9be2 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:39.859501347 +0000 UTC m=+33.157717899 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs") pod "network-metrics-daemon-f5458" (UID: "5aa2732a-c080-4b95-af51-91052aeb9be2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:23.960042 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:23.960006    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv6s4\" (UniqueName: \"kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4\") pod \"network-check-target-295rv\" (UID: \"da300f87-f427-4da6-b75c-9acd5d86b32f\") " pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:23.960247 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:23.960187    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 22:23:23.960247 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:23.960211    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 22:23:23.960247 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:23.960224    2556 projected.go:196] Error preparing data for projected volume kube-api-access-sv6s4 for pod openshift-network-diagnostics/network-check-target-295rv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:23.960405 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:23.960286    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4 podName:da300f87-f427-4da6-b75c-9acd5d86b32f nodeName:}" failed. No retries permitted until 2026-07-20 22:23:39.96027091 +0000 UTC m=+33.258487475 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sv6s4" (UniqueName: "kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4") pod "network-check-target-295rv" (UID: "da300f87-f427-4da6-b75c-9acd5d86b32f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:24.200640 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:24.200534    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:24.200819 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:24.200674    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:24.200819 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:24.200801    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:24.200947 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:24.200684    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:24.200947 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:24.200677    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:24.201036 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:24.200947    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:26.200882 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:26.200851    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:26.201329 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:26.200961    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:26.201329 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:26.201022    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:26.201329 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:26.201082    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:26.201329 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:26.201111    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:26.201329 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:26.201157    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:26.448008 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:26.447450    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-74.ec2.internal" event={"ID":"a82db344e86a6ac15add14bc18023b45","Type":"ContainerStarted","Data":"328e09b3d234d9821a5f3e6d7f23d95b8c708a5b3c40ffc423fe3837fc7d4bda"}
Jul 20 22:23:26.452598 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:26.452511    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fm4hh" event={"ID":"5a37a744-9bdb-4257-99b9-dccada162ae2","Type":"ContainerStarted","Data":"fed6ba374571a9d23dafb327bef59a9318f4082678b80724cea741f172bc55a1"}
Jul 20 22:23:26.474845 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:26.474808    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw" event={"ID":"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac","Type":"ContainerStarted","Data":"89517c3f5986be2fa2580247cbc734ad087f1c1b7455ea0ba6eb8457fb3b9a88"}
Jul 20 22:23:26.474968 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:26.474913    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw" event={"ID":"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac","Type":"ContainerStarted","Data":"42ef5ee40c856ba08ddf87ced6684e6d04600ef1197d5ee680015b8e73d36127"}
Jul 20 22:23:26.490711 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:26.490152    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-74.ec2.internal" podStartSLOduration=18.49013006 podStartE2EDuration="18.49013006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:23:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:26.469063175 +0000 UTC m=+19.767279745" watchObservedRunningTime="2026-07-20 22:23:26.49013006 +0000 UTC m=+19.788346630"
Jul 20 22:23:27.479170 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:27.479128    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-llqcs" event={"ID":"cbfdd4e1-476f-4dbb-b7de-51d307901a3f","Type":"ContainerStarted","Data":"bf6a248f161656a176985911f05f2d60c7366d1caf1a53776ad0913d3fa8c856"}
Jul 20 22:23:27.480910 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:27.480875    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k" event={"ID":"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e","Type":"ContainerStarted","Data":"78eb86eeda50065eab99247542acb7df22fc6a9aaaf09d3f048f0e178e6398df"}
Jul 20 22:23:27.482515 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:27.482471    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-drz7d" event={"ID":"e744ff96-be0e-4270-8947-0410e17b97fd","Type":"ContainerStarted","Data":"08ca6e75f92a2fa32070428c76263608ea98b0872b7541b7370693c440e7ab66"}
Jul 20 22:23:27.484275 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:27.484248    2556 generic.go:356] "Generic (PLEG): container finished" podID="9d7523d4f36035ceb479de8b93d22fb2" containerID="97918094d9c7f4c59bf6c860407cdfd5672467646dd0d2cd145c6a7d52993572" exitCode=0
Jul 20 22:23:27.484394 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:27.484328    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal" event={"ID":"9d7523d4f36035ceb479de8b93d22fb2","Type":"ContainerDied","Data":"97918094d9c7f4c59bf6c860407cdfd5672467646dd0d2cd145c6a7d52993572"}
Jul 20 22:23:27.486778 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:27.486749    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-55kwx" event={"ID":"7628eb97-7435-415a-bfa4-6cb8bbede73b","Type":"ContainerStarted","Data":"fcd63fcde47a273f6d13e42fec475f96c87f9a03bd436182bc1b4fed1bf77ec4"}
Jul 20 22:23:27.488930 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:27.488904    2556 generic.go:356] "Generic (PLEG): container finished" podID="fafbbaf1-20bc-4827-9ff8-30d34f880dbd" containerID="f425bc1c41d7299f888c5c36c03bf7cc876dc3f5ab79fa20992dc64bda69e5da" exitCode=0
Jul 20 22:23:27.489030 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:27.489000    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8clnl" event={"ID":"fafbbaf1-20bc-4827-9ff8-30d34f880dbd","Type":"ContainerDied","Data":"f425bc1c41d7299f888c5c36c03bf7cc876dc3f5ab79fa20992dc64bda69e5da"}
Jul 20 22:23:27.493694 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:27.493637    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw" event={"ID":"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac","Type":"ContainerStarted","Data":"29c04e9a28162e714045743dc84a25ecca001fa3f85856df2e04968c16d41223"}
Jul 20 22:23:27.493761 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:27.493710    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw" event={"ID":"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac","Type":"ContainerStarted","Data":"7d28755aae6a43ce1edc6451b6432586a6afde1c5fd6b7a7ae44f90db1c236ed"}
Jul 20 22:23:27.493816 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:27.493759    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw" event={"ID":"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac","Type":"ContainerStarted","Data":"4c380d1e30c122ca0f0af5fce3d90f75ba301641fbbe594f6edcd545ecddab7e"}
Jul 20 22:23:27.493816 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:27.493809    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw" event={"ID":"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac","Type":"ContainerStarted","Data":"0736625f24906e57fe65baff345e015759e88a244d3750c4b2b87145c4971736"}
Jul 20 22:23:27.494807 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:27.494762    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fm4hh" podStartSLOduration=2.9347008580000002 podStartE2EDuration="20.494743803s" totalImagesPullingTime="17.560042945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:23:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:26.49083066 +0000 UTC m=+19.789047231" watchObservedRunningTime="2026-07-20 22:23:27.494743803 +0000 UTC m=+20.792960366"
Jul 20 22:23:27.495964 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:27.495930    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-llqcs" podStartSLOduration=2.95070386 podStartE2EDuration="20.495914288s" totalImagesPullingTime="17.545210428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:23:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:27.495050425 +0000 UTC m=+20.793266986" watchObservedRunningTime="2026-07-20 22:23:27.495914288 +0000 UTC m=+20.794130859"
Jul 20 22:23:27.497880 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:27.496958    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fkbrm" event={"ID":"97ba3d80-72ae-44da-aef4-4b89d829cfa7","Type":"ContainerStarted","Data":"546640ef8699a1b36beaf8ff868b3a6b203fc6bd941821b87f33f8425a85caca"}
Jul 20 22:23:27.526411 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:27.526341    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-55kwx" podStartSLOduration=3.043484754 podStartE2EDuration="20.526318566s" totalImagesPullingTime="17.482833812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:23:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:27.525935127 +0000 UTC m=+20.824151699" watchObservedRunningTime="2026-07-20 22:23:27.526318566 +0000 UTC m=+20.824535137"
Jul 20 22:23:27.558910 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:27.558874    2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 22:23:27.572734 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:27.572678    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-drz7d" podStartSLOduration=2.99441786 podStartE2EDuration="20.572658224s" totalImagesPullingTime="17.578240364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:23:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:27.545450181 +0000 UTC m=+20.843666750" watchObservedRunningTime="2026-07-20 22:23:27.572658224 +0000 UTC m=+20.870874800"
Jul 20 22:23:27.602252 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:27.602199    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fkbrm" podStartSLOduration=3.028601462 podStartE2EDuration="20.602182159s" totalImagesPullingTime="17.573580697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:23:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:27.601841279 +0000 UTC m=+20.900057851" watchObservedRunningTime="2026-07-20 22:23:27.602182159 +0000 UTC m=+20.900398729"
Jul 20 22:23:28.092668 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:28.092482    2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T22:23:27.558894445Z","UUID":"0df1b4fe-18b7-4143-9580-b963f0baf27f","Handler":null,"Name":"","Endpoint":""}
Jul 20 22:23:28.095349 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:28.095325    2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 22:23:28.095488 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:28.095367    2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 22:23:28.200889 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:28.200859    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:28.201064 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:28.200982    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:28.201166 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:28.201148    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:28.201321 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:28.201293    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:28.201386 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:28.201338    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:28.201441 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:28.201402    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:28.502913 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:28.502879    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k" event={"ID":"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e","Type":"ContainerStarted","Data":"ebeb338bd02c1b8b924f4e133a15e0e4546b613db0dcad8b356d0ea7cebfa981"}
Jul 20 22:23:28.505401 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:28.505349    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal" event={"ID":"9d7523d4f36035ceb479de8b93d22fb2","Type":"ContainerStarted","Data":"717104acadee725737f6fc7bb902061f7be0b896b11a880161446d3d5057d526"}
Jul 20 22:23:28.525346 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:28.525191    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-74.ec2.internal" podStartSLOduration=20.525171128 podStartE2EDuration="20.525171128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:23:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:28.524404287 +0000 UTC m=+21.822620856" watchObservedRunningTime="2026-07-20 22:23:28.525171128 +0000 UTC m=+21.823387694"
Jul 20 22:23:29.510782 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:29.510744    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k" event={"ID":"d260a4c0-32d5-44b7-8c4e-bd71ee42e34e","Type":"ContainerStarted","Data":"fa8eb95cea5eb84d94d04f44fb3a2fe71b22a145be5436bad342d2ee08e7a308"}
Jul 20 22:23:29.531653 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:29.530889    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hh8k" podStartSLOduration=3.25266628 podStartE2EDuration="22.530863876s" totalImagesPullingTime="19.278197596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:23:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:29.53047976 +0000 UTC m=+22.828696333" watchObservedRunningTime="2026-07-20 22:23:29.530863876 +0000 UTC m=+22.829080447"
Jul 20 22:23:30.200918 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:30.200881    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:30.201109 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:30.201002    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:30.201109 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:30.201012    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:30.201109 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:30.201039    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:30.201245 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:30.201134    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:30.201245 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:30.201202    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:32.090949 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:32.090914    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-drz7d"
Jul 20 22:23:32.091555 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:32.091538    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-drz7d"
Jul 20 22:23:32.201003 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:32.200966    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:32.201196 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:32.201010    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:32.201196 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:32.201102    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:32.201196 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:32.201169    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:32.201196 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:32.201186    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:32.201426 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:32.201284    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:33.522058 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:33.521890    2556 generic.go:356] "Generic (PLEG): container finished" podID="fafbbaf1-20bc-4827-9ff8-30d34f880dbd" containerID="29d0cab807d8a7bfe086e14f0be4c751003bc0dfd21368fdcd39922268d84235" exitCode=0
Jul 20 22:23:33.522453 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:33.521971    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8clnl" event={"ID":"fafbbaf1-20bc-4827-9ff8-30d34f880dbd","Type":"ContainerDied","Data":"29d0cab807d8a7bfe086e14f0be4c751003bc0dfd21368fdcd39922268d84235"}
Jul 20 22:23:33.525534 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:33.525508    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw" event={"ID":"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac","Type":"ContainerStarted","Data":"73bfa29b72daca38940c0d4174ebb7b63d4c6f7f8106b11437590a7994510dfd"}
Jul 20 22:23:33.527062 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:33.527042    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2ll4h" event={"ID":"ee8ea194-33c5-4952-ad19-541828d1c720","Type":"ContainerStarted","Data":"82fb3a40ef4850128a55a341d748fcbe8f8916edf0f3c73abe109d5850c378d6"}
Jul 20 22:23:33.572084 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:33.572035    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2ll4h" podStartSLOduration=1.160624276 podStartE2EDuration="25.572018514s" totalImagesPullingTime="24.411394238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:23:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-20 22:23:33.57195006 +0000 UTC m=+26.870166653" watchObservedRunningTime="2026-07-20 22:23:33.572018514 +0000 UTC m=+26.870235130"
Jul 20 22:23:33.901555 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:33.901469    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-drz7d"
Jul 20 22:23:33.901730 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:33.901634    2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 20 22:23:33.902106 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:33.902069    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-drz7d"
Jul 20 22:23:34.200828 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:34.200803    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:34.201005 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:34.200804    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:34.201005 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:34.200897    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:34.201005 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:34.200993    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:34.201110 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:34.200808    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:34.201110 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:34.201075    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:35.536625 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:35.536574    2556 generic.go:356] "Generic (PLEG): container finished" podID="fafbbaf1-20bc-4827-9ff8-30d34f880dbd" containerID="1423e19059a8eb6d0bb356c9d90985c5d7642c97335b95003da84f2741b8d204" exitCode=0
Jul 20 22:23:35.537446 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:35.536655    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8clnl" event={"ID":"fafbbaf1-20bc-4827-9ff8-30d34f880dbd","Type":"ContainerDied","Data":"1423e19059a8eb6d0bb356c9d90985c5d7642c97335b95003da84f2741b8d204"}
Jul 20 22:23:35.540523 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:35.540489    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw" event={"ID":"74e2adba-9c9c-4c73-b9a5-99caf4bb1dac","Type":"ContainerStarted","Data":"7ea35061cc3c8454c5fb9a91d54da876ab6cb934b6aca529f40d8c8c78204868"}
Jul 20 22:23:35.540808 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:35.540789    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:35.540909 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:35.540843    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:35.540909 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:35.540876    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:35.556331 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:35.556309    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:35.556443 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:35.556406    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:23:35.585535 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:35.585491    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw" podStartSLOduration=10.748552966 podStartE2EDuration="28.585474209s" totalImagesPullingTime="17.836921243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:23:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:35.585081465 +0000 UTC m=+28.883298036" watchObservedRunningTime="2026-07-20 22:23:35.585474209 +0000 UTC m=+28.883690779"
Jul 20 22:23:36.201130 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:36.200944    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:36.201326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:36.200951    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:36.201326 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:36.201235    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:36.201326 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:36.201306    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:36.201513 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:36.201011    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:36.201513 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:36.201398    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:36.545284 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:36.545249    2556 generic.go:356] "Generic (PLEG): container finished" podID="fafbbaf1-20bc-4827-9ff8-30d34f880dbd" containerID="ac65a6d35309376864dc198b115bd3cc9cd68d3a119a39d7a8d113a7200caafb" exitCode=0
Jul 20 22:23:36.545704 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:36.545289    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8clnl" event={"ID":"fafbbaf1-20bc-4827-9ff8-30d34f880dbd","Type":"ContainerDied","Data":"ac65a6d35309376864dc198b115bd3cc9cd68d3a119a39d7a8d113a7200caafb"}
Jul 20 22:23:36.972275 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:36.972239    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-465x2"]
Jul 20 22:23:36.972449 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:36.972357    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:36.972532 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:36.972468    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:36.975846 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:36.975810    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-295rv"]
Jul 20 22:23:36.976016 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:36.975905    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:36.976016 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:36.976002    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:36.986727 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:36.986693    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f5458"]
Jul 20 22:23:36.986901 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:36.986822    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:36.986962 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:36.986942    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:38.200854 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:38.200819    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:38.201355 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:38.200933    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:39.201438 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:39.201408    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:39.201919 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:39.201412    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:39.201919 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:39.201542    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:39.201919 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:39.201596    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:39.883784 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:39.883749    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs\") pod \"network-metrics-daemon-f5458\" (UID: \"5aa2732a-c080-4b95-af51-91052aeb9be2\") " pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:39.884046 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:39.883804    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret\") pod \"global-pull-secret-syncer-465x2\" (UID: \"db2f1fd2-ec2a-4826-95de-24577a40fdf0\") " pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:39.884046 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:39.883926    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:39.884046 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:39.883928    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:39.884046 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:39.883983    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret podName:db2f1fd2-ec2a-4826-95de-24577a40fdf0 nodeName:}" failed. No retries permitted until 2026-07-20 22:24:11.883967569 +0000 UTC m=+65.182184117 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret") pod "global-pull-secret-syncer-465x2" (UID: "db2f1fd2-ec2a-4826-95de-24577a40fdf0") : object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:39.884046 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:39.883997    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs podName:5aa2732a-c080-4b95-af51-91052aeb9be2 nodeName:}" failed. No retries permitted until 2026-07-20 22:24:11.883990797 +0000 UTC m=+65.182207344 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs") pod "network-metrics-daemon-f5458" (UID: "5aa2732a-c080-4b95-af51-91052aeb9be2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:39.984733 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:39.984686    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv6s4\" (UniqueName: \"kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4\") pod \"network-check-target-295rv\" (UID: \"da300f87-f427-4da6-b75c-9acd5d86b32f\") " pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:39.984898 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:39.984863    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 22:23:39.984898 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:39.984886    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 22:23:39.984898 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:39.984896    2556 projected.go:196] Error preparing data for projected volume kube-api-access-sv6s4 for pod openshift-network-diagnostics/network-check-target-295rv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:39.985020 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:39.984948    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4 podName:da300f87-f427-4da6-b75c-9acd5d86b32f nodeName:}" failed. No retries permitted until 2026-07-20 22:24:11.984933416 +0000 UTC m=+65.283149982 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sv6s4" (UniqueName: "kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4") pod "network-check-target-295rv" (UID: "da300f87-f427-4da6-b75c-9acd5d86b32f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:40.201108 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:40.201072    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:40.201298 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:40.201202    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:41.201036 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:41.200999    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:41.201409 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:41.201141    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:41.201409 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:41.201176    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:41.201409 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:41.201236    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:41.561015 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:41.560933    2556 generic.go:356] "Generic (PLEG): container finished" podID="fafbbaf1-20bc-4827-9ff8-30d34f880dbd" containerID="8a422ee7d88709c499fd85865346a0580a6337d140c96dec666620d5caaea0d8" exitCode=0
Jul 20 22:23:41.561015 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:41.560988    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8clnl" event={"ID":"fafbbaf1-20bc-4827-9ff8-30d34f880dbd","Type":"ContainerDied","Data":"8a422ee7d88709c499fd85865346a0580a6337d140c96dec666620d5caaea0d8"}
Jul 20 22:23:42.201006 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:42.200968    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:42.201194 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:42.201097    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:42.566525 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:42.566438    2556 generic.go:356] "Generic (PLEG): container finished" podID="fafbbaf1-20bc-4827-9ff8-30d34f880dbd" containerID="882a531b8075bad80a80eba68a6f4144dfbe4f676bcd76ccb265bce45ad80e28" exitCode=0
Jul 20 22:23:42.566525 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:42.566512    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8clnl" event={"ID":"fafbbaf1-20bc-4827-9ff8-30d34f880dbd","Type":"ContainerDied","Data":"882a531b8075bad80a80eba68a6f4144dfbe4f676bcd76ccb265bce45ad80e28"}
Jul 20 22:23:42.745949 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:42.745784    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-llqcs_cbfdd4e1-476f-4dbb-b7de-51d307901a3f/dns-node-resolver/0.log"
Jul 20 22:23:43.200794 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:43.200757    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:43.200794 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:43.200792    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:43.201017 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:43.200897    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:43.201062 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:43.201011    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:43.309826 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:43.309792    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-55kwx_7628eb97-7435-415a-bfa4-6cb8bbede73b/node-ca/0.log"
Jul 20 22:23:43.573043 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:43.573011    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8clnl" event={"ID":"fafbbaf1-20bc-4827-9ff8-30d34f880dbd","Type":"ContainerStarted","Data":"234c5b24210a97fb2940ede33d1d32b2522c32dedb26901253b153b27b49bf0c"}
Jul 20 22:23:43.604723 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:43.604651    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8clnl" podStartSLOduration=8.143474559 podStartE2EDuration="36.604635561s" totalImagesPullingTime="28.461161002s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:23:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:43.603998651 +0000 UTC m=+36.902215221" watchObservedRunningTime="2026-07-20 22:23:43.604635561 +0000 UTC m=+36.902852130"
Jul 20 22:23:44.200971 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:44.200936    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:44.201145 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:44.201082    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:45.200376 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:45.200344    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:45.201090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:45.200352    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:45.201090 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:45.200448    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:45.201090 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:45.200543    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:46.201119 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:46.201084    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:46.201498 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:46.201205    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:47.203894 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:47.203864    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:47.204440 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:47.203864    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:47.204440 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:47.203988    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:47.204440 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:47.204025    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:48.200744 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:48.200716    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:48.200919 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:48.200813    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:49.200417 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:49.200373    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:49.200417 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:49.200413    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:49.200909 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:49.200530    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:49.200909 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:49.200630    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:50.200554 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:50.200520    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:50.200954 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:50.200639    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:51.206920 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:51.206887    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:51.207410 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:51.206897    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:51.207410 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:51.206993    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:51.207410 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:51.207098    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:52.200604 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:52.200568    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:52.200797 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:52.200685    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:53.200420 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:53.200390    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:53.200420 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:53.200418    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:53.201019 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:53.200518    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:53.201019 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:53.200630    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:54.200767 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:54.200734    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:54.201159 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:54.200840    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:55.200948 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:55.200911    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:55.201342 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:55.201032    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:55.201342 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:55.201084    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:55.201342 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:55.201174    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:56.200524 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:56.200479    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:56.200791 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:56.200590    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:57.201395 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:57.201360    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:57.201787 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:57.201471    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:57.201787 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:57.201480    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:57.201787 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:57.201555    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:23:58.201190 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:58.201152    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:23:58.201364 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:58.201262    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:23:59.201002 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:59.200971    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:23:59.201465 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:59.201108    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:23:59.201465 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:23:59.201150    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:23:59.201465 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:23:59.201227    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:24:00.200500 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:00.200460    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:24:00.200764 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:24:00.200571    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:24:01.201322 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:01.201286    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:24:01.201866 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:01.201331    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:24:01.201866 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:24:01.201406    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:24:01.201866 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:24:01.201562    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:24:02.201274 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:02.201236    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:24:02.201448 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:24:02.201349    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:24:03.200954 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:03.200916    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:24:03.201124 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:03.200921    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:24:03.201124 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:24:03.201034    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:24:03.201200 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:24:03.201120    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:24:04.201142 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:04.201106    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:24:04.201522 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:24:04.201208    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rv" podUID="da300f87-f427-4da6-b75c-9acd5d86b32f"
Jul 20 22:24:05.200890 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:05.200848    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:24:05.201061 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:24:05.200966    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5458" podUID="5aa2732a-c080-4b95-af51-91052aeb9be2"
Jul 20 22:24:05.201061 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:05.200997    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:24:05.201139 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:24:05.201057    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-465x2" podUID="db2f1fd2-ec2a-4826-95de-24577a40fdf0"
Jul 20 22:24:06.093831 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.093753    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-74.ec2.internal" event="NodeReady"
Jul 20 22:24:06.094169 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.093872    2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 22:24:06.179318 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.179285    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ms5c6"]
Jul 20 22:24:06.181200 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.181184    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5jdrv"]
Jul 20 22:24:06.181322 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.181303    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ms5c6"
Jul 20 22:24:06.182756 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.182738    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5jdrv"
Jul 20 22:24:06.184540 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.184523    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 22:24:06.185251 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.185231    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vb99p\""
Jul 20 22:24:06.186347 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.186331    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 22:24:06.187013 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.186996    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 22:24:06.187302 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.187285    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4d65x\""
Jul 20 22:24:06.187400 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.187292    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 22:24:06.188415 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.188373    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 22:24:06.200563 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.200540    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ms5c6"]
Jul 20 22:24:06.200709 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.200675    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:24:06.202029 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.202003    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5jdrv"]
Jul 20 22:24:06.204159 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.204129    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 22:24:06.204331 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.204311    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vv84p\""
Jul 20 22:24:06.206069 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.206049    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 22:24:06.270123 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.270090    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nzvqr"]
Jul 20 22:24:06.272004 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.271973    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nzvqr"
Jul 20 22:24:06.280851 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.280829    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 22:24:06.280950 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.280860    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 22:24:06.280950 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.280863    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 22:24:06.280950 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.280880    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ftm7s\""
Jul 20 22:24:06.281518 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.281505    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 22:24:06.320512 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.320476    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nzvqr"]
Jul 20 22:24:06.365250 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.365167    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rnmk\" (UniqueName: \"kubernetes.io/projected/c20f3abd-d34c-4a8b-9607-dd685e3baf6f-kube-api-access-4rnmk\") pod \"insights-runtime-extractor-nzvqr\" (UID: \"c20f3abd-d34c-4a8b-9607-dd685e3baf6f\") " pod="openshift-insights/insights-runtime-extractor-nzvqr"
Jul 20 22:24:06.365250 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.365213    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/06714327-8e4d-4ad8-b6cb-53290121c68c-config-volume\") pod \"dns-default-ms5c6\" (UID: \"06714327-8e4d-4ad8-b6cb-53290121c68c\") " pod="openshift-dns/dns-default-ms5c6"
Jul 20 22:24:06.365416 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.365249    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-768z9\" (UniqueName: \"kubernetes.io/projected/06714327-8e4d-4ad8-b6cb-53290121c68c-kube-api-access-768z9\") pod \"dns-default-ms5c6\" (UID: \"06714327-8e4d-4ad8-b6cb-53290121c68c\") " pod="openshift-dns/dns-default-ms5c6"
Jul 20 22:24:06.365416 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.365278    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/06714327-8e4d-4ad8-b6cb-53290121c68c-metrics-tls\") pod \"dns-default-ms5c6\" (UID: \"06714327-8e4d-4ad8-b6cb-53290121c68c\") " pod="openshift-dns/dns-default-ms5c6"
Jul 20 22:24:06.365416 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.365300    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06714327-8e4d-4ad8-b6cb-53290121c68c-tmp-dir\") pod \"dns-default-ms5c6\" (UID: \"06714327-8e4d-4ad8-b6cb-53290121c68c\") " pod="openshift-dns/dns-default-ms5c6"
Jul 20 22:24:06.365416 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.365351    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c20f3abd-d34c-4a8b-9607-dd685e3baf6f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nzvqr\" (UID: \"c20f3abd-d34c-4a8b-9607-dd685e3baf6f\") " pod="openshift-insights/insights-runtime-extractor-nzvqr"
Jul 20 22:24:06.365416 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.365393    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c20f3abd-d34c-4a8b-9607-dd685e3baf6f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nzvqr\" (UID: \"c20f3abd-d34c-4a8b-9607-dd685e3baf6f\") " pod="openshift-insights/insights-runtime-extractor-nzvqr"
Jul 20 22:24:06.365416 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.365417    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c20f3abd-d34c-4a8b-9607-dd685e3baf6f-crio-socket\") pod \"insights-runtime-extractor-nzvqr\" (UID: \"c20f3abd-d34c-4a8b-9607-dd685e3baf6f\") " pod="openshift-insights/insights-runtime-extractor-nzvqr"
Jul 20 22:24:06.365589 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.365433    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk5sr\" (UniqueName: \"kubernetes.io/projected/eef3eaa1-c989-4c61-85cb-83e05b1c51e6-kube-api-access-mk5sr\") pod \"ingress-canary-5jdrv\" (UID: \"eef3eaa1-c989-4c61-85cb-83e05b1c51e6\") " pod="openshift-ingress-canary/ingress-canary-5jdrv"
Jul 20 22:24:06.365589 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.365492    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c20f3abd-d34c-4a8b-9607-dd685e3baf6f-data-volume\") pod \"insights-runtime-extractor-nzvqr\" (UID: \"c20f3abd-d34c-4a8b-9607-dd685e3baf6f\") " pod="openshift-insights/insights-runtime-extractor-nzvqr"
Jul 20 22:24:06.365589 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.365507    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eef3eaa1-c989-4c61-85cb-83e05b1c51e6-cert\") pod \"ingress-canary-5jdrv\" (UID: \"eef3eaa1-c989-4c61-85cb-83e05b1c51e6\") " pod="openshift-ingress-canary/ingress-canary-5jdrv"
Jul 20 22:24:06.466061 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.466027    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c20f3abd-d34c-4a8b-9607-dd685e3baf6f-data-volume\") pod \"insights-runtime-extractor-nzvqr\" (UID: \"c20f3abd-d34c-4a8b-9607-dd685e3baf6f\") " pod="openshift-insights/insights-runtime-extractor-nzvqr"
Jul 20 22:24:06.466061 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.466064    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eef3eaa1-c989-4c61-85cb-83e05b1c51e6-cert\") pod \"ingress-canary-5jdrv\" (UID: \"eef3eaa1-c989-4c61-85cb-83e05b1c51e6\") " pod="openshift-ingress-canary/ingress-canary-5jdrv"
Jul 20 22:24:06.466305 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.466111    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rnmk\" (UniqueName: \"kubernetes.io/projected/c20f3abd-d34c-4a8b-9607-dd685e3baf6f-kube-api-access-4rnmk\") pod \"insights-runtime-extractor-nzvqr\" (UID: \"c20f3abd-d34c-4a8b-9607-dd685e3baf6f\") " pod="openshift-insights/insights-runtime-extractor-nzvqr"
Jul 20 22:24:06.466305 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.466141    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/06714327-8e4d-4ad8-b6cb-53290121c68c-config-volume\") pod \"dns-default-ms5c6\" (UID: \"06714327-8e4d-4ad8-b6cb-53290121c68c\") " pod="openshift-dns/dns-default-ms5c6"
Jul 20 22:24:06.466305 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.466171    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-768z9\" (UniqueName: \"kubernetes.io/projected/06714327-8e4d-4ad8-b6cb-53290121c68c-kube-api-access-768z9\") pod \"dns-default-ms5c6\" (UID: \"06714327-8e4d-4ad8-b6cb-53290121c68c\") " pod="openshift-dns/dns-default-ms5c6"
Jul 20 22:24:06.466305 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.466196    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/06714327-8e4d-4ad8-b6cb-53290121c68c-metrics-tls\") pod \"dns-default-ms5c6\" (UID: \"06714327-8e4d-4ad8-b6cb-53290121c68c\") " pod="openshift-dns/dns-default-ms5c6"
Jul 20 22:24:06.466305 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.466219    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06714327-8e4d-4ad8-b6cb-53290121c68c-tmp-dir\") pod \"dns-default-ms5c6\" (UID: \"06714327-8e4d-4ad8-b6cb-53290121c68c\") " pod="openshift-dns/dns-default-ms5c6"
Jul 20 22:24:06.466305 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.466248    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c20f3abd-d34c-4a8b-9607-dd685e3baf6f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nzvqr\" (UID: \"c20f3abd-d34c-4a8b-9607-dd685e3baf6f\") " pod="openshift-insights/insights-runtime-extractor-nzvqr"
Jul 20 22:24:06.466305 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.466278    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c20f3abd-d34c-4a8b-9607-dd685e3baf6f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nzvqr\" (UID: \"c20f3abd-d34c-4a8b-9607-dd685e3baf6f\") " pod="openshift-insights/insights-runtime-extractor-nzvqr"
Jul 20 22:24:06.466305 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.466305    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c20f3abd-d34c-4a8b-9607-dd685e3baf6f-crio-socket\") pod \"insights-runtime-extractor-nzvqr\" (UID: \"c20f3abd-d34c-4a8b-9607-dd685e3baf6f\") " pod="openshift-insights/insights-runtime-extractor-nzvqr"
Jul 20 22:24:06.466778 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.466327    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk5sr\" (UniqueName: \"kubernetes.io/projected/eef3eaa1-c989-4c61-85cb-83e05b1c51e6-kube-api-access-mk5sr\") pod \"ingress-canary-5jdrv\" (UID: \"eef3eaa1-c989-4c61-85cb-83e05b1c51e6\") " pod="openshift-ingress-canary/ingress-canary-5jdrv"
Jul 20 22:24:06.466778 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.466500    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c20f3abd-d34c-4a8b-9607-dd685e3baf6f-data-volume\") pod \"insights-runtime-extractor-nzvqr\" (UID: \"c20f3abd-d34c-4a8b-9607-dd685e3baf6f\") " pod="openshift-insights/insights-runtime-extractor-nzvqr"
Jul 20 22:24:06.466778 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.466581    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c20f3abd-d34c-4a8b-9607-dd685e3baf6f-crio-socket\") pod \"insights-runtime-extractor-nzvqr\" (UID: \"c20f3abd-d34c-4a8b-9607-dd685e3baf6f\") " pod="openshift-insights/insights-runtime-extractor-nzvqr"
Jul 20 22:24:06.466931 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.466868    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06714327-8e4d-4ad8-b6cb-53290121c68c-tmp-dir\") pod \"dns-default-ms5c6\" (UID: \"06714327-8e4d-4ad8-b6cb-53290121c68c\") " pod="openshift-dns/dns-default-ms5c6"
Jul 20 22:24:06.466931 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.466880    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/06714327-8e4d-4ad8-b6cb-53290121c68c-config-volume\") pod \"dns-default-ms5c6\" (UID: \"06714327-8e4d-4ad8-b6cb-53290121c68c\") " pod="openshift-dns/dns-default-ms5c6"
Jul 20 22:24:06.467046 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.467024    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c20f3abd-d34c-4a8b-9607-dd685e3baf6f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nzvqr\" (UID: \"c20f3abd-d34c-4a8b-9607-dd685e3baf6f\") " pod="openshift-insights/insights-runtime-extractor-nzvqr"
Jul 20 22:24:06.470210 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.470186    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/06714327-8e4d-4ad8-b6cb-53290121c68c-metrics-tls\") pod \"dns-default-ms5c6\" (UID: \"06714327-8e4d-4ad8-b6cb-53290121c68c\") " pod="openshift-dns/dns-default-ms5c6"
Jul 20 22:24:06.470314 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.470221    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c20f3abd-d34c-4a8b-9607-dd685e3baf6f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nzvqr\" (UID: \"c20f3abd-d34c-4a8b-9607-dd685e3baf6f\") " pod="openshift-insights/insights-runtime-extractor-nzvqr"
Jul 20 22:24:06.470314 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.470236    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eef3eaa1-c989-4c61-85cb-83e05b1c51e6-cert\") pod \"ingress-canary-5jdrv\" (UID: \"eef3eaa1-c989-4c61-85cb-83e05b1c51e6\") " pod="openshift-ingress-canary/ingress-canary-5jdrv"
Jul 20 22:24:06.483697 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.483672    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-768z9\" (UniqueName: \"kubernetes.io/projected/06714327-8e4d-4ad8-b6cb-53290121c68c-kube-api-access-768z9\") pod \"dns-default-ms5c6\" (UID: \"06714327-8e4d-4ad8-b6cb-53290121c68c\") " pod="openshift-dns/dns-default-ms5c6"
Jul 20 22:24:06.485789 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.485771    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rnmk\" (UniqueName: \"kubernetes.io/projected/c20f3abd-d34c-4a8b-9607-dd685e3baf6f-kube-api-access-4rnmk\") pod \"insights-runtime-extractor-nzvqr\" (UID: \"c20f3abd-d34c-4a8b-9607-dd685e3baf6f\") " pod="openshift-insights/insights-runtime-extractor-nzvqr"
Jul 20 22:24:06.491503 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.491484    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ms5c6"
Jul 20 22:24:06.493753 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.493727    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk5sr\" (UniqueName: \"kubernetes.io/projected/eef3eaa1-c989-4c61-85cb-83e05b1c51e6-kube-api-access-mk5sr\") pod \"ingress-canary-5jdrv\" (UID: \"eef3eaa1-c989-4c61-85cb-83e05b1c51e6\") " pod="openshift-ingress-canary/ingress-canary-5jdrv"
Jul 20 22:24:06.495889 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.495868    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5jdrv"
Jul 20 22:24:06.580301 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.580038    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nzvqr"
Jul 20 22:24:06.641535 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.641500    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5jdrv"]
Jul 20 22:24:06.646108 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:24:06.646083    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef3eaa1_c989_4c61_85cb_83e05b1c51e6.slice/crio-4673ff182c7026896a79cfed7e37cb414a217f1a02022ff61b780db2b191dcfb WatchSource:0}: Error finding container 4673ff182c7026896a79cfed7e37cb414a217f1a02022ff61b780db2b191dcfb: Status 404 returned error can't find the container with id 4673ff182c7026896a79cfed7e37cb414a217f1a02022ff61b780db2b191dcfb
Jul 20 22:24:06.662446 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.662421    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ms5c6"]
Jul 20 22:24:06.665567 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:24:06.665536    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06714327_8e4d_4ad8_b6cb_53290121c68c.slice/crio-4468d0bbc47264c429e01a55c7b4a7b6ead2ef8c4b518bef498e28678cc03a67 WatchSource:0}: Error finding container 4468d0bbc47264c429e01a55c7b4a7b6ead2ef8c4b518bef498e28678cc03a67: Status 404 returned error can't find the container with id 4468d0bbc47264c429e01a55c7b4a7b6ead2ef8c4b518bef498e28678cc03a67
Jul 20 22:24:06.717334 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:06.717231    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nzvqr"]
Jul 20 22:24:06.721939 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:24:06.721914    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc20f3abd_d34c_4a8b_9607_dd685e3baf6f.slice/crio-5b1f3787b7a72431c416f58f5b24e95ae969a0078cbc6e3590381dfc9966102c WatchSource:0}: Error finding container 5b1f3787b7a72431c416f58f5b24e95ae969a0078cbc6e3590381dfc9966102c: Status 404 returned error can't find the container with id 5b1f3787b7a72431c416f58f5b24e95ae969a0078cbc6e3590381dfc9966102c
Jul 20 22:24:07.203271 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:07.202721    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:24:07.203271 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:07.202669    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:24:07.206261 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:07.206242    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wpkcl\""
Jul 20 22:24:07.206411 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:07.206242    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 22:24:07.206411 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:07.206242    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 22:24:07.566143 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:07.566016    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dl7kw"
Jul 20 22:24:07.634072 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:07.633970    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nzvqr" event={"ID":"c20f3abd-d34c-4a8b-9607-dd685e3baf6f","Type":"ContainerStarted","Data":"5b1f3787b7a72431c416f58f5b24e95ae969a0078cbc6e3590381dfc9966102c"}
Jul 20 22:24:07.636038 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:07.636010    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5jdrv" event={"ID":"eef3eaa1-c989-4c61-85cb-83e05b1c51e6","Type":"ContainerStarted","Data":"4673ff182c7026896a79cfed7e37cb414a217f1a02022ff61b780db2b191dcfb"}
Jul 20 22:24:07.637728 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:07.637665    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ms5c6" event={"ID":"06714327-8e4d-4ad8-b6cb-53290121c68c","Type":"ContainerStarted","Data":"4468d0bbc47264c429e01a55c7b4a7b6ead2ef8c4b518bef498e28678cc03a67"}
Jul 20 22:24:09.645474 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:09.645437    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ms5c6" event={"ID":"06714327-8e4d-4ad8-b6cb-53290121c68c","Type":"ContainerStarted","Data":"0ce8effd3f95628042eaebf9acd5e6c8e98b2d7a0bbb3e313f8ff54a0b8865df"}
Jul 20 22:24:10.004357 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:10.004317    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-blxnc"]
Jul 20 22:24:10.012997 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:10.012972    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-blxnc"
Jul 20 22:24:10.017276 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:10.017244    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 20 22:24:10.017441 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:10.017293    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hsgfv\""
Jul 20 22:24:10.017755 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:10.017732    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-blxnc"]
Jul 20 22:24:10.197178 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:10.197140    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f83f2bd1-56a1-4d21-a9bd-ca074c49478c-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-blxnc\" (UID: \"f83f2bd1-56a1-4d21-a9bd-ca074c49478c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-blxnc"
Jul 20 22:24:10.298369 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:10.298288    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f83f2bd1-56a1-4d21-a9bd-ca074c49478c-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-blxnc\" (UID: \"f83f2bd1-56a1-4d21-a9bd-ca074c49478c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-blxnc"
Jul 20 22:24:10.298527 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:24:10.298455    2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 20 22:24:10.298581 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:24:10.298535    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f83f2bd1-56a1-4d21-a9bd-ca074c49478c-tls-certificates podName:f83f2bd1-56a1-4d21-a9bd-ca074c49478c nodeName:}" failed. No retries permitted until 2026-07-20 22:24:10.798516806 +0000 UTC m=+64.096733357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/f83f2bd1-56a1-4d21-a9bd-ca074c49478c-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-blxnc" (UID: "f83f2bd1-56a1-4d21-a9bd-ca074c49478c") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 20 22:24:10.802107 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:10.802073    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f83f2bd1-56a1-4d21-a9bd-ca074c49478c-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-blxnc\" (UID: \"f83f2bd1-56a1-4d21-a9bd-ca074c49478c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-blxnc"
Jul 20 22:24:10.804864 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:10.804838    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f83f2bd1-56a1-4d21-a9bd-ca074c49478c-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-blxnc\" (UID: \"f83f2bd1-56a1-4d21-a9bd-ca074c49478c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-blxnc"
Jul 20 22:24:10.924388 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:10.924359    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-blxnc"
Jul 20 22:24:11.910071 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:11.909994    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs\") pod \"network-metrics-daemon-f5458\" (UID: \"5aa2732a-c080-4b95-af51-91052aeb9be2\") " pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:24:11.910071 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:11.910065    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret\") pod \"global-pull-secret-syncer-465x2\" (UID: \"db2f1fd2-ec2a-4826-95de-24577a40fdf0\") " pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:24:11.912564 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:11.912545    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db2f1fd2-ec2a-4826-95de-24577a40fdf0-original-pull-secret\") pod \"global-pull-secret-syncer-465x2\" (UID: \"db2f1fd2-ec2a-4826-95de-24577a40fdf0\") " pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:24:11.912696 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:11.912545    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5aa2732a-c080-4b95-af51-91052aeb9be2-metrics-certs\") pod \"network-metrics-daemon-f5458\" (UID: \"5aa2732a-c080-4b95-af51-91052aeb9be2\") " pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:24:12.011295 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:12.011253    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv6s4\" (UniqueName: \"kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4\") pod \"network-check-target-295rv\" (UID: \"da300f87-f427-4da6-b75c-9acd5d86b32f\") " pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:24:12.014197 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:12.014176    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 22:24:12.016304 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:12.016284    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-465x2"
Jul 20 22:24:12.022457 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:12.022436    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5458"
Jul 20 22:24:12.024883 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:12.024865    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 22:24:12.035785 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:12.035757    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv6s4\" (UniqueName: \"kubernetes.io/projected/da300f87-f427-4da6-b75c-9acd5d86b32f-kube-api-access-sv6s4\") pod \"network-check-target-295rv\" (UID: \"da300f87-f427-4da6-b75c-9acd5d86b32f\") " pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:24:12.213279 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:12.213251    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vv84p\""
Jul 20 22:24:12.220410 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:12.220382    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:24:12.740891 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:12.740811    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-465x2"]
Jul 20 22:24:12.747761 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:24:12.747709    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb2f1fd2_ec2a_4826_95de_24577a40fdf0.slice/crio-423eec7592cc392034f3c71c8a428a211dae25652172d4b4ca8263a2a86683a4 WatchSource:0}: Error finding container 423eec7592cc392034f3c71c8a428a211dae25652172d4b4ca8263a2a86683a4: Status 404 returned error can't find the container with id 423eec7592cc392034f3c71c8a428a211dae25652172d4b4ca8263a2a86683a4
Jul 20 22:24:12.760197 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:12.758721    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-blxnc"]
Jul 20 22:24:12.766101 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:24:12.766069    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf83f2bd1_56a1_4d21_a9bd_ca074c49478c.slice/crio-90c85a16e5ab503fddb09e9837b12d94ff1b2f535d7ef2cd2c8773835437e64a WatchSource:0}: Error finding container 90c85a16e5ab503fddb09e9837b12d94ff1b2f535d7ef2cd2c8773835437e64a: Status 404 returned error can't find the container with id 90c85a16e5ab503fddb09e9837b12d94ff1b2f535d7ef2cd2c8773835437e64a
Jul 20 22:24:12.780476 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:12.780450    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-295rv"]
Jul 20 22:24:12.786200 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:24:12.786175    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda300f87_f427_4da6_b75c_9acd5d86b32f.slice/crio-7b489c839ffe985f80dd33dad6cb76388c03fecad71dd7dbd3de9d607f8d52b8 WatchSource:0}: Error finding container 7b489c839ffe985f80dd33dad6cb76388c03fecad71dd7dbd3de9d607f8d52b8: Status 404 returned error can't find the container with id 7b489c839ffe985f80dd33dad6cb76388c03fecad71dd7dbd3de9d607f8d52b8
Jul 20 22:24:12.987867 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:12.985931    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f5458"]
Jul 20 22:24:12.990420 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:24:12.990394    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa2732a_c080_4b95_af51_91052aeb9be2.slice/crio-25230bca850f4ebab16913cc134f0b4da8a373d2089f1953dd9afec0983d75ad WatchSource:0}: Error finding container 25230bca850f4ebab16913cc134f0b4da8a373d2089f1953dd9afec0983d75ad: Status 404 returned error can't find the container with id 25230bca850f4ebab16913cc134f0b4da8a373d2089f1953dd9afec0983d75ad
Jul 20 22:24:13.663622 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:13.663562    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f5458" event={"ID":"5aa2732a-c080-4b95-af51-91052aeb9be2","Type":"ContainerStarted","Data":"25230bca850f4ebab16913cc134f0b4da8a373d2089f1953dd9afec0983d75ad"}
Jul 20 22:24:13.665805 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:13.665779    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nzvqr" event={"ID":"c20f3abd-d34c-4a8b-9607-dd685e3baf6f","Type":"ContainerStarted","Data":"befcb7ab5d811d45f0376d440aebb614bc49aca934ade5902dc22e25a13e773c"}
Jul 20 22:24:13.669269 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:13.668554    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5jdrv" event={"ID":"eef3eaa1-c989-4c61-85cb-83e05b1c51e6","Type":"ContainerStarted","Data":"8477461b26a43e0520a3b3f5642ae5c59457d4306827dbc6d2c445bf06ddc9f1"}
Jul 20 22:24:13.674593 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:13.674562    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ms5c6" event={"ID":"06714327-8e4d-4ad8-b6cb-53290121c68c","Type":"ContainerStarted","Data":"cd4913882365f1f2743971d3e83c5d29e778ca00fb4f1acdd0be2a61e0c2c11c"}
Jul 20 22:24:13.674839 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:13.674821    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ms5c6"
Jul 20 22:24:13.679744 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:13.679720    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-295rv" event={"ID":"da300f87-f427-4da6-b75c-9acd5d86b32f","Type":"ContainerStarted","Data":"7b489c839ffe985f80dd33dad6cb76388c03fecad71dd7dbd3de9d607f8d52b8"}
Jul 20 22:24:13.682986 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:13.682917    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-465x2" event={"ID":"db2f1fd2-ec2a-4826-95de-24577a40fdf0","Type":"ContainerStarted","Data":"423eec7592cc392034f3c71c8a428a211dae25652172d4b4ca8263a2a86683a4"}
Jul 20 22:24:13.686122 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:13.686077    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5jdrv" podStartSLOduration=1.7958576229999998 podStartE2EDuration="7.686062334s" totalImagesPullingTime="5.890204711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:13.685190881 +0000 UTC m=+66.983407487" watchObservedRunningTime="2026-07-20 22:24:13.686062334 +0000 UTC m=+66.984278901"
Jul 20 22:24:13.687192 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:13.687167    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-blxnc" event={"ID":"f83f2bd1-56a1-4d21-a9bd-ca074c49478c","Type":"ContainerStarted","Data":"90c85a16e5ab503fddb09e9837b12d94ff1b2f535d7ef2cd2c8773835437e64a"}
Jul 20 22:24:13.702070 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:13.701728    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ms5c6" podStartSLOduration=5.716311029 podStartE2EDuration="7.701704383s" totalImagesPullingTime="1.985393354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:13.700797407 +0000 UTC m=+66.999013973" watchObservedRunningTime="2026-07-20 22:24:13.701704383 +0000 UTC m=+66.999920954"
Jul 20 22:24:15.696772 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:15.696722    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f5458" event={"ID":"5aa2732a-c080-4b95-af51-91052aeb9be2","Type":"ContainerStarted","Data":"5db19483189ce6cfab34e3367ba196e33fb49b2e73016454709f44a4f94a46ef"}
Jul 20 22:24:15.699319 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:15.699286    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-blxnc" event={"ID":"f83f2bd1-56a1-4d21-a9bd-ca074c49478c","Type":"ContainerStarted","Data":"7d1db9ebf946be8640137b84c3981c24be89f03adae273b813b9e99f84cc46be"}
Jul 20 22:24:15.700564 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:15.700243    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-blxnc"
Jul 20 22:24:15.706330 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:15.706284    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-blxnc"
Jul 20 22:24:15.717240 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:15.716876    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-blxnc" podStartSLOduration=4.759494353 podStartE2EDuration="6.71685174s" totalImagesPullingTime="1.957357387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:15.71639443 +0000 UTC m=+69.014611003" watchObservedRunningTime="2026-07-20 22:24:15.71685174 +0000 UTC m=+69.015068311"
Jul 20 22:24:16.084670 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:16.084573    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-pz6lf"]
Jul 20 22:24:16.094492 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:16.094461    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-pz6lf"
Jul 20 22:24:16.097185 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:16.097160    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 22:24:16.098367 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:16.097748    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 22:24:16.098367 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:16.097788    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xpq5v\""
Jul 20 22:24:16.098367 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:16.098189    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 20 22:24:16.098367 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:16.098251    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 20 22:24:16.098367 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:16.098297    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 22:24:16.098860 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:16.098838    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-pz6lf"]
Jul 20 22:24:16.247812 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:16.247774    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-pz6lf\" (UID: \"8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pz6lf"
Jul 20 22:24:16.247812 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:16.247817    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-pz6lf\" (UID: \"8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pz6lf"
Jul 20 22:24:16.247996 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:16.247838    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-pz6lf\" (UID: \"8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pz6lf"
Jul 20 22:24:16.247996 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:16.247865    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-797bc\" (UniqueName: \"kubernetes.io/projected/8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9-kube-api-access-797bc\") pod \"prometheus-operator-5945b5cfd-pz6lf\" (UID: \"8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pz6lf"
Jul 20 22:24:16.348705 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:16.348633    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-pz6lf\" (UID: \"8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pz6lf"
Jul 20 22:24:16.348705 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:16.348677    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-pz6lf\" (UID: \"8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pz6lf"
Jul 20 22:24:16.348705 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:16.348702    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-pz6lf\" (UID: \"8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pz6lf"
Jul 20 22:24:16.348963 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:16.348727    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-797bc\" (UniqueName: \"kubernetes.io/projected/8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9-kube-api-access-797bc\") pod \"prometheus-operator-5945b5cfd-pz6lf\" (UID: \"8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pz6lf"
Jul 20 22:24:16.349378 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:16.349354    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-pz6lf\" (UID: \"8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pz6lf"
Jul 20 22:24:16.350904 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:16.350882    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-pz6lf\" (UID: \"8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pz6lf"
Jul 20 22:24:16.351063 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:16.351045    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-pz6lf\" (UID: \"8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pz6lf"
Jul 20 22:24:16.358620 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:16.358580    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-797bc\" (UniqueName: \"kubernetes.io/projected/8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9-kube-api-access-797bc\") pod \"prometheus-operator-5945b5cfd-pz6lf\" (UID: \"8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pz6lf"
Jul 20 22:24:16.407251 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:16.407215    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-pz6lf"
Jul 20 22:24:19.537109 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:19.537083    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-pz6lf"]
Jul 20 22:24:19.539383 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:24:19.539347    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a55c805_15e8_4dc5_a6ea_fdb67bb3fbe9.slice/crio-59770528329d3a4241c03607706c6514a7fd23b2cea671380e6664a4d64cfe58 WatchSource:0}: Error finding container 59770528329d3a4241c03607706c6514a7fd23b2cea671380e6664a4d64cfe58: Status 404 returned error can't find the container with id 59770528329d3a4241c03607706c6514a7fd23b2cea671380e6664a4d64cfe58
Jul 20 22:24:19.716333 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:19.716298    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f5458" event={"ID":"5aa2732a-c080-4b95-af51-91052aeb9be2","Type":"ContainerStarted","Data":"fc26e16ca8ec806d8c4a82c7c4acb8e5e6075b47263e97d40c3dee739f75d8aa"}
Jul 20 22:24:19.718044 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:19.718016    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nzvqr" event={"ID":"c20f3abd-d34c-4a8b-9607-dd685e3baf6f","Type":"ContainerStarted","Data":"e2898a75ef59f7a64434c5dc94440e36b8600a7a9d217d8b555bb1bcc8e7bc65"}
Jul 20 22:24:19.719359 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:19.719330    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-295rv" event={"ID":"da300f87-f427-4da6-b75c-9acd5d86b32f","Type":"ContainerStarted","Data":"65a4cac3eb0cb5f013624c6b7a33aca3278b37db297ace32e94c3398ff832ddd"}
Jul 20 22:24:19.719498 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:19.719450    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:24:19.720853 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:19.720821    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-465x2" event={"ID":"db2f1fd2-ec2a-4826-95de-24577a40fdf0","Type":"ContainerStarted","Data":"188002641f1f4848a7df1efef8a1e7e7eecf361a5ced7d3a295d82fa429365a1"}
Jul 20 22:24:19.721920 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:19.721900    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-pz6lf" event={"ID":"8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9","Type":"ContainerStarted","Data":"59770528329d3a4241c03607706c6514a7fd23b2cea671380e6664a4d64cfe58"}
Jul 20 22:24:19.734031 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:19.733987    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f5458" podStartSLOduration=70.996394565 podStartE2EDuration="1m12.733972991s" totalImagesPullingTime="1.737578426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:23:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:19.733467242 +0000 UTC m=+73.031683816" watchObservedRunningTime="2026-07-20 22:24:19.733972991 +0000 UTC m=+73.032189560"
Jul 20 22:24:19.750111 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:19.750063    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-465x2" podStartSLOduration=65.114829776 podStartE2EDuration="1m11.750045698s" totalImagesPullingTime="6.635215922s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:23:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:19.749678578 +0000 UTC m=+73.047895150" watchObservedRunningTime="2026-07-20 22:24:19.750045698 +0000 UTC m=+73.048262259"
Jul 20 22:24:19.768448 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:19.768396    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-295rv" podStartSLOduration=65.186210341 podStartE2EDuration="1m11.768378797s" totalImagesPullingTime="6.582168456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:23:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:19.767773328 +0000 UTC m=+73.065989922" watchObservedRunningTime="2026-07-20 22:24:19.768378797 +0000 UTC m=+73.066595410"
Jul 20 22:24:20.692471 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:20.692440    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ms5c6"
Jul 20 22:24:21.733064 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:21.733026    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-pz6lf" event={"ID":"8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9","Type":"ContainerStarted","Data":"3276e6b118b66f25e6f7c2e65d3199065e9cb43934fd0e835c8a046c5754d6d8"}
Jul 20 22:24:21.733498 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:21.733096    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-pz6lf" event={"ID":"8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9","Type":"ContainerStarted","Data":"4bcc333acb5ec8f48389ec4016592ddd2852953bffd0a9eb85a786aef59103a9"}
Jul 20 22:24:21.752364 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:21.752309    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-pz6lf" podStartSLOduration=4.546947325 podStartE2EDuration="5.75228966s" totalImagesPullingTime="1.205342335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:21.751671935 +0000 UTC m=+75.049888505" watchObservedRunningTime="2026-07-20 22:24:21.75228966 +0000 UTC m=+75.050506236"
Jul 20 22:24:23.518115 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.518032    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-5d2sp"]
Jul 20 22:24:23.521090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.521074    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5d2sp"
Jul 20 22:24:23.524001 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.523978    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wxv2g\""
Jul 20 22:24:23.524745 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.524725    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 20 22:24:23.530431 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.530414    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 20 22:24:23.532661 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.532640    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-p6ctq"]
Jul 20 22:24:23.536120 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.536101    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq"
Jul 20 22:24:23.537716 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.537581    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-5d2sp"]
Jul 20 22:24:23.540833 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.540794    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 20 22:24:23.541680 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.541576    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-v4rqp\""
Jul 20 22:24:23.542189 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.542169    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 20 22:24:23.542404 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.542385    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 20 22:24:23.566320 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.566296    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-p6ctq"]
Jul 20 22:24:23.576312 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.576291    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-djtt5"]
Jul 20 22:24:23.579436 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.579415    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.582422 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.582402    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 22:24:23.582516 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.582415    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-k4svg\""
Jul 20 22:24:23.582516 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.582407    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 22:24:23.582629 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.582561    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 22:24:23.600973 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.600949    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b7dae53-5d1f-4302-b38d-16d070ddd44f-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-p6ctq\" (UID: \"3b7dae53-5d1f-4302-b38d-16d070ddd44f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq"
Jul 20 22:24:23.601074 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.600980    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b7dae53-5d1f-4302-b38d-16d070ddd44f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-p6ctq\" (UID: \"3b7dae53-5d1f-4302-b38d-16d070ddd44f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq"
Jul 20 22:24:23.601074 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.600999    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/97f7efca-b402-48e2-b63c-4aa4b417624d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-5d2sp\" (UID: \"97f7efca-b402-48e2-b63c-4aa4b417624d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5d2sp"
Jul 20 22:24:23.601074 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.601015    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3b7dae53-5d1f-4302-b38d-16d070ddd44f-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-p6ctq\" (UID: \"3b7dae53-5d1f-4302-b38d-16d070ddd44f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq"
Jul 20 22:24:23.601074 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.601037    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.601074 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.601062    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-root\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.601234 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.601124    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-node-exporter-accelerators-collector-config\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.601234 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.601187    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6wr2\" (UniqueName: \"kubernetes.io/projected/97f7efca-b402-48e2-b63c-4aa4b417624d-kube-api-access-p6wr2\") pod \"openshift-state-metrics-79f6958cdf-5d2sp\" (UID: \"97f7efca-b402-48e2-b63c-4aa4b417624d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5d2sp"
Jul 20 22:24:23.601234 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.601214    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3b7dae53-5d1f-4302-b38d-16d070ddd44f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-p6ctq\" (UID: \"3b7dae53-5d1f-4302-b38d-16d070ddd44f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq"
Jul 20 22:24:23.601234 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.601231    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-node-exporter-wtmp\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.601349 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.601258    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-node-exporter-textfile\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.601349 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.601296    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4k4k\" (UniqueName: \"kubernetes.io/projected/3b7dae53-5d1f-4302-b38d-16d070ddd44f-kube-api-access-z4k4k\") pod \"kube-state-metrics-56c5594674-p6ctq\" (UID: \"3b7dae53-5d1f-4302-b38d-16d070ddd44f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq"
Jul 20 22:24:23.601349 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.601326    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b7dae53-5d1f-4302-b38d-16d070ddd44f-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-p6ctq\" (UID: \"3b7dae53-5d1f-4302-b38d-16d070ddd44f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq"
Jul 20 22:24:23.601433 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.601368    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-sys\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.601433 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.601384    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-node-exporter-tls\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.601433 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.601399    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqvgd\" (UniqueName: \"kubernetes.io/projected/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-kube-api-access-nqvgd\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.601433 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.601414    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-metrics-client-ca\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.601433 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.601431    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97f7efca-b402-48e2-b63c-4aa4b417624d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-5d2sp\" (UID: \"97f7efca-b402-48e2-b63c-4aa4b417624d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5d2sp"
Jul 20 22:24:23.601583 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.601447    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97f7efca-b402-48e2-b63c-4aa4b417624d-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-5d2sp\" (UID: \"97f7efca-b402-48e2-b63c-4aa4b417624d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5d2sp"
Jul 20 22:24:23.701759 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.701719    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-sys\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.701759 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.701760    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-node-exporter-tls\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.701997 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.701780    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqvgd\" (UniqueName: \"kubernetes.io/projected/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-kube-api-access-nqvgd\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.701997 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.701808    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-metrics-client-ca\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.701997 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.701827    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-sys\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.701997 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.701836    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97f7efca-b402-48e2-b63c-4aa4b417624d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-5d2sp\" (UID: \"97f7efca-b402-48e2-b63c-4aa4b417624d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5d2sp"
Jul 20 22:24:23.701997 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.701884    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97f7efca-b402-48e2-b63c-4aa4b417624d-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-5d2sp\" (UID: \"97f7efca-b402-48e2-b63c-4aa4b417624d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5d2sp"
Jul 20 22:24:23.701997 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.701923    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b7dae53-5d1f-4302-b38d-16d070ddd44f-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-p6ctq\" (UID: \"3b7dae53-5d1f-4302-b38d-16d070ddd44f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq"
Jul 20 22:24:23.701997 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.701956    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b7dae53-5d1f-4302-b38d-16d070ddd44f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-p6ctq\" (UID: \"3b7dae53-5d1f-4302-b38d-16d070ddd44f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq"
Jul 20 22:24:23.701997 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.701981    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/97f7efca-b402-48e2-b63c-4aa4b417624d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-5d2sp\" (UID: \"97f7efca-b402-48e2-b63c-4aa4b417624d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5d2sp"
Jul 20 22:24:23.701997 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.701999    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3b7dae53-5d1f-4302-b38d-16d070ddd44f-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-p6ctq\" (UID: \"3b7dae53-5d1f-4302-b38d-16d070ddd44f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq"
Jul 20 22:24:23.702402 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.702032    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.702402 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.702064    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-root\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.702402 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.702090    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-node-exporter-accelerators-collector-config\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.702402 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.702122    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6wr2\" (UniqueName: \"kubernetes.io/projected/97f7efca-b402-48e2-b63c-4aa4b417624d-kube-api-access-p6wr2\") pod \"openshift-state-metrics-79f6958cdf-5d2sp\" (UID: \"97f7efca-b402-48e2-b63c-4aa4b417624d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5d2sp"
Jul 20 22:24:23.702402 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.702152    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3b7dae53-5d1f-4302-b38d-16d070ddd44f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-p6ctq\" (UID: \"3b7dae53-5d1f-4302-b38d-16d070ddd44f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq"
Jul 20 22:24:23.702402 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.702205    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-node-exporter-wtmp\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.702402 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.702282    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-node-exporter-textfile\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.702402 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.702334    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4k4k\" (UniqueName: \"kubernetes.io/projected/3b7dae53-5d1f-4302-b38d-16d070ddd44f-kube-api-access-z4k4k\") pod \"kube-state-metrics-56c5594674-p6ctq\" (UID: \"3b7dae53-5d1f-4302-b38d-16d070ddd44f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq"
Jul 20 22:24:23.702402 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.702366    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b7dae53-5d1f-4302-b38d-16d070ddd44f-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-p6ctq\" (UID: \"3b7dae53-5d1f-4302-b38d-16d070ddd44f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq"
Jul 20 22:24:23.702936 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.702538    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-metrics-client-ca\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.703126 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.703099    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b7dae53-5d1f-4302-b38d-16d070ddd44f-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-p6ctq\" (UID: \"3b7dae53-5d1f-4302-b38d-16d070ddd44f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq"
Jul 20 22:24:23.703276 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.703240    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97f7efca-b402-48e2-b63c-4aa4b417624d-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-5d2sp\" (UID: \"97f7efca-b402-48e2-b63c-4aa4b417624d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5d2sp"
Jul 20 22:24:23.703415 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.703255    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3b7dae53-5d1f-4302-b38d-16d070ddd44f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-p6ctq\" (UID: \"3b7dae53-5d1f-4302-b38d-16d070ddd44f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq"
Jul 20 22:24:23.703415 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.703338    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-root\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.703520 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.703485    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-node-exporter-wtmp\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.703866 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.703824    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-node-exporter-textfile\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.703965 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.703925    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3b7dae53-5d1f-4302-b38d-16d070ddd44f-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-p6ctq\" (UID: \"3b7dae53-5d1f-4302-b38d-16d070ddd44f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq"
Jul 20 22:24:23.704397 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.704371    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-node-exporter-accelerators-collector-config\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.704972 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.704949    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-node-exporter-tls\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.705071 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.704955    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97f7efca-b402-48e2-b63c-4aa4b417624d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-5d2sp\" (UID: \"97f7efca-b402-48e2-b63c-4aa4b417624d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5d2sp"
Jul 20 22:24:23.705183 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.705158    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b7dae53-5d1f-4302-b38d-16d070ddd44f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-p6ctq\" (UID: \"3b7dae53-5d1f-4302-b38d-16d070ddd44f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq"
Jul 20 22:24:23.705423 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.705403    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.705648 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.705630    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b7dae53-5d1f-4302-b38d-16d070ddd44f-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-p6ctq\" (UID: \"3b7dae53-5d1f-4302-b38d-16d070ddd44f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq"
Jul 20 22:24:23.705770 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.705753    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/97f7efca-b402-48e2-b63c-4aa4b417624d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-5d2sp\" (UID: \"97f7efca-b402-48e2-b63c-4aa4b417624d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5d2sp"
Jul 20 22:24:23.711248 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.711229    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqvgd\" (UniqueName: \"kubernetes.io/projected/e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5-kube-api-access-nqvgd\") pod \"node-exporter-djtt5\" (UID: \"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5\") " pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.712985 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.712962    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4k4k\" (UniqueName: \"kubernetes.io/projected/3b7dae53-5d1f-4302-b38d-16d070ddd44f-kube-api-access-z4k4k\") pod \"kube-state-metrics-56c5594674-p6ctq\" (UID: \"3b7dae53-5d1f-4302-b38d-16d070ddd44f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq"
Jul 20 22:24:23.713324 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.713304    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6wr2\" (UniqueName: \"kubernetes.io/projected/97f7efca-b402-48e2-b63c-4aa4b417624d-kube-api-access-p6wr2\") pod \"openshift-state-metrics-79f6958cdf-5d2sp\" (UID: \"97f7efca-b402-48e2-b63c-4aa4b417624d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5d2sp"
Jul 20 22:24:23.742648 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.742600    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nzvqr" event={"ID":"c20f3abd-d34c-4a8b-9607-dd685e3baf6f","Type":"ContainerStarted","Data":"2191fc46040a9c178c8b61bad39f65902162e2018b3d48167c799e7a82dedc71"}
Jul 20 22:24:23.768396 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.768316    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nzvqr" podStartSLOduration=1.472560634 podStartE2EDuration="17.768301352s" totalImagesPullingTime="16.295740718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:24:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:23.767860932 +0000 UTC m=+77.066077501" watchObservedRunningTime="2026-07-20 22:24:23.768301352 +0000 UTC m=+77.066517922"
Jul 20 22:24:23.830177 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.830144    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5d2sp"
Jul 20 22:24:23.847658 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.847630    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq"
Jul 20 22:24:23.889158 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.888743    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-djtt5"
Jul 20 22:24:23.904400 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:24:23.904358    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4dbf8b7_2eab_4f09_a246_3c4e0f910ca5.slice/crio-1dfcdc8dd6769385110aeccd0b6611efb8df0fba0b00d069ab31f2953649b9e1 WatchSource:0}: Error finding container 1dfcdc8dd6769385110aeccd0b6611efb8df0fba0b00d069ab31f2953649b9e1: Status 404 returned error can't find the container with id 1dfcdc8dd6769385110aeccd0b6611efb8df0fba0b00d069ab31f2953649b9e1
Jul 20 22:24:23.970045 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.970014    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-5d2sp"]
Jul 20 22:24:23.972875 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:24:23.972848    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97f7efca_b402_48e2_b63c_4aa4b417624d.slice/crio-25a78001af1333eb40c6cf185e74a9de3e1c42651083b06950fe512cdce1c46a WatchSource:0}: Error finding container 25a78001af1333eb40c6cf185e74a9de3e1c42651083b06950fe512cdce1c46a: Status 404 returned error can't find the container with id 25a78001af1333eb40c6cf185e74a9de3e1c42651083b06950fe512cdce1c46a
Jul 20 22:24:23.990974 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:23.990889    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-p6ctq"]
Jul 20 22:24:24.008731 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:24:24.008697    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b7dae53_5d1f_4302_b38d_16d070ddd44f.slice/crio-6df2fb3931cd42e11057fc57fe654cdc95c8b1d54be0acac174a6fdda846587a WatchSource:0}: Error finding container 6df2fb3931cd42e11057fc57fe654cdc95c8b1d54be0acac174a6fdda846587a: Status 404 returned error can't find the container with id 6df2fb3931cd42e11057fc57fe654cdc95c8b1d54be0acac174a6fdda846587a
Jul 20 22:24:24.554354 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.554305    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 22:24:24.557962 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.557941    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.562654 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.562601    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 20 22:24:24.562893 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.562867    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 20 22:24:24.563295 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.563035    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 20 22:24:24.563380 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.563312    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 20 22:24:24.564161 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.563502    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 20 22:24:24.564161 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.563719    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 20 22:24:24.564161 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.563788    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 20 22:24:24.564161 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.563825    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 20 22:24:24.564161 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.563834    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 20 22:24:24.564161 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.563938    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hcvnx\""
Jul 20 22:24:24.583424 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.583389    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 22:24:24.608711 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.608317    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.608711 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.608358    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ls96\" (UniqueName: \"kubernetes.io/projected/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-kube-api-access-8ls96\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.608711 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.608390    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-config-out\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.608711 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.608440    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.608711 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.608472    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.608711 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.608517    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.608711 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.608541    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.608711 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.608577    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.608711 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.608601    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.608711 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.608656    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.608711 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.608682    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.609351 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.608753    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.609351 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.608796    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-web-config\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.710035 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.709947    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.710035 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.709994    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ls96\" (UniqueName: \"kubernetes.io/projected/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-kube-api-access-8ls96\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.710035 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.710023    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-config-out\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.710326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.710078    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.710326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.710115    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.710326 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:24:24.710144    2556 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 20 22:24:24.710326 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:24:24.710237    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-main-tls podName:7d8732b0-8c68-4308-86bc-ca5f3fd54ef8 nodeName:}" failed. No retries permitted until 2026-07-20 22:24:25.21020627 +0000 UTC m=+78.508422833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8") : secret "alertmanager-main-tls" not found
Jul 20 22:24:24.710530 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.710147    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.710530 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.710521    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.711667 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.710583    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.711667 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.710634    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.711667 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.710675    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.711667 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.710708    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.711667 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.710741    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.711667 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.710773    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-web-config\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.711667 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.711449    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.712090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.711726    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.712090 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:24:24.711967    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-alertmanager-trusted-ca-bundle podName:7d8732b0-8c68-4308-86bc-ca5f3fd54ef8 nodeName:}" failed. No retries permitted until 2026-07-20 22:24:25.211940778 +0000 UTC m=+78.510157348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8") : configmap references non-existent config key: ca-bundle.crt
Jul 20 22:24:24.714069 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.714037    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-web-config\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.716397 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.716278    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.717517 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.716675    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-config-out\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.717517 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.716921    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.717517 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.717239    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.717846 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.717293    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.717846 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.717646    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.717957 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.717890    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.727532 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.727486    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ls96\" (UniqueName: \"kubernetes.io/projected/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-kube-api-access-8ls96\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:24.753791 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.752829    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-djtt5" event={"ID":"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5","Type":"ContainerStarted","Data":"1dfcdc8dd6769385110aeccd0b6611efb8df0fba0b00d069ab31f2953649b9e1"}
Jul 20 22:24:24.757346 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.757206    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5d2sp" event={"ID":"97f7efca-b402-48e2-b63c-4aa4b417624d","Type":"ContainerStarted","Data":"ac4bed040ec2a8cd592933f9cec0b7e3ce531c5354b3cb2bd4568bd344134d47"}
Jul 20 22:24:24.757346 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.757281    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5d2sp" event={"ID":"97f7efca-b402-48e2-b63c-4aa4b417624d","Type":"ContainerStarted","Data":"2d142d273021adced553a64a645b1a279f66cac44868b3c6c0cee90e78ae804a"}
Jul 20 22:24:24.757346 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.757310    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5d2sp" event={"ID":"97f7efca-b402-48e2-b63c-4aa4b417624d","Type":"ContainerStarted","Data":"25a78001af1333eb40c6cf185e74a9de3e1c42651083b06950fe512cdce1c46a"}
Jul 20 22:24:24.758533 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:24.758506    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq" event={"ID":"3b7dae53-5d1f-4302-b38d-16d070ddd44f","Type":"ContainerStarted","Data":"6df2fb3931cd42e11057fc57fe654cdc95c8b1d54be0acac174a6fdda846587a"}
Jul 20 22:24:25.215392 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:25.215354    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:25.215570 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:25.215415    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:25.216342 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:25.216314    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:25.218143 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:25.218117    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:25.471509 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:25.471470    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:25.650667 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:25.650558    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 22:24:25.656251 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:24:25.656177    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d8732b0_8c68_4308_86bc_ca5f3fd54ef8.slice/crio-17fcfc71f85a66ea09f56c05242573e7bb99996ec1e7d38013c264842381d50b WatchSource:0}: Error finding container 17fcfc71f85a66ea09f56c05242573e7bb99996ec1e7d38013c264842381d50b: Status 404 returned error can't find the container with id 17fcfc71f85a66ea09f56c05242573e7bb99996ec1e7d38013c264842381d50b
Jul 20 22:24:25.765055 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:25.765012    2556 generic.go:356] "Generic (PLEG): container finished" podID="e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5" containerID="34d4baae21260f14a8e66e04c4a1e8f8cc28ef3b44ee552c95d1dc1c5934166a" exitCode=0
Jul 20 22:24:25.765284 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:25.765213    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-djtt5" event={"ID":"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5","Type":"ContainerDied","Data":"34d4baae21260f14a8e66e04c4a1e8f8cc28ef3b44ee552c95d1dc1c5934166a"}
Jul 20 22:24:25.768490 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:25.768458    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5d2sp" event={"ID":"97f7efca-b402-48e2-b63c-4aa4b417624d","Type":"ContainerStarted","Data":"675dbae7aa8531c7e1e9e84fa9d60b8006e5d3f0eff721270fb62a935b6980a6"}
Jul 20 22:24:25.769962 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:25.769921    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8","Type":"ContainerStarted","Data":"17fcfc71f85a66ea09f56c05242573e7bb99996ec1e7d38013c264842381d50b"}
Jul 20 22:24:25.772687 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:25.772661    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq" event={"ID":"3b7dae53-5d1f-4302-b38d-16d070ddd44f","Type":"ContainerStarted","Data":"c9b7195acfebdacfa85211fe7ce39bc3d0319ffeec3ca72472fed8efc47845ae"}
Jul 20 22:24:25.772793 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:25.772714    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq" event={"ID":"3b7dae53-5d1f-4302-b38d-16d070ddd44f","Type":"ContainerStarted","Data":"b9ec15cb5ec43ab30088bc692c4cbb227160501a13b343711d3e8cb133325e47"}
Jul 20 22:24:25.772793 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:25.772742    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq" event={"ID":"3b7dae53-5d1f-4302-b38d-16d070ddd44f","Type":"ContainerStarted","Data":"aec95c554e6379ed070afe18e37ec0b5c9d4fa0ebb6d06655f2db17e7eebc36c"}
Jul 20 22:24:25.829836 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:25.829779    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5d2sp" podStartSLOduration=1.453791761 podStartE2EDuration="2.829759185s" totalImagesPullingTime="1.375967424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:25.829743795 +0000 UTC m=+79.127960366" watchObservedRunningTime="2026-07-20 22:24:25.829759185 +0000 UTC m=+79.127975756"
Jul 20 22:24:25.883568 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:25.883490    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-p6ctq" podStartSLOduration=1.411891888 podStartE2EDuration="2.883475325s" totalImagesPullingTime="1.471583437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:25.882013844 +0000 UTC m=+79.180230413" watchObservedRunningTime="2026-07-20 22:24:25.883475325 +0000 UTC m=+79.181691895"
Jul 20 22:24:26.542287 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.542253    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-86b5c47444-6gv2m"]
Jul 20 22:24:26.546097 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.546073    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.551200 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.551175    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 20 22:24:26.553794 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.553768    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8nr2x\""
Jul 20 22:24:26.553912 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.553839    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fqlnjck2b112p\""
Jul 20 22:24:26.553912 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.553871    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 20 22:24:26.554032 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.553999    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 20 22:24:26.554132 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.554096    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 20 22:24:26.554263 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.554176    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 20 22:24:26.567267 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.567241    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86b5c47444-6gv2m"]
Jul 20 22:24:26.625929 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.625896    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.626084 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.625938    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-metrics-client-ca\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.626084 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.625968    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-secret-grpc-tls\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.626084 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.626001    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.626084 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.626030    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.626084 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.626049    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.626084 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.626071    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml8m5\" (UniqueName: \"kubernetes.io/projected/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-kube-api-access-ml8m5\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.626263 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.626098    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-secret-thanos-querier-tls\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.727243 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.727218    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.727660 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.727250    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.727660 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.727270    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml8m5\" (UniqueName: \"kubernetes.io/projected/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-kube-api-access-ml8m5\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.727660 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.727288    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-secret-thanos-querier-tls\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.727660 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.727481    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.727660 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.727537    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-metrics-client-ca\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.727660 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.727581    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-secret-grpc-tls\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.727660 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.727629    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.728371 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.728305    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-metrics-client-ca\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.730073 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.730052    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.730325 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.730297    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-secret-thanos-querier-tls\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.730387 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.730340    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.730387 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.730379    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.730777 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.730662    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-secret-grpc-tls\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.730937 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.730919    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.736505 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.736479    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml8m5\" (UniqueName: \"kubernetes.io/projected/73d2bb5d-12c8-4d4a-b379-793cda2a1a5b-kube-api-access-ml8m5\") pod \"thanos-querier-86b5c47444-6gv2m\" (UID: \"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b\") " pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.778435 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.778403    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-djtt5" event={"ID":"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5","Type":"ContainerStarted","Data":"32ad89afd995b97eea9b6efc77051f8b6a3ff1d07f05e048709e284b8c798042"}
Jul 20 22:24:26.778585 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.778462    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-djtt5" event={"ID":"e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5","Type":"ContainerStarted","Data":"a50e5661c0e9c4376ea6b4dd54cf86a062a6c9a47c644945c54a311d18e6cf2a"}
Jul 20 22:24:26.780081 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.780052    2556 generic.go:356] "Generic (PLEG): container finished" podID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerID="a0aecdf506856303d4e65a5e97a3d317da4214e0c612d2a00a6154dd05f0671e" exitCode=0
Jul 20 22:24:26.780198 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.780142    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8","Type":"ContainerDied","Data":"a0aecdf506856303d4e65a5e97a3d317da4214e0c612d2a00a6154dd05f0671e"}
Jul 20 22:24:26.800889 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.800839    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-djtt5" podStartSLOduration=2.147188721 podStartE2EDuration="3.800823936s" totalImagesPullingTime="1.568230898s" totalInitContainerRuntime="85.404317ms" isStatefulPod=true podCreationTimestamp="2026-07-20 22:24:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:26.799173467 +0000 UTC m=+80.097390038" watchObservedRunningTime="2026-07-20 22:24:26.800823936 +0000 UTC m=+80.099040503"
Jul 20 22:24:26.860598 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.860561    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:26.993071 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:26.993039    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86b5c47444-6gv2m"]
Jul 20 22:24:26.995681 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:24:26.995656    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d2bb5d_12c8_4d4a_b379_793cda2a1a5b.slice/crio-ce628950384ac9fb91941f6e7076117cf3527cbb6e468f640a2715411ee7a2a6 WatchSource:0}: Error finding container ce628950384ac9fb91941f6e7076117cf3527cbb6e468f640a2715411ee7a2a6: Status 404 returned error can't find the container with id ce628950384ac9fb91941f6e7076117cf3527cbb6e468f640a2715411ee7a2a6
Jul 20 22:24:27.791407 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:27.791309    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m" event={"ID":"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b","Type":"ContainerStarted","Data":"ce628950384ac9fb91941f6e7076117cf3527cbb6e468f640a2715411ee7a2a6"}
Jul 20 22:24:27.847124 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:27.847084    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-556596fb4d-c6bwb"]
Jul 20 22:24:27.850951 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:27.850860    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:27.853396 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:27.853365    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nktmh\""
Jul 20 22:24:27.854435 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:27.854390    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 20 22:24:27.854783 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:27.854641    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9m0og808etuo4\""
Jul 20 22:24:27.854783 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:27.854659    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 20 22:24:27.854783 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:27.854680    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 20 22:24:27.854783 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:27.854734    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 20 22:24:27.862449 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:27.862394    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-556596fb4d-c6bwb"]
Jul 20 22:24:27.938546 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:27.938418    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4775f561-03d0-44a2-95f6-ccc83cfb63d4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-556596fb4d-c6bwb\" (UID: \"4775f561-03d0-44a2-95f6-ccc83cfb63d4\") " pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:27.938546 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:27.938482    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4775f561-03d0-44a2-95f6-ccc83cfb63d4-secret-metrics-server-tls\") pod \"metrics-server-556596fb4d-c6bwb\" (UID: \"4775f561-03d0-44a2-95f6-ccc83cfb63d4\") " pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:27.938546 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:27.938511    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4775f561-03d0-44a2-95f6-ccc83cfb63d4-metrics-server-audit-profiles\") pod \"metrics-server-556596fb4d-c6bwb\" (UID: \"4775f561-03d0-44a2-95f6-ccc83cfb63d4\") " pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:27.938881 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:27.938633    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4775f561-03d0-44a2-95f6-ccc83cfb63d4-audit-log\") pod \"metrics-server-556596fb4d-c6bwb\" (UID: \"4775f561-03d0-44a2-95f6-ccc83cfb63d4\") " pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:27.938881 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:27.938669    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4775f561-03d0-44a2-95f6-ccc83cfb63d4-client-ca-bundle\") pod \"metrics-server-556596fb4d-c6bwb\" (UID: \"4775f561-03d0-44a2-95f6-ccc83cfb63d4\") " pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:27.938881 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:27.938705    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf9lv\" (UniqueName: \"kubernetes.io/projected/4775f561-03d0-44a2-95f6-ccc83cfb63d4-kube-api-access-pf9lv\") pod \"metrics-server-556596fb4d-c6bwb\" (UID: \"4775f561-03d0-44a2-95f6-ccc83cfb63d4\") " pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:27.938881 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:27.938736    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4775f561-03d0-44a2-95f6-ccc83cfb63d4-secret-metrics-server-client-certs\") pod \"metrics-server-556596fb4d-c6bwb\" (UID: \"4775f561-03d0-44a2-95f6-ccc83cfb63d4\") " pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:28.040178 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.040146    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf9lv\" (UniqueName: \"kubernetes.io/projected/4775f561-03d0-44a2-95f6-ccc83cfb63d4-kube-api-access-pf9lv\") pod \"metrics-server-556596fb4d-c6bwb\" (UID: \"4775f561-03d0-44a2-95f6-ccc83cfb63d4\") " pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:28.040362 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.040195    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4775f561-03d0-44a2-95f6-ccc83cfb63d4-secret-metrics-server-client-certs\") pod \"metrics-server-556596fb4d-c6bwb\" (UID: \"4775f561-03d0-44a2-95f6-ccc83cfb63d4\") " pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:28.040362 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.040250    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4775f561-03d0-44a2-95f6-ccc83cfb63d4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-556596fb4d-c6bwb\" (UID: \"4775f561-03d0-44a2-95f6-ccc83cfb63d4\") " pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:28.040362 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.040291    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4775f561-03d0-44a2-95f6-ccc83cfb63d4-secret-metrics-server-tls\") pod \"metrics-server-556596fb4d-c6bwb\" (UID: \"4775f561-03d0-44a2-95f6-ccc83cfb63d4\") " pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:28.040362 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.040319    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4775f561-03d0-44a2-95f6-ccc83cfb63d4-metrics-server-audit-profiles\") pod \"metrics-server-556596fb4d-c6bwb\" (UID: \"4775f561-03d0-44a2-95f6-ccc83cfb63d4\") " pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:28.040575 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.040365    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4775f561-03d0-44a2-95f6-ccc83cfb63d4-audit-log\") pod \"metrics-server-556596fb4d-c6bwb\" (UID: \"4775f561-03d0-44a2-95f6-ccc83cfb63d4\") " pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:28.040575 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.040391    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4775f561-03d0-44a2-95f6-ccc83cfb63d4-client-ca-bundle\") pod \"metrics-server-556596fb4d-c6bwb\" (UID: \"4775f561-03d0-44a2-95f6-ccc83cfb63d4\") " pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:28.041123 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.041098    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4775f561-03d0-44a2-95f6-ccc83cfb63d4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-556596fb4d-c6bwb\" (UID: \"4775f561-03d0-44a2-95f6-ccc83cfb63d4\") " pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:28.041230 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.041145    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4775f561-03d0-44a2-95f6-ccc83cfb63d4-audit-log\") pod \"metrics-server-556596fb4d-c6bwb\" (UID: \"4775f561-03d0-44a2-95f6-ccc83cfb63d4\") " pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:28.041439 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.041381    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4775f561-03d0-44a2-95f6-ccc83cfb63d4-metrics-server-audit-profiles\") pod \"metrics-server-556596fb4d-c6bwb\" (UID: \"4775f561-03d0-44a2-95f6-ccc83cfb63d4\") " pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:28.043515 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.043473    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4775f561-03d0-44a2-95f6-ccc83cfb63d4-client-ca-bundle\") pod \"metrics-server-556596fb4d-c6bwb\" (UID: \"4775f561-03d0-44a2-95f6-ccc83cfb63d4\") " pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:28.043631 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.043496    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4775f561-03d0-44a2-95f6-ccc83cfb63d4-secret-metrics-server-tls\") pod \"metrics-server-556596fb4d-c6bwb\" (UID: \"4775f561-03d0-44a2-95f6-ccc83cfb63d4\") " pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:28.043799 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.043780    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4775f561-03d0-44a2-95f6-ccc83cfb63d4-secret-metrics-server-client-certs\") pod \"metrics-server-556596fb4d-c6bwb\" (UID: \"4775f561-03d0-44a2-95f6-ccc83cfb63d4\") " pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:28.049739 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.049714    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf9lv\" (UniqueName: \"kubernetes.io/projected/4775f561-03d0-44a2-95f6-ccc83cfb63d4-kube-api-access-pf9lv\") pod \"metrics-server-556596fb4d-c6bwb\" (UID: \"4775f561-03d0-44a2-95f6-ccc83cfb63d4\") " pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:28.163186 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.163156    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:28.218370 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.218338    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-lvx6p"]
Jul 20 22:24:28.222160 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.222135    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-lvx6p"
Jul 20 22:24:28.224454 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.224427    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-gjr5j\""
Jul 20 22:24:28.224910 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.224891    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 20 22:24:28.235497 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.235473    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-lvx6p"]
Jul 20 22:24:28.242142 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.242118    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rvxh\" (UniqueName: \"kubernetes.io/projected/8dc87887-02cf-4877-bd83-29e7d7e77421-kube-api-access-2rvxh\") pod \"monitoring-plugin-7b7b7bc8bf-lvx6p\" (UID: \"8dc87887-02cf-4877-bd83-29e7d7e77421\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-lvx6p"
Jul 20 22:24:28.242241 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.242198    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8dc87887-02cf-4877-bd83-29e7d7e77421-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-lvx6p\" (UID: \"8dc87887-02cf-4877-bd83-29e7d7e77421\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-lvx6p"
Jul 20 22:24:28.324936 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.324676    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-556596fb4d-c6bwb"]
Jul 20 22:24:28.343325 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.343284    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8dc87887-02cf-4877-bd83-29e7d7e77421-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-lvx6p\" (UID: \"8dc87887-02cf-4877-bd83-29e7d7e77421\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-lvx6p"
Jul 20 22:24:28.343482 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.343372    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rvxh\" (UniqueName: \"kubernetes.io/projected/8dc87887-02cf-4877-bd83-29e7d7e77421-kube-api-access-2rvxh\") pod \"monitoring-plugin-7b7b7bc8bf-lvx6p\" (UID: \"8dc87887-02cf-4877-bd83-29e7d7e77421\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-lvx6p"
Jul 20 22:24:28.345949 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.345926    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8dc87887-02cf-4877-bd83-29e7d7e77421-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-lvx6p\" (UID: \"8dc87887-02cf-4877-bd83-29e7d7e77421\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-lvx6p"
Jul 20 22:24:28.354838 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.354817    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rvxh\" (UniqueName: \"kubernetes.io/projected/8dc87887-02cf-4877-bd83-29e7d7e77421-kube-api-access-2rvxh\") pod \"monitoring-plugin-7b7b7bc8bf-lvx6p\" (UID: \"8dc87887-02cf-4877-bd83-29e7d7e77421\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-lvx6p"
Jul 20 22:24:28.535624 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.535577    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-lvx6p"
Jul 20 22:24:28.776243 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:24:28.776207    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4775f561_03d0_44a2_95f6_ccc83cfb63d4.slice/crio-d2f1be3eeeef87ccab071adeb2005b2553f4f11a2f5f862f0e9cc14b8d61c27e WatchSource:0}: Error finding container d2f1be3eeeef87ccab071adeb2005b2553f4f11a2f5f862f0e9cc14b8d61c27e: Status 404 returned error can't find the container with id d2f1be3eeeef87ccab071adeb2005b2553f4f11a2f5f862f0e9cc14b8d61c27e
Jul 20 22:24:28.797413 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.797382    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb" event={"ID":"4775f561-03d0-44a2-95f6-ccc83cfb63d4","Type":"ContainerStarted","Data":"d2f1be3eeeef87ccab071adeb2005b2553f4f11a2f5f862f0e9cc14b8d61c27e"}
Jul 20 22:24:28.927684 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:28.927653    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-lvx6p"]
Jul 20 22:24:28.937985 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:24:28.937944    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dc87887_02cf_4877_bd83_29e7d7e77421.slice/crio-9a6c7c3ee4fb99c980468a99ae55a6f4eb721364711dc5f20528db1038b73932 WatchSource:0}: Error finding container 9a6c7c3ee4fb99c980468a99ae55a6f4eb721364711dc5f20528db1038b73932: Status 404 returned error can't find the container with id 9a6c7c3ee4fb99c980468a99ae55a6f4eb721364711dc5f20528db1038b73932
Jul 20 22:24:29.811387 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.810879    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-lvx6p" event={"ID":"8dc87887-02cf-4877-bd83-29e7d7e77421","Type":"ContainerStarted","Data":"9a6c7c3ee4fb99c980468a99ae55a6f4eb721364711dc5f20528db1038b73932"}
Jul 20 22:24:29.816631 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.814864    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 22:24:29.820959 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.820932    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.824347 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.824318    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8","Type":"ContainerStarted","Data":"33ca0cfe334b3d222abce11ff98adeadeb72fc3ac2cdf824e05ef1d92af4b738"}
Jul 20 22:24:29.824631 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.824588    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8","Type":"ContainerStarted","Data":"25d82d9837bc4bca1bd6b9bd8f95bdae02ba5dd97d652ca4a95f2ff992302fc8"}
Jul 20 22:24:29.824805 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.824787    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8","Type":"ContainerStarted","Data":"1279119a7bb4695aa7bfd2e29011499d235a1956d73d5722646da0d167f31b2e"}
Jul 20 22:24:29.824951 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.824937    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8","Type":"ContainerStarted","Data":"f786b66de32629774b9923c66db1fbdb7120e50fa7ce32dfad2f829a762e78f4"}
Jul 20 22:24:29.825442 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.825420    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8","Type":"ContainerStarted","Data":"d5e054b02eb1dc9758bdab18a66d9738b67ba78a17f78ab9fd8d6b62221feb7a"}
Jul 20 22:24:29.825531 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.825356    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 20 22:24:29.826518 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.826500    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 20 22:24:29.829358 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.829335    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hfl6q\""
Jul 20 22:24:29.829503 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.826777    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 20 22:24:29.830662 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.827135    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 20 22:24:29.830662 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.827186    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-66bdc2eo0f9bl\""
Jul 20 22:24:29.830662 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.827420    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 20 22:24:29.830662 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.827458    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 20 22:24:29.830662 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.827538    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 20 22:24:29.830662 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.827573    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 20 22:24:29.830662 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.827864    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 20 22:24:29.830662 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.827907    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 20 22:24:29.830662 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.829309    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 20 22:24:29.830662 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.827069    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 20 22:24:29.833317 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.833293    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m" event={"ID":"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b","Type":"ContainerStarted","Data":"59dda9b652e38fea2c0ba5a4e9bf6abfd76b89b0a9d009fac8d3c5d267863181"}
Jul 20 22:24:29.833587 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.833569    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m" event={"ID":"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b","Type":"ContainerStarted","Data":"6d23f9f9f501a5c4cf42db6b76d81561d3a10aca45498f19f8f26a58f010ad53"}
Jul 20 22:24:29.833761 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.833746    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m" event={"ID":"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b","Type":"ContainerStarted","Data":"74c90e7cf2d14bb71479edcf4ed319666de11fd67254e8ee70bb92fa9f3325a6"}
Jul 20 22:24:29.837850 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.834701    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 20 22:24:29.838751 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.838652    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 22:24:29.839372 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.839333    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 20 22:24:29.863362 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.863322    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.863362 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.863367    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.863622 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.863414    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4818dda-7659-4a20-9c12-ad6f20e06d2e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.863622 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.863471    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4818dda-7659-4a20-9c12-ad6f20e06d2e-config-out\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.863622 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.863496    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-web-config\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.863622 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.863532    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.863846 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.863632    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.863846 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.863691    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.863846 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.863722    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.863846 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.863762    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.863846 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.863784    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.863846 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.863814    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.863846 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.863837    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.864191 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.863860    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.864191 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.863892    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.864191 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.863917    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkpdm\" (UniqueName: \"kubernetes.io/projected/c4818dda-7659-4a20-9c12-ad6f20e06d2e-kube-api-access-qkpdm\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.864191 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.863941    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-config\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.864191 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.863982    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.864191 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.864101    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.864191 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.864136    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.965352 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.965321    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.965352 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.965354    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkpdm\" (UniqueName: \"kubernetes.io/projected/c4818dda-7659-4a20-9c12-ad6f20e06d2e-kube-api-access-qkpdm\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.965580 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.965374    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-config\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.965580 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.965399    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.965580 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.965422    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.965580 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.965439    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.965580 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.965479    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.965580 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.965501    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.965580 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.965528    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4818dda-7659-4a20-9c12-ad6f20e06d2e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.965580 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.965558    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4818dda-7659-4a20-9c12-ad6f20e06d2e-config-out\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.966204 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.965587    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-web-config\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.966204 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.965644    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.966204 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.965680    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.966204 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.965711    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.966204 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.965733    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.966204 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.965772    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.966204 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.965798    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.966204 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.965830    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.966204 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.965855    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.966204 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.966128    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.967295 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.967267    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.967632 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.967584    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.967812 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.967783    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.970508 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.968903    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.970508 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.969510    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4818dda-7659-4a20-9c12-ad6f20e06d2e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.970508 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.970129    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.972536 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.970596    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.972536 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.970688    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.972536 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.970735    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.972536 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.971073    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.972536 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.971405    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.972536 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.971936    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-web-config\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.972536 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.972176    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.972536 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.972210    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-config\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.972536 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.972255    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4818dda-7659-4a20-9c12-ad6f20e06d2e-config-out\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.972536 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.972262    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.972536 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.972358    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.973105 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.972762    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.973852 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.973831    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:29.979863 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:29.979845    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkpdm\" (UniqueName: \"kubernetes.io/projected/c4818dda-7659-4a20-9c12-ad6f20e06d2e-kube-api-access-qkpdm\") pod \"prometheus-k8s-0\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:30.137990 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:30.137893    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:30.966469 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:30.966441    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 22:24:30.968941 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:24:30.968914    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4818dda_7659_4a20_9c12_ad6f20e06d2e.slice/crio-b7524414357893a901eca867f68a892f295a00e69f69957df5da17c169b8444f WatchSource:0}: Error finding container b7524414357893a901eca867f68a892f295a00e69f69957df5da17c169b8444f: Status 404 returned error can't find the container with id b7524414357893a901eca867f68a892f295a00e69f69957df5da17c169b8444f
Jul 20 22:24:31.846106 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:31.846070    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8","Type":"ContainerStarted","Data":"6afe65ab6ea083c816b2b0b6e76279a89cab5afb74299ff94cd1950848439aa1"}
Jul 20 22:24:31.848877 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:31.848847    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m" event={"ID":"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b","Type":"ContainerStarted","Data":"92a46e7af40aeb46c95564d5dacc1f3cfcdc068178f402872f46118313421fca"}
Jul 20 22:24:31.848998 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:31.848917    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m" event={"ID":"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b","Type":"ContainerStarted","Data":"3768d1718db2dfbe3fe0a40288b96fda33894458044f2baf2e9226d8a337f552"}
Jul 20 22:24:31.848998 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:31.848958    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m" event={"ID":"73d2bb5d-12c8-4d4a-b379-793cda2a1a5b","Type":"ContainerStarted","Data":"7538e9d3bf8ecdda9b79095fb52ffca41caa9f6d06cae323d86be532a2b83984"}
Jul 20 22:24:31.849124 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:31.849002    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:31.850330 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:31.850304    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb" event={"ID":"4775f561-03d0-44a2-95f6-ccc83cfb63d4","Type":"ContainerStarted","Data":"fb1d058759e658a82492323058992a6b5daa1169378b4ecf8eaae269d4494430"}
Jul 20 22:24:31.851813 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:31.851793    2556 generic.go:356] "Generic (PLEG): container finished" podID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerID="01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931" exitCode=0
Jul 20 22:24:31.851887 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:31.851871    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4818dda-7659-4a20-9c12-ad6f20e06d2e","Type":"ContainerDied","Data":"01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931"}
Jul 20 22:24:31.851939 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:31.851932    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4818dda-7659-4a20-9c12-ad6f20e06d2e","Type":"ContainerStarted","Data":"b7524414357893a901eca867f68a892f295a00e69f69957df5da17c169b8444f"}
Jul 20 22:24:31.853324 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:31.853306    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-lvx6p" event={"ID":"8dc87887-02cf-4877-bd83-29e7d7e77421","Type":"ContainerStarted","Data":"29527cd9461c1481adb297d03e16a796d74b114b2a9343aabe95a684b652b1ec"}
Jul 20 22:24:31.853528 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:31.853510    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-lvx6p"
Jul 20 22:24:31.858848 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:31.858832    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-lvx6p"
Jul 20 22:24:31.903377 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:31.903328    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.217171898 podStartE2EDuration="7.903310752s" totalImagesPullingTime="4.665261662s" totalInitContainerRuntime="20.877192ms" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:31.901545122 +0000 UTC m=+85.199761696" watchObservedRunningTime="2026-07-20 22:24:31.903310752 +0000 UTC m=+85.201527323"
Jul 20 22:24:31.933770 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:31.933716    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m" podStartSLOduration=2.31908595 podStartE2EDuration="5.933691764s" totalImagesPullingTime="3.614605814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:31.931525296 +0000 UTC m=+85.229741867" watchObservedRunningTime="2026-07-20 22:24:31.933691764 +0000 UTC m=+85.231908339"
Jul 20 22:24:31.973623 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:31.973563    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb" podStartSLOduration=2.936931984 podStartE2EDuration="4.97354565s" totalImagesPullingTime="2.036613666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:31.969746147 +0000 UTC m=+85.267962727" watchObservedRunningTime="2026-07-20 22:24:31.97354565 +0000 UTC m=+85.271762219"
Jul 20 22:24:31.998198 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:31.998145    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-lvx6p" podStartSLOduration=2.125074041 podStartE2EDuration="3.998127226s" totalImagesPullingTime="1.873053185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:31.996690854 +0000 UTC m=+85.294907424" watchObservedRunningTime="2026-07-20 22:24:31.998127226 +0000 UTC m=+85.296343796"
Jul 20 22:24:35.876196 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:35.876145    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4818dda-7659-4a20-9c12-ad6f20e06d2e","Type":"ContainerStarted","Data":"9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67"}
Jul 20 22:24:35.876569 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:35.876226    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4818dda-7659-4a20-9c12-ad6f20e06d2e","Type":"ContainerStarted","Data":"1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc"}
Jul 20 22:24:35.876569 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:35.876266    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4818dda-7659-4a20-9c12-ad6f20e06d2e","Type":"ContainerStarted","Data":"125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f"}
Jul 20 22:24:35.876569 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:35.876296    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4818dda-7659-4a20-9c12-ad6f20e06d2e","Type":"ContainerStarted","Data":"16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865"}
Jul 20 22:24:35.876569 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:35.876325    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4818dda-7659-4a20-9c12-ad6f20e06d2e","Type":"ContainerStarted","Data":"e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54"}
Jul 20 22:24:35.876569 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:35.876353    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4818dda-7659-4a20-9c12-ad6f20e06d2e","Type":"ContainerStarted","Data":"5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459"}
Jul 20 22:24:35.906881 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:35.906828    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.676712161 podStartE2EDuration="6.906808874s" totalImagesPullingTime="3.208140767s" totalInitContainerRuntime="21.955946ms" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:35.904225942 +0000 UTC m=+89.202442525" watchObservedRunningTime="2026-07-20 22:24:35.906808874 +0000 UTC m=+89.205025443"
Jul 20 22:24:37.864433 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:37.864405    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-86b5c47444-6gv2m"
Jul 20 22:24:40.138961 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:40.138917    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:48.163821 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:48.163783    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:48.164252 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:48.163853    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:24:50.728891 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:24:50.728862    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-295rv"
Jul 20 22:25:08.169010 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:08.168981    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:25:08.173894 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:08.173871    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-556596fb4d-c6bwb"
Jul 20 22:25:30.138793 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:30.138761    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:30.157931 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:30.157905    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:31.112701 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:31.112675    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:43.820225 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:43.820188    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 22:25:43.820694 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:43.820497    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="alertmanager" containerID="cri-o://d5e054b02eb1dc9758bdab18a66d9738b67ba78a17f78ab9fd8d6b62221feb7a" gracePeriod=120
Jul 20 22:25:43.820694 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:43.820557    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="kube-rbac-proxy-metric" containerID="cri-o://33ca0cfe334b3d222abce11ff98adeadeb72fc3ac2cdf824e05ef1d92af4b738" gracePeriod=120
Jul 20 22:25:43.820694 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:43.820575    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="prom-label-proxy" containerID="cri-o://6afe65ab6ea083c816b2b0b6e76279a89cab5afb74299ff94cd1950848439aa1" gracePeriod=120
Jul 20 22:25:43.820694 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:43.820642    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="config-reloader" containerID="cri-o://f786b66de32629774b9923c66db1fbdb7120e50fa7ce32dfad2f829a762e78f4" gracePeriod=120
Jul 20 22:25:43.820694 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:43.820639    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="kube-rbac-proxy-web" containerID="cri-o://1279119a7bb4695aa7bfd2e29011499d235a1956d73d5722646da0d167f31b2e" gracePeriod=120
Jul 20 22:25:43.820967 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:43.820717    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="kube-rbac-proxy" containerID="cri-o://25d82d9837bc4bca1bd6b9bd8f95bdae02ba5dd97d652ca4a95f2ff992302fc8" gracePeriod=120
Jul 20 22:25:44.154961 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:44.154872    2556 generic.go:356] "Generic (PLEG): container finished" podID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerID="6afe65ab6ea083c816b2b0b6e76279a89cab5afb74299ff94cd1950848439aa1" exitCode=0
Jul 20 22:25:44.154961 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:44.154896    2556 generic.go:356] "Generic (PLEG): container finished" podID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerID="25d82d9837bc4bca1bd6b9bd8f95bdae02ba5dd97d652ca4a95f2ff992302fc8" exitCode=0
Jul 20 22:25:44.154961 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:44.154903    2556 generic.go:356] "Generic (PLEG): container finished" podID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerID="f786b66de32629774b9923c66db1fbdb7120e50fa7ce32dfad2f829a762e78f4" exitCode=0
Jul 20 22:25:44.154961 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:44.154909    2556 generic.go:356] "Generic (PLEG): container finished" podID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerID="d5e054b02eb1dc9758bdab18a66d9738b67ba78a17f78ab9fd8d6b62221feb7a" exitCode=0
Jul 20 22:25:44.154961 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:44.154942    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8","Type":"ContainerDied","Data":"6afe65ab6ea083c816b2b0b6e76279a89cab5afb74299ff94cd1950848439aa1"}
Jul 20 22:25:44.155221 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:44.155010    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8","Type":"ContainerDied","Data":"25d82d9837bc4bca1bd6b9bd8f95bdae02ba5dd97d652ca4a95f2ff992302fc8"}
Jul 20 22:25:44.155221 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:44.155036    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8","Type":"ContainerDied","Data":"f786b66de32629774b9923c66db1fbdb7120e50fa7ce32dfad2f829a762e78f4"}
Jul 20 22:25:44.155221 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:44.155059    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8","Type":"ContainerDied","Data":"d5e054b02eb1dc9758bdab18a66d9738b67ba78a17f78ab9fd8d6b62221feb7a"}
Jul 20 22:25:45.082153 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.082125    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.162966 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.162878    2556 generic.go:356] "Generic (PLEG): container finished" podID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerID="33ca0cfe334b3d222abce11ff98adeadeb72fc3ac2cdf824e05ef1d92af4b738" exitCode=0
Jul 20 22:25:45.162966 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.162903    2556 generic.go:356] "Generic (PLEG): container finished" podID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerID="1279119a7bb4695aa7bfd2e29011499d235a1956d73d5722646da0d167f31b2e" exitCode=0
Jul 20 22:25:45.162966 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.162913    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8","Type":"ContainerDied","Data":"33ca0cfe334b3d222abce11ff98adeadeb72fc3ac2cdf824e05ef1d92af4b738"}
Jul 20 22:25:45.162966 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.162966    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.163258 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.163006    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8","Type":"ContainerDied","Data":"1279119a7bb4695aa7bfd2e29011499d235a1956d73d5722646da0d167f31b2e"}
Jul 20 22:25:45.163258 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.163048    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8","Type":"ContainerDied","Data":"17fcfc71f85a66ea09f56c05242573e7bb99996ec1e7d38013c264842381d50b"}
Jul 20 22:25:45.163258 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.163071    2556 scope.go:117] "RemoveContainer" containerID="6afe65ab6ea083c816b2b0b6e76279a89cab5afb74299ff94cd1950848439aa1"
Jul 20 22:25:45.171067 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.171047    2556 scope.go:117] "RemoveContainer" containerID="33ca0cfe334b3d222abce11ff98adeadeb72fc3ac2cdf824e05ef1d92af4b738"
Jul 20 22:25:45.178309 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.178288    2556 scope.go:117] "RemoveContainer" containerID="25d82d9837bc4bca1bd6b9bd8f95bdae02ba5dd97d652ca4a95f2ff992302fc8"
Jul 20 22:25:45.187272 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.187254    2556 scope.go:117] "RemoveContainer" containerID="1279119a7bb4695aa7bfd2e29011499d235a1956d73d5722646da0d167f31b2e"
Jul 20 22:25:45.194413 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.194390    2556 scope.go:117] "RemoveContainer" containerID="f786b66de32629774b9923c66db1fbdb7120e50fa7ce32dfad2f829a762e78f4"
Jul 20 22:25:45.201774 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.201750    2556 scope.go:117] "RemoveContainer" containerID="d5e054b02eb1dc9758bdab18a66d9738b67ba78a17f78ab9fd8d6b62221feb7a"
Jul 20 22:25:45.209222 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.209206    2556 scope.go:117] "RemoveContainer" containerID="a0aecdf506856303d4e65a5e97a3d317da4214e0c612d2a00a6154dd05f0671e"
Jul 20 22:25:45.216343 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.216325    2556 scope.go:117] "RemoveContainer" containerID="6afe65ab6ea083c816b2b0b6e76279a89cab5afb74299ff94cd1950848439aa1"
Jul 20 22:25:45.216801 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:25:45.216640    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6afe65ab6ea083c816b2b0b6e76279a89cab5afb74299ff94cd1950848439aa1\": container with ID starting with 6afe65ab6ea083c816b2b0b6e76279a89cab5afb74299ff94cd1950848439aa1 not found: ID does not exist" containerID="6afe65ab6ea083c816b2b0b6e76279a89cab5afb74299ff94cd1950848439aa1"
Jul 20 22:25:45.216801 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.216682    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6afe65ab6ea083c816b2b0b6e76279a89cab5afb74299ff94cd1950848439aa1"} err="failed to get container status \"6afe65ab6ea083c816b2b0b6e76279a89cab5afb74299ff94cd1950848439aa1\": rpc error: code = NotFound desc = could not find container \"6afe65ab6ea083c816b2b0b6e76279a89cab5afb74299ff94cd1950848439aa1\": container with ID starting with 6afe65ab6ea083c816b2b0b6e76279a89cab5afb74299ff94cd1950848439aa1 not found: ID does not exist"
Jul 20 22:25:45.216801 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.216725    2556 scope.go:117] "RemoveContainer" containerID="33ca0cfe334b3d222abce11ff98adeadeb72fc3ac2cdf824e05ef1d92af4b738"
Jul 20 22:25:45.217401 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:25:45.217271    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33ca0cfe334b3d222abce11ff98adeadeb72fc3ac2cdf824e05ef1d92af4b738\": container with ID starting with 33ca0cfe334b3d222abce11ff98adeadeb72fc3ac2cdf824e05ef1d92af4b738 not found: ID does not exist" containerID="33ca0cfe334b3d222abce11ff98adeadeb72fc3ac2cdf824e05ef1d92af4b738"
Jul 20 22:25:45.217401 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.217303    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33ca0cfe334b3d222abce11ff98adeadeb72fc3ac2cdf824e05ef1d92af4b738"} err="failed to get container status \"33ca0cfe334b3d222abce11ff98adeadeb72fc3ac2cdf824e05ef1d92af4b738\": rpc error: code = NotFound desc = could not find container \"33ca0cfe334b3d222abce11ff98adeadeb72fc3ac2cdf824e05ef1d92af4b738\": container with ID starting with 33ca0cfe334b3d222abce11ff98adeadeb72fc3ac2cdf824e05ef1d92af4b738 not found: ID does not exist"
Jul 20 22:25:45.217401 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.217325    2556 scope.go:117] "RemoveContainer" containerID="25d82d9837bc4bca1bd6b9bd8f95bdae02ba5dd97d652ca4a95f2ff992302fc8"
Jul 20 22:25:45.217975 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:25:45.217852    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25d82d9837bc4bca1bd6b9bd8f95bdae02ba5dd97d652ca4a95f2ff992302fc8\": container with ID starting with 25d82d9837bc4bca1bd6b9bd8f95bdae02ba5dd97d652ca4a95f2ff992302fc8 not found: ID does not exist" containerID="25d82d9837bc4bca1bd6b9bd8f95bdae02ba5dd97d652ca4a95f2ff992302fc8"
Jul 20 22:25:45.217975 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.217881    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25d82d9837bc4bca1bd6b9bd8f95bdae02ba5dd97d652ca4a95f2ff992302fc8"} err="failed to get container status \"25d82d9837bc4bca1bd6b9bd8f95bdae02ba5dd97d652ca4a95f2ff992302fc8\": rpc error: code = NotFound desc = could not find container \"25d82d9837bc4bca1bd6b9bd8f95bdae02ba5dd97d652ca4a95f2ff992302fc8\": container with ID starting with 25d82d9837bc4bca1bd6b9bd8f95bdae02ba5dd97d652ca4a95f2ff992302fc8 not found: ID does not exist"
Jul 20 22:25:45.217975 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.217901    2556 scope.go:117] "RemoveContainer" containerID="1279119a7bb4695aa7bfd2e29011499d235a1956d73d5722646da0d167f31b2e"
Jul 20 22:25:45.218497 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:25:45.218474    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1279119a7bb4695aa7bfd2e29011499d235a1956d73d5722646da0d167f31b2e\": container with ID starting with 1279119a7bb4695aa7bfd2e29011499d235a1956d73d5722646da0d167f31b2e not found: ID does not exist" containerID="1279119a7bb4695aa7bfd2e29011499d235a1956d73d5722646da0d167f31b2e"
Jul 20 22:25:45.218599 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.218506    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1279119a7bb4695aa7bfd2e29011499d235a1956d73d5722646da0d167f31b2e"} err="failed to get container status \"1279119a7bb4695aa7bfd2e29011499d235a1956d73d5722646da0d167f31b2e\": rpc error: code = NotFound desc = could not find container \"1279119a7bb4695aa7bfd2e29011499d235a1956d73d5722646da0d167f31b2e\": container with ID starting with 1279119a7bb4695aa7bfd2e29011499d235a1956d73d5722646da0d167f31b2e not found: ID does not exist"
Jul 20 22:25:45.218599 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.218528    2556 scope.go:117] "RemoveContainer" containerID="f786b66de32629774b9923c66db1fbdb7120e50fa7ce32dfad2f829a762e78f4"
Jul 20 22:25:45.219048 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:25:45.219023    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f786b66de32629774b9923c66db1fbdb7120e50fa7ce32dfad2f829a762e78f4\": container with ID starting with f786b66de32629774b9923c66db1fbdb7120e50fa7ce32dfad2f829a762e78f4 not found: ID does not exist" containerID="f786b66de32629774b9923c66db1fbdb7120e50fa7ce32dfad2f829a762e78f4"
Jul 20 22:25:45.219126 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.219051    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f786b66de32629774b9923c66db1fbdb7120e50fa7ce32dfad2f829a762e78f4"} err="failed to get container status \"f786b66de32629774b9923c66db1fbdb7120e50fa7ce32dfad2f829a762e78f4\": rpc error: code = NotFound desc = could not find container \"f786b66de32629774b9923c66db1fbdb7120e50fa7ce32dfad2f829a762e78f4\": container with ID starting with f786b66de32629774b9923c66db1fbdb7120e50fa7ce32dfad2f829a762e78f4 not found: ID does not exist"
Jul 20 22:25:45.219126 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.219067    2556 scope.go:117] "RemoveContainer" containerID="d5e054b02eb1dc9758bdab18a66d9738b67ba78a17f78ab9fd8d6b62221feb7a"
Jul 20 22:25:45.219311 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:25:45.219295    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5e054b02eb1dc9758bdab18a66d9738b67ba78a17f78ab9fd8d6b62221feb7a\": container with ID starting with d5e054b02eb1dc9758bdab18a66d9738b67ba78a17f78ab9fd8d6b62221feb7a not found: ID does not exist" containerID="d5e054b02eb1dc9758bdab18a66d9738b67ba78a17f78ab9fd8d6b62221feb7a"
Jul 20 22:25:45.219351 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.219314    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5e054b02eb1dc9758bdab18a66d9738b67ba78a17f78ab9fd8d6b62221feb7a"} err="failed to get container status \"d5e054b02eb1dc9758bdab18a66d9738b67ba78a17f78ab9fd8d6b62221feb7a\": rpc error: code = NotFound desc = could not find container \"d5e054b02eb1dc9758bdab18a66d9738b67ba78a17f78ab9fd8d6b62221feb7a\": container with ID starting with d5e054b02eb1dc9758bdab18a66d9738b67ba78a17f78ab9fd8d6b62221feb7a not found: ID does not exist"
Jul 20 22:25:45.219351 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.219326    2556 scope.go:117] "RemoveContainer" containerID="a0aecdf506856303d4e65a5e97a3d317da4214e0c612d2a00a6154dd05f0671e"
Jul 20 22:25:45.219540 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:25:45.219522    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0aecdf506856303d4e65a5e97a3d317da4214e0c612d2a00a6154dd05f0671e\": container with ID starting with a0aecdf506856303d4e65a5e97a3d317da4214e0c612d2a00a6154dd05f0671e not found: ID does not exist" containerID="a0aecdf506856303d4e65a5e97a3d317da4214e0c612d2a00a6154dd05f0671e"
Jul 20 22:25:45.219584 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.219546    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0aecdf506856303d4e65a5e97a3d317da4214e0c612d2a00a6154dd05f0671e"} err="failed to get container status \"a0aecdf506856303d4e65a5e97a3d317da4214e0c612d2a00a6154dd05f0671e\": rpc error: code = NotFound desc = could not find container \"a0aecdf506856303d4e65a5e97a3d317da4214e0c612d2a00a6154dd05f0671e\": container with ID starting with a0aecdf506856303d4e65a5e97a3d317da4214e0c612d2a00a6154dd05f0671e not found: ID does not exist"
Jul 20 22:25:45.219584 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.219562    2556 scope.go:117] "RemoveContainer" containerID="6afe65ab6ea083c816b2b0b6e76279a89cab5afb74299ff94cd1950848439aa1"
Jul 20 22:25:45.219790 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.219774    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6afe65ab6ea083c816b2b0b6e76279a89cab5afb74299ff94cd1950848439aa1"} err="failed to get container status \"6afe65ab6ea083c816b2b0b6e76279a89cab5afb74299ff94cd1950848439aa1\": rpc error: code = NotFound desc = could not find container \"6afe65ab6ea083c816b2b0b6e76279a89cab5afb74299ff94cd1950848439aa1\": container with ID starting with 6afe65ab6ea083c816b2b0b6e76279a89cab5afb74299ff94cd1950848439aa1 not found: ID does not exist"
Jul 20 22:25:45.219836 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.219791    2556 scope.go:117] "RemoveContainer" containerID="33ca0cfe334b3d222abce11ff98adeadeb72fc3ac2cdf824e05ef1d92af4b738"
Jul 20 22:25:45.219990 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.219969    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33ca0cfe334b3d222abce11ff98adeadeb72fc3ac2cdf824e05ef1d92af4b738"} err="failed to get container status \"33ca0cfe334b3d222abce11ff98adeadeb72fc3ac2cdf824e05ef1d92af4b738\": rpc error: code = NotFound desc = could not find container \"33ca0cfe334b3d222abce11ff98adeadeb72fc3ac2cdf824e05ef1d92af4b738\": container with ID starting with 33ca0cfe334b3d222abce11ff98adeadeb72fc3ac2cdf824e05ef1d92af4b738 not found: ID does not exist"
Jul 20 22:25:45.220069 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.219993    2556 scope.go:117] "RemoveContainer" containerID="25d82d9837bc4bca1bd6b9bd8f95bdae02ba5dd97d652ca4a95f2ff992302fc8"
Jul 20 22:25:45.220186 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.220170    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25d82d9837bc4bca1bd6b9bd8f95bdae02ba5dd97d652ca4a95f2ff992302fc8"} err="failed to get container status \"25d82d9837bc4bca1bd6b9bd8f95bdae02ba5dd97d652ca4a95f2ff992302fc8\": rpc error: code = NotFound desc = could not find container \"25d82d9837bc4bca1bd6b9bd8f95bdae02ba5dd97d652ca4a95f2ff992302fc8\": container with ID starting with 25d82d9837bc4bca1bd6b9bd8f95bdae02ba5dd97d652ca4a95f2ff992302fc8 not found: ID does not exist"
Jul 20 22:25:45.220249 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.220188    2556 scope.go:117] "RemoveContainer" containerID="1279119a7bb4695aa7bfd2e29011499d235a1956d73d5722646da0d167f31b2e"
Jul 20 22:25:45.220383 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.220368    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1279119a7bb4695aa7bfd2e29011499d235a1956d73d5722646da0d167f31b2e"} err="failed to get container status \"1279119a7bb4695aa7bfd2e29011499d235a1956d73d5722646da0d167f31b2e\": rpc error: code = NotFound desc = could not find container \"1279119a7bb4695aa7bfd2e29011499d235a1956d73d5722646da0d167f31b2e\": container with ID starting with 1279119a7bb4695aa7bfd2e29011499d235a1956d73d5722646da0d167f31b2e not found: ID does not exist"
Jul 20 22:25:45.220436 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.220384    2556 scope.go:117] "RemoveContainer" containerID="f786b66de32629774b9923c66db1fbdb7120e50fa7ce32dfad2f829a762e78f4"
Jul 20 22:25:45.220579 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.220564    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f786b66de32629774b9923c66db1fbdb7120e50fa7ce32dfad2f829a762e78f4"} err="failed to get container status \"f786b66de32629774b9923c66db1fbdb7120e50fa7ce32dfad2f829a762e78f4\": rpc error: code = NotFound desc = could not find container \"f786b66de32629774b9923c66db1fbdb7120e50fa7ce32dfad2f829a762e78f4\": container with ID starting with f786b66de32629774b9923c66db1fbdb7120e50fa7ce32dfad2f829a762e78f4 not found: ID does not exist"
Jul 20 22:25:45.220660 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.220580    2556 scope.go:117] "RemoveContainer" containerID="d5e054b02eb1dc9758bdab18a66d9738b67ba78a17f78ab9fd8d6b62221feb7a"
Jul 20 22:25:45.220803 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.220787    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5e054b02eb1dc9758bdab18a66d9738b67ba78a17f78ab9fd8d6b62221feb7a"} err="failed to get container status \"d5e054b02eb1dc9758bdab18a66d9738b67ba78a17f78ab9fd8d6b62221feb7a\": rpc error: code = NotFound desc = could not find container \"d5e054b02eb1dc9758bdab18a66d9738b67ba78a17f78ab9fd8d6b62221feb7a\": container with ID starting with d5e054b02eb1dc9758bdab18a66d9738b67ba78a17f78ab9fd8d6b62221feb7a not found: ID does not exist"
Jul 20 22:25:45.220803 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.220803    2556 scope.go:117] "RemoveContainer" containerID="a0aecdf506856303d4e65a5e97a3d317da4214e0c612d2a00a6154dd05f0671e"
Jul 20 22:25:45.221034 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.221017    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0aecdf506856303d4e65a5e97a3d317da4214e0c612d2a00a6154dd05f0671e"} err="failed to get container status \"a0aecdf506856303d4e65a5e97a3d317da4214e0c612d2a00a6154dd05f0671e\": rpc error: code = NotFound desc = could not find container \"a0aecdf506856303d4e65a5e97a3d317da4214e0c612d2a00a6154dd05f0671e\": container with ID starting with a0aecdf506856303d4e65a5e97a3d317da4214e0c612d2a00a6154dd05f0671e not found: ID does not exist"
Jul 20 22:25:45.228318 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.228297    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-kube-rbac-proxy-web\") pod \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") "
Jul 20 22:25:45.228419 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.228342    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ls96\" (UniqueName: \"kubernetes.io/projected/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-kube-api-access-8ls96\") pod \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") "
Jul 20 22:25:45.228419 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.228372    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-kube-rbac-proxy\") pod \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") "
Jul 20 22:25:45.228519 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.228478    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-main-tls\") pod \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") "
Jul 20 22:25:45.228519 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.228511    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-config-out\") pod \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") "
Jul 20 22:25:45.228638 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.228542    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-cluster-tls-config\") pod \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") "
Jul 20 22:25:45.228638 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.228585    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-metrics-client-ca\") pod \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") "
Jul 20 22:25:45.228745 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.228648    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") "
Jul 20 22:25:45.228745 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.228676    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-web-config\") pod \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") "
Jul 20 22:25:45.228745 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.228701    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-tls-assets\") pod \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") "
Jul 20 22:25:45.228745 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.228731    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-alertmanager-trusted-ca-bundle\") pod \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") "
Jul 20 22:25:45.228936 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.228759    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-alertmanager-main-db\") pod \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") "
Jul 20 22:25:45.228936 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.228800    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-config-volume\") pod \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\" (UID: \"7d8732b0-8c68-4308-86bc-ca5f3fd54ef8\") "
Jul 20 22:25:45.229576 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.229543    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" (UID: "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:25:45.230098 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.230036    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" (UID: "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:25:45.230098 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.230056    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" (UID: "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:25:45.231461 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.231436    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-config-volume" (OuterVolumeSpecName: "config-volume") pod "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" (UID: "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:45.231863 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.231747    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-kube-api-access-8ls96" (OuterVolumeSpecName: "kube-api-access-8ls96") pod "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" (UID: "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8"). InnerVolumeSpecName "kube-api-access-8ls96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:25:45.231863 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.231808    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" (UID: "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:45.231863 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.231818    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" (UID: "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:45.231863 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.231833    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" (UID: "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:45.232076 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.231869    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-config-out" (OuterVolumeSpecName: "config-out") pod "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" (UID: "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:25:45.233022 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.233000    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" (UID: "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:45.233347 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.233328    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" (UID: "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:25:45.236270 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.236234    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" (UID: "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:45.242516 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.242494    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-web-config" (OuterVolumeSpecName: "web-config") pod "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" (UID: "7d8732b0-8c68-4308-86bc-ca5f3fd54ef8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:45.330021 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.329979    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:45.330021 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.330015    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ls96\" (UniqueName: \"kubernetes.io/projected/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-kube-api-access-8ls96\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:45.330254 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.330039    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:45.330254 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.330057    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-main-tls\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:45.330254 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.330067    2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-config-out\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:45.330254 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.330076    2556 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-cluster-tls-config\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:45.330254 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.330085    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-metrics-client-ca\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:45.330254 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.330094    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:45.330254 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.330104    2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-web-config\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:45.330254 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.330112    2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-tls-assets\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:45.330254 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.330121    2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:45.330254 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.330129    2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-alertmanager-main-db\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:45.330254 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.330137    2556 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8-config-volume\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:45.487684 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.487648    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 22:25:45.492410 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.492384    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 22:25:45.521498 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.521465    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 22:25:45.521791 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.521777    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="init-config-reloader"
Jul 20 22:25:45.521850 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.521793    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="init-config-reloader"
Jul 20 22:25:45.521850 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.521804    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="alertmanager"
Jul 20 22:25:45.521850 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.521809    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="alertmanager"
Jul 20 22:25:45.521850 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.521817    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="kube-rbac-proxy-web"
Jul 20 22:25:45.521850 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.521822    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="kube-rbac-proxy-web"
Jul 20 22:25:45.521850 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.521829    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="kube-rbac-proxy-metric"
Jul 20 22:25:45.521850 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.521835    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="kube-rbac-proxy-metric"
Jul 20 22:25:45.521850 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.521841    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="prom-label-proxy"
Jul 20 22:25:45.521850 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.521846    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="prom-label-proxy"
Jul 20 22:25:45.522093 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.521856    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="config-reloader"
Jul 20 22:25:45.522093 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.521861    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="config-reloader"
Jul 20 22:25:45.522093 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.521870    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="kube-rbac-proxy"
Jul 20 22:25:45.522093 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.521876    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="kube-rbac-proxy"
Jul 20 22:25:45.522093 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.521924    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="alertmanager"
Jul 20 22:25:45.522093 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.521931    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="kube-rbac-proxy"
Jul 20 22:25:45.522093 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.521939    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="kube-rbac-proxy-metric"
Jul 20 22:25:45.522093 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.521945    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="kube-rbac-proxy-web"
Jul 20 22:25:45.522093 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.521951    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="prom-label-proxy"
Jul 20 22:25:45.522093 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.521957    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" containerName="config-reloader"
Jul 20 22:25:45.525764 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.525742    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.528370 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.528352    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 20 22:25:45.528370 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.528358    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 20 22:25:45.528521 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.528371    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 20 22:25:45.529161 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.529134    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 20 22:25:45.529259 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.529176    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 20 22:25:45.530096 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.529330    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 20 22:25:45.531674 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.530591    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hcvnx\""
Jul 20 22:25:45.531674 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.531340    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 20 22:25:45.532731 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.532205    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 20 22:25:45.538330 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.538283    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 20 22:25:45.543470 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.543448    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 22:25:45.633404 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.633370    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/972dd196-5dee-490e-b296-198118c5a1c5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.633404 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.633405    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/972dd196-5dee-490e-b296-198118c5a1c5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.633630 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.633426    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/972dd196-5dee-490e-b296-198118c5a1c5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.633630 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.633450    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/972dd196-5dee-490e-b296-198118c5a1c5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.633630 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.633475    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/972dd196-5dee-490e-b296-198118c5a1c5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.633630 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.633491    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/972dd196-5dee-490e-b296-198118c5a1c5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.633630 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.633517    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbncx\" (UniqueName: \"kubernetes.io/projected/972dd196-5dee-490e-b296-198118c5a1c5-kube-api-access-qbncx\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.633630 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.633538    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/972dd196-5dee-490e-b296-198118c5a1c5-config-volume\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.633630 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.633591    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/972dd196-5dee-490e-b296-198118c5a1c5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.633630 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.633635    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/972dd196-5dee-490e-b296-198118c5a1c5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.633879 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.633672    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/972dd196-5dee-490e-b296-198118c5a1c5-web-config\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.633879 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.633701    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/972dd196-5dee-490e-b296-198118c5a1c5-config-out\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.633879 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.633723    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/972dd196-5dee-490e-b296-198118c5a1c5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.734399 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.734305    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/972dd196-5dee-490e-b296-198118c5a1c5-web-config\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.734399 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.734351    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/972dd196-5dee-490e-b296-198118c5a1c5-config-out\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.734399 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.734387    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/972dd196-5dee-490e-b296-198118c5a1c5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.734667 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.734440    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/972dd196-5dee-490e-b296-198118c5a1c5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.734667 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.734467    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/972dd196-5dee-490e-b296-198118c5a1c5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.734667 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.734491    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/972dd196-5dee-490e-b296-198118c5a1c5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.734835 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.734668    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/972dd196-5dee-490e-b296-198118c5a1c5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.734835 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.734745    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/972dd196-5dee-490e-b296-198118c5a1c5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.735696 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.734958    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/972dd196-5dee-490e-b296-198118c5a1c5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.735696 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.735024    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbncx\" (UniqueName: \"kubernetes.io/projected/972dd196-5dee-490e-b296-198118c5a1c5-kube-api-access-qbncx\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.735696 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.735066    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/972dd196-5dee-490e-b296-198118c5a1c5-config-volume\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.735696 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.735102    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/972dd196-5dee-490e-b296-198118c5a1c5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.735696 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.735137    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/972dd196-5dee-490e-b296-198118c5a1c5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.736173 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.736103    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/972dd196-5dee-490e-b296-198118c5a1c5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.736173 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.736103    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/972dd196-5dee-490e-b296-198118c5a1c5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.736307 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.736223    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/972dd196-5dee-490e-b296-198118c5a1c5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.737308 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.737262    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/972dd196-5dee-490e-b296-198118c5a1c5-config-out\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.737637 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.737569    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/972dd196-5dee-490e-b296-198118c5a1c5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.737637 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.737597    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/972dd196-5dee-490e-b296-198118c5a1c5-web-config\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.737795 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.737773    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/972dd196-5dee-490e-b296-198118c5a1c5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.738006 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.737988    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/972dd196-5dee-490e-b296-198118c5a1c5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.738414 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.738395    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/972dd196-5dee-490e-b296-198118c5a1c5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.738554 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.738540    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/972dd196-5dee-490e-b296-198118c5a1c5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.738690 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.738672    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/972dd196-5dee-490e-b296-198118c5a1c5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.738733 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.738695    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/972dd196-5dee-490e-b296-198118c5a1c5-config-volume\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.744061 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.744041    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbncx\" (UniqueName: \"kubernetes.io/projected/972dd196-5dee-490e-b296-198118c5a1c5-kube-api-access-qbncx\") pod \"alertmanager-main-0\" (UID: \"972dd196-5dee-490e-b296-198118c5a1c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:45.843932 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:45.843897    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:46.004663 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:46.004560    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 22:25:46.168939 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:46.168909    2556 generic.go:356] "Generic (PLEG): container finished" podID="972dd196-5dee-490e-b296-198118c5a1c5" containerID="b9f6b7c4d4ea1809140d7070c5e50a17f254d9634db844b0a4273a34cb429b3b" exitCode=0
Jul 20 22:25:46.169309 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:46.168981    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"972dd196-5dee-490e-b296-198118c5a1c5","Type":"ContainerDied","Data":"b9f6b7c4d4ea1809140d7070c5e50a17f254d9634db844b0a4273a34cb429b3b"}
Jul 20 22:25:46.169309 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:46.169032    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"972dd196-5dee-490e-b296-198118c5a1c5","Type":"ContainerStarted","Data":"4e00318d710081bfd91e5094f98a462a379535156d77148fcccaa67d2550a7f3"}
Jul 20 22:25:47.177528 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:47.177502    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"972dd196-5dee-490e-b296-198118c5a1c5","Type":"ContainerStarted","Data":"a125f279cf648c04197a3a2fc3de86ce5373fc0673d95a1064e92d65593c66d4"}
Jul 20 22:25:47.177898 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:47.177569    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"972dd196-5dee-490e-b296-198118c5a1c5","Type":"ContainerStarted","Data":"9116f8b711f9ac296fd310d2e938e88941cf295b9803e679035d98ab6fd57573"}
Jul 20 22:25:47.177898 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:47.177597    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"972dd196-5dee-490e-b296-198118c5a1c5","Type":"ContainerStarted","Data":"260337add594a55045200cc38da28f2a7583141d9e2f3f39968e76eb0df1a025"}
Jul 20 22:25:47.177898 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:47.177644    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"972dd196-5dee-490e-b296-198118c5a1c5","Type":"ContainerStarted","Data":"4420cdb54b3026a4063363823ca37b82a4154c2f3e1e6fbf713e40f7e14ac1a6"}
Jul 20 22:25:47.177898 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:47.177670    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"972dd196-5dee-490e-b296-198118c5a1c5","Type":"ContainerStarted","Data":"5765c387df5935cd049b55c936614a5ae32f4ae50497f700683fd1c5c2aca2b3"}
Jul 20 22:25:47.177898 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:47.177692    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"972dd196-5dee-490e-b296-198118c5a1c5","Type":"ContainerStarted","Data":"917ef508a1b02f4adbe5106b8923f18e6a6ac14322feb192bf44cff9623e3ae4"}
Jul 20 22:25:47.207060 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:47.207030    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d8732b0-8c68-4308-86bc-ca5f3fd54ef8" path="/var/lib/kubelet/pods/7d8732b0-8c68-4308-86bc-ca5f3fd54ef8/volumes"
Jul 20 22:25:47.215596 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:47.215524    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.20016295 podStartE2EDuration="2.215502809s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.339859ms" isStatefulPod=false podCreationTimestamp="2026-07-20 22:25:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:25:47.214027491 +0000 UTC m=+160.512244071" watchObservedRunningTime="2026-07-20 22:25:47.215502809 +0000 UTC m=+160.513719360"
Jul 20 22:25:48.193292 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.193260    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 22:25:48.193818 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.193566    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="prometheus" containerID="cri-o://5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459" gracePeriod=600
Jul 20 22:25:48.193818 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.193632    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="kube-rbac-proxy" containerID="cri-o://1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc" gracePeriod=600
Jul 20 22:25:48.193818 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.193660    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="config-reloader" containerID="cri-o://e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54" gracePeriod=600
Jul 20 22:25:48.193818 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.193587    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="kube-rbac-proxy-web" containerID="cri-o://125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f" gracePeriod=600
Jul 20 22:25:48.193818 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.193592    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67" gracePeriod=600
Jul 20 22:25:48.193818 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.193646    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="thanos-sidecar" containerID="cri-o://16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865" gracePeriod=600
Jul 20 22:25:48.437018 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.436981    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:48.558049 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.557949    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-config\") pod \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") "
Jul 20 22:25:48.558049 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.557996    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4818dda-7659-4a20-9c12-ad6f20e06d2e-config-out\") pod \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") "
Jul 20 22:25:48.558049 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558015    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-configmap-serving-certs-ca-bundle\") pod \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") "
Jul 20 22:25:48.558328 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558061    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-trusted-ca-bundle\") pod \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") "
Jul 20 22:25:48.558328 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558083    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-configmap-kubelet-serving-ca-bundle\") pod \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") "
Jul 20 22:25:48.558328 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558101    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-prometheus-k8s-tls\") pod \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") "
Jul 20 22:25:48.558328 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558128    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-web-config\") pod \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") "
Jul 20 22:25:48.558328 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558159    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") "
Jul 20 22:25:48.558328 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558185    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-grpc-tls\") pod \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") "
Jul 20 22:25:48.558328 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558223    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-metrics-client-certs\") pod \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") "
Jul 20 22:25:48.558328 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558248    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-configmap-metrics-client-ca\") pod \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") "
Jul 20 22:25:48.558328 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558286    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-thanos-prometheus-http-client-file\") pod \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") "
Jul 20 22:25:48.558328 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558321    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") "
Jul 20 22:25:48.558887 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558352    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-kube-rbac-proxy\") pod \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") "
Jul 20 22:25:48.558887 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558395    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4818dda-7659-4a20-9c12-ad6f20e06d2e-tls-assets\") pod \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") "
Jul 20 22:25:48.558887 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558419    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-rulefiles-1\") pod \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") "
Jul 20 22:25:48.558887 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558432    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c4818dda-7659-4a20-9c12-ad6f20e06d2e" (UID: "c4818dda-7659-4a20-9c12-ad6f20e06d2e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:25:48.558887 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558464    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkpdm\" (UniqueName: \"kubernetes.io/projected/c4818dda-7659-4a20-9c12-ad6f20e06d2e-kube-api-access-qkpdm\") pod \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") "
Jul 20 22:25:48.558887 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558484    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c4818dda-7659-4a20-9c12-ad6f20e06d2e" (UID: "c4818dda-7659-4a20-9c12-ad6f20e06d2e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:25:48.558887 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558495    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-db\") pod \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") "
Jul 20 22:25:48.558887 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558494    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c4818dda-7659-4a20-9c12-ad6f20e06d2e" (UID: "c4818dda-7659-4a20-9c12-ad6f20e06d2e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:25:48.558887 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558542    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-rulefiles-0\") pod \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") "
Jul 20 22:25:48.558887 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558577    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-rulefiles-2\") pod \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\" (UID: \"c4818dda-7659-4a20-9c12-ad6f20e06d2e\") "
Jul 20 22:25:48.558887 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558710    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c4818dda-7659-4a20-9c12-ad6f20e06d2e" (UID: "c4818dda-7659-4a20-9c12-ad6f20e06d2e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:25:48.558887 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558885    2556 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:48.558887 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558904    2556 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-configmap-metrics-client-ca\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:48.558887 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558918    2556 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:48.558887 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.558935    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:48.559760 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.559734    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c4818dda-7659-4a20-9c12-ad6f20e06d2e" (UID: "c4818dda-7659-4a20-9c12-ad6f20e06d2e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:25:48.559957 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.559925    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c4818dda-7659-4a20-9c12-ad6f20e06d2e" (UID: "c4818dda-7659-4a20-9c12-ad6f20e06d2e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:25:48.560383 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.560355    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c4818dda-7659-4a20-9c12-ad6f20e06d2e" (UID: "c4818dda-7659-4a20-9c12-ad6f20e06d2e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:25:48.560493 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.560469    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c4818dda-7659-4a20-9c12-ad6f20e06d2e" (UID: "c4818dda-7659-4a20-9c12-ad6f20e06d2e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:25:48.560703 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.560676    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c4818dda-7659-4a20-9c12-ad6f20e06d2e" (UID: "c4818dda-7659-4a20-9c12-ad6f20e06d2e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:48.561299 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.561268    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-config" (OuterVolumeSpecName: "config") pod "c4818dda-7659-4a20-9c12-ad6f20e06d2e" (UID: "c4818dda-7659-4a20-9c12-ad6f20e06d2e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:48.562940 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.562911    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c4818dda-7659-4a20-9c12-ad6f20e06d2e" (UID: "c4818dda-7659-4a20-9c12-ad6f20e06d2e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:48.563034 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.562982    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c4818dda-7659-4a20-9c12-ad6f20e06d2e" (UID: "c4818dda-7659-4a20-9c12-ad6f20e06d2e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:48.563203 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.563183    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4818dda-7659-4a20-9c12-ad6f20e06d2e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c4818dda-7659-4a20-9c12-ad6f20e06d2e" (UID: "c4818dda-7659-4a20-9c12-ad6f20e06d2e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:25:48.563203 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.563188    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4818dda-7659-4a20-9c12-ad6f20e06d2e-config-out" (OuterVolumeSpecName: "config-out") pod "c4818dda-7659-4a20-9c12-ad6f20e06d2e" (UID: "c4818dda-7659-4a20-9c12-ad6f20e06d2e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:25:48.563298 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.563203    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c4818dda-7659-4a20-9c12-ad6f20e06d2e" (UID: "c4818dda-7659-4a20-9c12-ad6f20e06d2e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:48.563423 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.563398    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4818dda-7659-4a20-9c12-ad6f20e06d2e-kube-api-access-qkpdm" (OuterVolumeSpecName: "kube-api-access-qkpdm") pod "c4818dda-7659-4a20-9c12-ad6f20e06d2e" (UID: "c4818dda-7659-4a20-9c12-ad6f20e06d2e"). InnerVolumeSpecName "kube-api-access-qkpdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:25:48.563574 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.563552    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c4818dda-7659-4a20-9c12-ad6f20e06d2e" (UID: "c4818dda-7659-4a20-9c12-ad6f20e06d2e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:48.563805 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.563773    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c4818dda-7659-4a20-9c12-ad6f20e06d2e" (UID: "c4818dda-7659-4a20-9c12-ad6f20e06d2e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:48.564035 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.564016    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c4818dda-7659-4a20-9c12-ad6f20e06d2e" (UID: "c4818dda-7659-4a20-9c12-ad6f20e06d2e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:48.572900 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.572879    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-web-config" (OuterVolumeSpecName: "web-config") pod "c4818dda-7659-4a20-9c12-ad6f20e06d2e" (UID: "c4818dda-7659-4a20-9c12-ad6f20e06d2e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:48.660093 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.660055    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:48.660093 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.660086    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:48.660093 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.660100    2556 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-config\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:48.660354 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.660112    2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4818dda-7659-4a20-9c12-ad6f20e06d2e-config-out\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:48.660354 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.660125    2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:48.660354 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.660136    2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-web-config\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:48.660354 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.660147    2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:48.660354 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.660160    2556 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-grpc-tls\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:48.660354 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.660171    2556 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-metrics-client-certs\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:48.660354 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.660184    2556 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:48.660354 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.660196    2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:48.660354 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.660209    2556 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4818dda-7659-4a20-9c12-ad6f20e06d2e-secret-kube-rbac-proxy\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:48.660354 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.660220    2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4818dda-7659-4a20-9c12-ad6f20e06d2e-tls-assets\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:48.660354 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.660232    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:48.660354 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.660243    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkpdm\" (UniqueName: \"kubernetes.io/projected/c4818dda-7659-4a20-9c12-ad6f20e06d2e-kube-api-access-qkpdm\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:48.660354 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:48.660257    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c4818dda-7659-4a20-9c12-ad6f20e06d2e-prometheus-k8s-db\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:25:49.188897 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.188856    2556 generic.go:356] "Generic (PLEG): container finished" podID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerID="9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67" exitCode=0
Jul 20 22:25:49.188897 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.188887    2556 generic.go:356] "Generic (PLEG): container finished" podID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerID="1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc" exitCode=0
Jul 20 22:25:49.188897 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.188897    2556 generic.go:356] "Generic (PLEG): container finished" podID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerID="125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f" exitCode=0
Jul 20 22:25:49.188897 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.188906    2556 generic.go:356] "Generic (PLEG): container finished" podID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerID="16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865" exitCode=0
Jul 20 22:25:49.189249 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.188915    2556 generic.go:356] "Generic (PLEG): container finished" podID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerID="e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54" exitCode=0
Jul 20 22:25:49.189249 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.188923    2556 generic.go:356] "Generic (PLEG): container finished" podID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerID="5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459" exitCode=0
Jul 20 22:25:49.189249 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.188946    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.189249 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.188939    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4818dda-7659-4a20-9c12-ad6f20e06d2e","Type":"ContainerDied","Data":"9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67"}
Jul 20 22:25:49.189249 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.189027    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4818dda-7659-4a20-9c12-ad6f20e06d2e","Type":"ContainerDied","Data":"1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc"}
Jul 20 22:25:49.189249 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.189073    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4818dda-7659-4a20-9c12-ad6f20e06d2e","Type":"ContainerDied","Data":"125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f"}
Jul 20 22:25:49.189249 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.189095    2556 scope.go:117] "RemoveContainer" containerID="9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67"
Jul 20 22:25:49.189249 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.189111    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4818dda-7659-4a20-9c12-ad6f20e06d2e","Type":"ContainerDied","Data":"16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865"}
Jul 20 22:25:49.189249 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.189153    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4818dda-7659-4a20-9c12-ad6f20e06d2e","Type":"ContainerDied","Data":"e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54"}
Jul 20 22:25:49.189249 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.189195    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4818dda-7659-4a20-9c12-ad6f20e06d2e","Type":"ContainerDied","Data":"5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459"}
Jul 20 22:25:49.189249 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.189237    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4818dda-7659-4a20-9c12-ad6f20e06d2e","Type":"ContainerDied","Data":"b7524414357893a901eca867f68a892f295a00e69f69957df5da17c169b8444f"}
Jul 20 22:25:49.202467 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.202339    2556 scope.go:117] "RemoveContainer" containerID="1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc"
Jul 20 22:25:49.216087 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.216057    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 22:25:49.220477 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.220449    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 22:25:49.227561 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.227538    2556 scope.go:117] "RemoveContainer" containerID="125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f"
Jul 20 22:25:49.234670 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.234648    2556 scope.go:117] "RemoveContainer" containerID="16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865"
Jul 20 22:25:49.241591 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.241568    2556 scope.go:117] "RemoveContainer" containerID="e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54"
Jul 20 22:25:49.248478 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.248445    2556 scope.go:117] "RemoveContainer" containerID="5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459"
Jul 20 22:25:49.250247 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.250229    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 22:25:49.250513 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.250502    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="prometheus"
Jul 20 22:25:49.250551 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.250515    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="prometheus"
Jul 20 22:25:49.250551 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.250525    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="thanos-sidecar"
Jul 20 22:25:49.250551 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.250531    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="thanos-sidecar"
Jul 20 22:25:49.250551 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.250540    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="kube-rbac-proxy"
Jul 20 22:25:49.250551 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.250545    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="kube-rbac-proxy"
Jul 20 22:25:49.250737 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.250555    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="kube-rbac-proxy-web"
Jul 20 22:25:49.250737 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.250561    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="kube-rbac-proxy-web"
Jul 20 22:25:49.250737 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.250572    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="init-config-reloader"
Jul 20 22:25:49.250737 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.250578    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="init-config-reloader"
Jul 20 22:25:49.250737 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.250585    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="kube-rbac-proxy-thanos"
Jul 20 22:25:49.250737 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.250590    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="kube-rbac-proxy-thanos"
Jul 20 22:25:49.250737 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.250600    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="config-reloader"
Jul 20 22:25:49.250737 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.250622    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="config-reloader"
Jul 20 22:25:49.250737 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.250669    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="kube-rbac-proxy"
Jul 20 22:25:49.250737 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.250678    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="kube-rbac-proxy-thanos"
Jul 20 22:25:49.250737 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.250684    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="kube-rbac-proxy-web"
Jul 20 22:25:49.250737 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.250690    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="prometheus"
Jul 20 22:25:49.250737 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.250695    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="thanos-sidecar"
Jul 20 22:25:49.250737 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.250702    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" containerName="config-reloader"
Jul 20 22:25:49.254329 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.254311    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.256552 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.256534    2556 scope.go:117] "RemoveContainer" containerID="01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931"
Jul 20 22:25:49.257333 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.257303    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 20 22:25:49.257439 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.257389    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 20 22:25:49.257520 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.257389    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 20 22:25:49.257926 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.257907    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 20 22:25:49.258626 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.258586    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 20 22:25:49.258707 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.258602    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-66bdc2eo0f9bl\""
Jul 20 22:25:49.258923 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.258897    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 20 22:25:49.258923 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.258908    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 20 22:25:49.259093 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.259068    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 20 22:25:49.259093 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.259084    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 20 22:25:49.259242 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.259086    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hfl6q\""
Jul 20 22:25:49.259298 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.259278    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 20 22:25:49.259351 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.259304    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 20 22:25:49.260127 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.259949    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 20 22:25:49.261388 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.261373    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 20 22:25:49.264574 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.264555    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 20 22:25:49.265381 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.265362    2556 scope.go:117] "RemoveContainer" containerID="9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67"
Jul 20 22:25:49.265679 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:25:49.265661    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67\": container with ID starting with 9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67 not found: ID does not exist" containerID="9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67"
Jul 20 22:25:49.265730 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.265688    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67"} err="failed to get container status \"9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67\": rpc error: code = NotFound desc = could not find container \"9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67\": container with ID starting with 9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67 not found: ID does not exist"
Jul 20 22:25:49.265730 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.265707    2556 scope.go:117] "RemoveContainer" containerID="1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc"
Jul 20 22:25:49.265951 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:25:49.265934    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc\": container with ID starting with 1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc not found: ID does not exist" containerID="1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc"
Jul 20 22:25:49.265992 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.265956    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc"} err="failed to get container status \"1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc\": rpc error: code = NotFound desc = could not find container \"1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc\": container with ID starting with 1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc not found: ID does not exist"
Jul 20 22:25:49.265992 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.265972    2556 scope.go:117] "RemoveContainer" containerID="125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f"
Jul 20 22:25:49.266211 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:25:49.266197    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f\": container with ID starting with 125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f not found: ID does not exist" containerID="125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f"
Jul 20 22:25:49.266246 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.266213    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f"} err="failed to get container status \"125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f\": rpc error: code = NotFound desc = could not find container \"125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f\": container with ID starting with 125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f not found: ID does not exist"
Jul 20 22:25:49.266246 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.266226    2556 scope.go:117] "RemoveContainer" containerID="16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865"
Jul 20 22:25:49.266434 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:25:49.266420    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865\": container with ID starting with 16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865 not found: ID does not exist" containerID="16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865"
Jul 20 22:25:49.266474 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.266436    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865"} err="failed to get container status \"16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865\": rpc error: code = NotFound desc = could not find container \"16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865\": container with ID starting with 16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865 not found: ID does not exist"
Jul 20 22:25:49.266474 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.266448    2556 scope.go:117] "RemoveContainer" containerID="e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54"
Jul 20 22:25:49.266919 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:25:49.266901    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54\": container with ID starting with e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54 not found: ID does not exist" containerID="e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54"
Jul 20 22:25:49.266958 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.266923    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54"} err="failed to get container status \"e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54\": rpc error: code = NotFound desc = could not find container \"e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54\": container with ID starting with e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54 not found: ID does not exist"
Jul 20 22:25:49.266958 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.266939    2556 scope.go:117] "RemoveContainer" containerID="5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459"
Jul 20 22:25:49.267126 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:25:49.267113    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459\": container with ID starting with 5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459 not found: ID does not exist" containerID="5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459"
Jul 20 22:25:49.267162 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.267130    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459"} err="failed to get container status \"5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459\": rpc error: code = NotFound desc = could not find container \"5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459\": container with ID starting with 5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459 not found: ID does not exist"
Jul 20 22:25:49.267162 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.267143    2556 scope.go:117] "RemoveContainer" containerID="01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931"
Jul 20 22:25:49.267357 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:25:49.267338    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931\": container with ID starting with 01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931 not found: ID does not exist" containerID="01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931"
Jul 20 22:25:49.267413 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.267366    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931"} err="failed to get container status \"01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931\": rpc error: code = NotFound desc = could not find container \"01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931\": container with ID starting with 01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931 not found: ID does not exist"
Jul 20 22:25:49.267413 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.267388    2556 scope.go:117] "RemoveContainer" containerID="9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67"
Jul 20 22:25:49.267623 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.267595    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67"} err="failed to get container status \"9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67\": rpc error: code = NotFound desc = could not find container \"9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67\": container with ID starting with 9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67 not found: ID does not exist"
Jul 20 22:25:49.267666 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.267622    2556 scope.go:117] "RemoveContainer" containerID="1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc"
Jul 20 22:25:49.267820 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.267807    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc"} err="failed to get container status \"1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc\": rpc error: code = NotFound desc = could not find container \"1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc\": container with ID starting with 1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc not found: ID does not exist"
Jul 20 22:25:49.267870 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.267820    2556 scope.go:117] "RemoveContainer" containerID="125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f"
Jul 20 22:25:49.267993 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.267978    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f"} err="failed to get container status \"125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f\": rpc error: code = NotFound desc = could not find container \"125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f\": container with ID starting with 125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f not found: ID does not exist"
Jul 20 22:25:49.268034 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.267993    2556 scope.go:117] "RemoveContainer" containerID="16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865"
Jul 20 22:25:49.268171 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.268154    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865"} err="failed to get container status \"16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865\": rpc error: code = NotFound desc = could not find container \"16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865\": container with ID starting with 16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865 not found: ID does not exist"
Jul 20 22:25:49.268228 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.268172    2556 scope.go:117] "RemoveContainer" containerID="e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54"
Jul 20 22:25:49.268372 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.268358    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54"} err="failed to get container status \"e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54\": rpc error: code = NotFound desc = could not find container \"e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54\": container with ID starting with e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54 not found: ID does not exist"
Jul 20 22:25:49.268413 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.268373    2556 scope.go:117] "RemoveContainer" containerID="5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459"
Jul 20 22:25:49.268532 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.268517    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459"} err="failed to get container status \"5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459\": rpc error: code = NotFound desc = could not find container \"5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459\": container with ID starting with 5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459 not found: ID does not exist"
Jul 20 22:25:49.268572 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.268532    2556 scope.go:117] "RemoveContainer" containerID="01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931"
Jul 20 22:25:49.268717 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.268702    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931"} err="failed to get container status \"01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931\": rpc error: code = NotFound desc = could not find container \"01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931\": container with ID starting with 01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931 not found: ID does not exist"
Jul 20 22:25:49.268763 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.268716    2556 scope.go:117] "RemoveContainer" containerID="9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67"
Jul 20 22:25:49.268894 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.268878    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67"} err="failed to get container status \"9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67\": rpc error: code = NotFound desc = could not find container \"9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67\": container with ID starting with 9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67 not found: ID does not exist"
Jul 20 22:25:49.268956 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.268895    2556 scope.go:117] "RemoveContainer" containerID="1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc"
Jul 20 22:25:49.269088 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.269074    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc"} err="failed to get container status \"1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc\": rpc error: code = NotFound desc = could not find container \"1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc\": container with ID starting with 1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc not found: ID does not exist"
Jul 20 22:25:49.269129 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.269089    2556 scope.go:117] "RemoveContainer" containerID="125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f"
Jul 20 22:25:49.269259 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.269244    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f"} err="failed to get container status \"125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f\": rpc error: code = NotFound desc = could not find container \"125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f\": container with ID starting with 125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f not found: ID does not exist"
Jul 20 22:25:49.269297 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.269259    2556 scope.go:117] "RemoveContainer" containerID="16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865"
Jul 20 22:25:49.269425 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.269411    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865"} err="failed to get container status \"16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865\": rpc error: code = NotFound desc = could not find container \"16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865\": container with ID starting with 16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865 not found: ID does not exist"
Jul 20 22:25:49.269468 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.269425    2556 scope.go:117] "RemoveContainer" containerID="e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54"
Jul 20 22:25:49.269599 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.269578    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54"} err="failed to get container status \"e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54\": rpc error: code = NotFound desc = could not find container \"e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54\": container with ID starting with e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54 not found: ID does not exist"
Jul 20 22:25:49.269678 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.269600    2556 scope.go:117] "RemoveContainer" containerID="5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459"
Jul 20 22:25:49.269910 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.269893    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459"} err="failed to get container status \"5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459\": rpc error: code = NotFound desc = could not find container \"5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459\": container with ID starting with 5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459 not found: ID does not exist"
Jul 20 22:25:49.269979 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.269912    2556 scope.go:117] "RemoveContainer" containerID="01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931"
Jul 20 22:25:49.270168 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.270149    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931"} err="failed to get container status \"01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931\": rpc error: code = NotFound desc = could not find container \"01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931\": container with ID starting with 01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931 not found: ID does not exist"
Jul 20 22:25:49.270268 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.270170    2556 scope.go:117] "RemoveContainer" containerID="9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67"
Jul 20 22:25:49.270592 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.270573    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67"} err="failed to get container status \"9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67\": rpc error: code = NotFound desc = could not find container \"9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67\": container with ID starting with 9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67 not found: ID does not exist"
Jul 20 22:25:49.270725 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.270602    2556 scope.go:117] "RemoveContainer" containerID="1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc"
Jul 20 22:25:49.271276 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.271257    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc"} err="failed to get container status \"1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc\": rpc error: code = NotFound desc = could not find container \"1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc\": container with ID starting with 1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc not found: ID does not exist"
Jul 20 22:25:49.271361 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.271278    2556 scope.go:117] "RemoveContainer" containerID="125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f"
Jul 20 22:25:49.271535 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.271512    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f"} err="failed to get container status \"125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f\": rpc error: code = NotFound desc = could not find container \"125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f\": container with ID starting with 125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f not found: ID does not exist"
Jul 20 22:25:49.271585 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.271538    2556 scope.go:117] "RemoveContainer" containerID="16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865"
Jul 20 22:25:49.271842 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.271819    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865"} err="failed to get container status \"16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865\": rpc error: code = NotFound desc = could not find container \"16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865\": container with ID starting with 16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865 not found: ID does not exist"
Jul 20 22:25:49.271899 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.271845    2556 scope.go:117] "RemoveContainer" containerID="e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54"
Jul 20 22:25:49.272179 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.272153    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54"} err="failed to get container status \"e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54\": rpc error: code = NotFound desc = could not find container \"e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54\": container with ID starting with e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54 not found: ID does not exist"
Jul 20 22:25:49.272179 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.272179    2556 scope.go:117] "RemoveContainer" containerID="5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459"
Jul 20 22:25:49.272433 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.272416    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459"} err="failed to get container status \"5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459\": rpc error: code = NotFound desc = could not find container \"5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459\": container with ID starting with 5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459 not found: ID does not exist"
Jul 20 22:25:49.272433 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.272432    2556 scope.go:117] "RemoveContainer" containerID="01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931"
Jul 20 22:25:49.272692 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.272663    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931"} err="failed to get container status \"01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931\": rpc error: code = NotFound desc = could not find container \"01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931\": container with ID starting with 01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931 not found: ID does not exist"
Jul 20 22:25:49.272747 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.272691    2556 scope.go:117] "RemoveContainer" containerID="9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67"
Jul 20 22:25:49.272928 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.272906    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67"} err="failed to get container status \"9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67\": rpc error: code = NotFound desc = could not find container \"9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67\": container with ID starting with 9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67 not found: ID does not exist"
Jul 20 22:25:49.272928 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.272926    2556 scope.go:117] "RemoveContainer" containerID="1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc"
Jul 20 22:25:49.273172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.273154    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc"} err="failed to get container status \"1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc\": rpc error: code = NotFound desc = could not find container \"1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc\": container with ID starting with 1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc not found: ID does not exist"
Jul 20 22:25:49.273232 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.273173    2556 scope.go:117] "RemoveContainer" containerID="125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f"
Jul 20 22:25:49.273391 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.273373    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f"} err="failed to get container status \"125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f\": rpc error: code = NotFound desc = could not find container \"125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f\": container with ID starting with 125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f not found: ID does not exist"
Jul 20 22:25:49.273455 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.273391    2556 scope.go:117] "RemoveContainer" containerID="16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865"
Jul 20 22:25:49.273597 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.273582    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865"} err="failed to get container status \"16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865\": rpc error: code = NotFound desc = could not find container \"16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865\": container with ID starting with 16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865 not found: ID does not exist"
Jul 20 22:25:49.273691 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.273598    2556 scope.go:117] "RemoveContainer" containerID="e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54"
Jul 20 22:25:49.273818 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.273802    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54"} err="failed to get container status \"e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54\": rpc error: code = NotFound desc = could not find container \"e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54\": container with ID starting with e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54 not found: ID does not exist"
Jul 20 22:25:49.273818 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.273817    2556 scope.go:117] "RemoveContainer" containerID="5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459"
Jul 20 22:25:49.274073 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.274043    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459"} err="failed to get container status \"5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459\": rpc error: code = NotFound desc = could not find container \"5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459\": container with ID starting with 5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459 not found: ID does not exist"
Jul 20 22:25:49.274073 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.274068    2556 scope.go:117] "RemoveContainer" containerID="01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931"
Jul 20 22:25:49.274185 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.274083    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 22:25:49.274343 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.274320    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931"} err="failed to get container status \"01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931\": rpc error: code = NotFound desc = could not find container \"01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931\": container with ID starting with 01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931 not found: ID does not exist"
Jul 20 22:25:49.274387 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.274344    2556 scope.go:117] "RemoveContainer" containerID="9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67"
Jul 20 22:25:49.274652 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.274625    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67"} err="failed to get container status \"9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67\": rpc error: code = NotFound desc = could not find container \"9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67\": container with ID starting with 9d5f37a327aec67568de5484de9510dee22105d5f4a71bd45448ab799d379e67 not found: ID does not exist"
Jul 20 22:25:49.274652 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.274651    2556 scope.go:117] "RemoveContainer" containerID="1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc"
Jul 20 22:25:49.274945 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.274920    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc"} err="failed to get container status \"1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc\": rpc error: code = NotFound desc = could not find container \"1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc\": container with ID starting with 1b9d4e9a7d987352a0741d8d91322c03ba640b56b1037d519916c9f6ab0584fc not found: ID does not exist"
Jul 20 22:25:49.275011 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.274946    2556 scope.go:117] "RemoveContainer" containerID="125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f"
Jul 20 22:25:49.277351 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.275212    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f"} err="failed to get container status \"125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f\": rpc error: code = NotFound desc = could not find container \"125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f\": container with ID starting with 125e8168b4203d242fa5882b39b2bd3e8e154f8d91edad72cf5b2deb3c2ce38f not found: ID does not exist"
Jul 20 22:25:49.277351 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.275239    2556 scope.go:117] "RemoveContainer" containerID="16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865"
Jul 20 22:25:49.277500 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.277434    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865"} err="failed to get container status \"16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865\": rpc error: code = NotFound desc = could not find container \"16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865\": container with ID starting with 16c23c603c2a08c3a1df4a3cbf8d68aa92bfea5acd547beff477fd3150948865 not found: ID does not exist"
Jul 20 22:25:49.277500 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.277461    2556 scope.go:117] "RemoveContainer" containerID="e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54"
Jul 20 22:25:49.277745 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.277722    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54"} err="failed to get container status \"e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54\": rpc error: code = NotFound desc = could not find container \"e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54\": container with ID starting with e37f7aa906a0cfc0e939ad8f9643c65c0a7c0a5c7fc0cc48e1f3dedff3a72b54 not found: ID does not exist"
Jul 20 22:25:49.277844 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.277746    2556 scope.go:117] "RemoveContainer" containerID="5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459"
Jul 20 22:25:49.278010 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.277979    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459"} err="failed to get container status \"5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459\": rpc error: code = NotFound desc = could not find container \"5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459\": container with ID starting with 5cfb49a4e5025d7305fe25b2aa378208f40ff432f02e02a002f4cf6118862459 not found: ID does not exist"
Jul 20 22:25:49.278104 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.278011    2556 scope.go:117] "RemoveContainer" containerID="01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931"
Jul 20 22:25:49.278294 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.278273    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931"} err="failed to get container status \"01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931\": rpc error: code = NotFound desc = could not find container \"01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931\": container with ID starting with 01cb942e83fe61c8d79029e5fbd4d4db4bfbde2872ee65cd3d16219675971931 not found: ID does not exist"
Jul 20 22:25:49.365183 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.365148    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.365346 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.365188    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.365346 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.365233    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsx4q\" (UniqueName: \"kubernetes.io/projected/aff3a606-3a71-43c6-b433-8ccc61cc5b26-kube-api-access-dsx4q\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.365346 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.365263    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aff3a606-3a71-43c6-b433-8ccc61cc5b26-config-out\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.365346 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.365280    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aff3a606-3a71-43c6-b433-8ccc61cc5b26-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.365346 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.365329    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.365498 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.365371    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-web-config\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.365498 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.365415    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/aff3a606-3a71-43c6-b433-8ccc61cc5b26-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.365498 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.365460    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aff3a606-3a71-43c6-b433-8ccc61cc5b26-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.365498 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.365478    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.365498 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.365493    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aff3a606-3a71-43c6-b433-8ccc61cc5b26-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.365660 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.365513    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.365660 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.365559    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.365660 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.365576    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/aff3a606-3a71-43c6-b433-8ccc61cc5b26-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.365660 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.365601    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aff3a606-3a71-43c6-b433-8ccc61cc5b26-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.365779 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.365669    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-config\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.365779 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.365684    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/aff3a606-3a71-43c6-b433-8ccc61cc5b26-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.365779 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.365708    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/aff3a606-3a71-43c6-b433-8ccc61cc5b26-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.365779 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.365729    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aff3a606-3a71-43c6-b433-8ccc61cc5b26-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.365779 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.365764    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.466183 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.466099    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aff3a606-3a71-43c6-b433-8ccc61cc5b26-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.466183 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.466146    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.466183 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.466178    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.466526 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.466206    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.466526 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.466232    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsx4q\" (UniqueName: \"kubernetes.io/projected/aff3a606-3a71-43c6-b433-8ccc61cc5b26-kube-api-access-dsx4q\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.466526 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.466253    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aff3a606-3a71-43c6-b433-8ccc61cc5b26-config-out\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.466526 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.466279    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aff3a606-3a71-43c6-b433-8ccc61cc5b26-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.466526 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.466305    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.466526 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.466324    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-web-config\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.466526 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.466351    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/aff3a606-3a71-43c6-b433-8ccc61cc5b26-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.466526 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.466385    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aff3a606-3a71-43c6-b433-8ccc61cc5b26-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.466526 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.466411    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.466526 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.466436    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aff3a606-3a71-43c6-b433-8ccc61cc5b26-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.466526 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.466463    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.466526 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.466503    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.466526 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.466530    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/aff3a606-3a71-43c6-b433-8ccc61cc5b26-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.467167 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.466553    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aff3a606-3a71-43c6-b433-8ccc61cc5b26-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.467167 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.466583    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-config\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.467167 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.466637    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/aff3a606-3a71-43c6-b433-8ccc61cc5b26-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.467167 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.466678    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/aff3a606-3a71-43c6-b433-8ccc61cc5b26-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.467167 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.466811    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aff3a606-3a71-43c6-b433-8ccc61cc5b26-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.467167 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.466998    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aff3a606-3a71-43c6-b433-8ccc61cc5b26-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.467436 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.467175    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/aff3a606-3a71-43c6-b433-8ccc61cc5b26-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.467436 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.467263    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aff3a606-3a71-43c6-b433-8ccc61cc5b26-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.467553 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.467457    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/aff3a606-3a71-43c6-b433-8ccc61cc5b26-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.469840 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.469800    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aff3a606-3a71-43c6-b433-8ccc61cc5b26-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.469986 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.469964    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.470052 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.469987    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.470121 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.470106    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.470177 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.470110    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.470225 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.470185    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.470225 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.470214    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aff3a606-3a71-43c6-b433-8ccc61cc5b26-config-out\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.470801 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.470729    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aff3a606-3a71-43c6-b433-8ccc61cc5b26-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.470801 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.470734    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/aff3a606-3a71-43c6-b433-8ccc61cc5b26-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.470938 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.470891    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.472383 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.472365    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-config\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.472458 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.472423    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-web-config\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.472701 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.472683    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aff3a606-3a71-43c6-b433-8ccc61cc5b26-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.473256 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.473239    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/aff3a606-3a71-43c6-b433-8ccc61cc5b26-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.476535 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.476516    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsx4q\" (UniqueName: \"kubernetes.io/projected/aff3a606-3a71-43c6-b433-8ccc61cc5b26-kube-api-access-dsx4q\") pod \"prometheus-k8s-0\" (UID: \"aff3a606-3a71-43c6-b433-8ccc61cc5b26\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.565862 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.565821    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:49.706224 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:49.706200    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 22:25:49.708046 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:25:49.708019    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff3a606_3a71_43c6_b433_8ccc61cc5b26.slice/crio-bcbf2426a290bbde22610dd93028457c0fd4e7ba5aa2dce6ef091a0752a93217 WatchSource:0}: Error finding container bcbf2426a290bbde22610dd93028457c0fd4e7ba5aa2dce6ef091a0752a93217: Status 404 returned error can't find the container with id bcbf2426a290bbde22610dd93028457c0fd4e7ba5aa2dce6ef091a0752a93217
Jul 20 22:25:50.194870 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:50.194836    2556 generic.go:356] "Generic (PLEG): container finished" podID="aff3a606-3a71-43c6-b433-8ccc61cc5b26" containerID="438c920aa90b967a40bc35f32a727d47352328dc604f3f6ac3e9b0b65479a22b" exitCode=0
Jul 20 22:25:50.195031 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:50.194923    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aff3a606-3a71-43c6-b433-8ccc61cc5b26","Type":"ContainerDied","Data":"438c920aa90b967a40bc35f32a727d47352328dc604f3f6ac3e9b0b65479a22b"}
Jul 20 22:25:50.195031 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:50.195001    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aff3a606-3a71-43c6-b433-8ccc61cc5b26","Type":"ContainerStarted","Data":"bcbf2426a290bbde22610dd93028457c0fd4e7ba5aa2dce6ef091a0752a93217"}
Jul 20 22:25:51.206978 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:51.206942    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4818dda-7659-4a20-9c12-ad6f20e06d2e" path="/var/lib/kubelet/pods/c4818dda-7659-4a20-9c12-ad6f20e06d2e/volumes"
Jul 20 22:25:51.207676 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:51.207653    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aff3a606-3a71-43c6-b433-8ccc61cc5b26","Type":"ContainerStarted","Data":"7d5de986ffa42b8f62bdd26e09f09c801ec5c4110046cec39f22c1f647955797"}
Jul 20 22:25:51.207978 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:51.207732    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aff3a606-3a71-43c6-b433-8ccc61cc5b26","Type":"ContainerStarted","Data":"955a16d5a5ae2a5b9744f870139e08ea4a4c7dda33dcacb3c59f46dde5cf9bc0"}
Jul 20 22:25:51.207978 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:51.207774    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aff3a606-3a71-43c6-b433-8ccc61cc5b26","Type":"ContainerStarted","Data":"e94fd1d6c8ea921121515c373e6fd3ae8ea34514cde1defd24ad0e7c1f5b6328"}
Jul 20 22:25:51.207978 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:51.207817    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aff3a606-3a71-43c6-b433-8ccc61cc5b26","Type":"ContainerStarted","Data":"d4612dc73806e45c57be12393cb8ec0a4b6c96b7f996f44cf3f2c0f1e4dbf0a3"}
Jul 20 22:25:51.207978 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:51.207856    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aff3a606-3a71-43c6-b433-8ccc61cc5b26","Type":"ContainerStarted","Data":"c21362d311ddbbb80b854a1baec027867097c5c17e87f265b9f40be8064704cf"}
Jul 20 22:25:51.207978 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:51.207900    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"aff3a606-3a71-43c6-b433-8ccc61cc5b26","Type":"ContainerStarted","Data":"67cb277a222cfcf109f943345070f191abcf41ef6291985320a352e5c59d85a1"}
Jul 20 22:25:51.234512 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:51.234449    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.216493558 podStartE2EDuration="2.234424722s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.931164ms" isStatefulPod=false podCreationTimestamp="2026-07-20 22:25:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:25:51.232184382 +0000 UTC m=+164.530400951" watchObservedRunningTime="2026-07-20 22:25:51.234424722 +0000 UTC m=+164.532641294"
Jul 20 22:25:54.566595 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:25:54.566547    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:26:49.566476 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:26:49.566431    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:26:49.581817 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:26:49.581793    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:26:50.449286 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:26:50.449262    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:28:07.052298 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:07.052271    2556 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 22:28:25.007257 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:25.007199    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-h7hff"]
Jul 20 22:28:25.010508 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:25.010493    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-h7hff"
Jul 20 22:28:25.013550 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:25.013530    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-jgcrw\""
Jul 20 22:28:25.014395 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:25.014380    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 20 22:28:25.014491 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:25.014443    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 20 22:28:25.029631 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:25.029591    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-h7hff"]
Jul 20 22:28:25.124431 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:25.124386    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82970b6d-e726-45bc-8687-27ff5f473cc0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-h7hff\" (UID: \"82970b6d-e726-45bc-8687-27ff5f473cc0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h7hff"
Jul 20 22:28:25.124692 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:25.124476    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8m9d\" (UniqueName: \"kubernetes.io/projected/82970b6d-e726-45bc-8687-27ff5f473cc0-kube-api-access-p8m9d\") pod \"cert-manager-webhook-6486ffd997-h7hff\" (UID: \"82970b6d-e726-45bc-8687-27ff5f473cc0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h7hff"
Jul 20 22:28:25.225813 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:25.225772    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8m9d\" (UniqueName: \"kubernetes.io/projected/82970b6d-e726-45bc-8687-27ff5f473cc0-kube-api-access-p8m9d\") pod \"cert-manager-webhook-6486ffd997-h7hff\" (UID: \"82970b6d-e726-45bc-8687-27ff5f473cc0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h7hff"
Jul 20 22:28:25.225964 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:25.225889    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82970b6d-e726-45bc-8687-27ff5f473cc0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-h7hff\" (UID: \"82970b6d-e726-45bc-8687-27ff5f473cc0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h7hff"
Jul 20 22:28:25.246633 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:25.246584    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82970b6d-e726-45bc-8687-27ff5f473cc0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-h7hff\" (UID: \"82970b6d-e726-45bc-8687-27ff5f473cc0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h7hff"
Jul 20 22:28:25.246834 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:25.246813    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8m9d\" (UniqueName: \"kubernetes.io/projected/82970b6d-e726-45bc-8687-27ff5f473cc0-kube-api-access-p8m9d\") pod \"cert-manager-webhook-6486ffd997-h7hff\" (UID: \"82970b6d-e726-45bc-8687-27ff5f473cc0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h7hff"
Jul 20 22:28:25.337819 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:25.337722    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-h7hff"
Jul 20 22:28:25.494721 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:25.494688    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-h7hff"]
Jul 20 22:28:25.498195 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:28:25.498157    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82970b6d_e726_45bc_8687_27ff5f473cc0.slice/crio-ef15ae1fd66227b3988bc3506e83de0837fa253aa15eec9da9081f89498a9f14 WatchSource:0}: Error finding container ef15ae1fd66227b3988bc3506e83de0837fa253aa15eec9da9081f89498a9f14: Status 404 returned error can't find the container with id ef15ae1fd66227b3988bc3506e83de0837fa253aa15eec9da9081f89498a9f14
Jul 20 22:28:25.500205 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:25.500189    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 22:28:25.801552 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:25.801517    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-h7hff" event={"ID":"82970b6d-e726-45bc-8687-27ff5f473cc0","Type":"ContainerStarted","Data":"ef15ae1fd66227b3988bc3506e83de0837fa253aa15eec9da9081f89498a9f14"}
Jul 20 22:28:28.816306 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:28.816270    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-h7hff" event={"ID":"82970b6d-e726-45bc-8687-27ff5f473cc0","Type":"ContainerStarted","Data":"949ba6c830902baee6daba8af197ad73be5f2dc21f1135c47a9922b57b2c254f"}
Jul 20 22:28:28.816744 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:28.816339    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-h7hff"
Jul 20 22:28:28.844182 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:28.844129    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-h7hff" podStartSLOduration=2.019464963 podStartE2EDuration="4.844114905s" totalImagesPullingTime="2.824649942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:28:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:28:28.842463053 +0000 UTC m=+322.140679622" watchObservedRunningTime="2026-07-20 22:28:28.844114905 +0000 UTC m=+322.142331475"
Jul 20 22:28:34.712841 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:34.712780    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qzl6b"]
Jul 20 22:28:34.716280 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:34.716261    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qzl6b"
Jul 20 22:28:34.722222 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:34.722010    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-w72vw\""
Jul 20 22:28:34.736193 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:34.736171    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qzl6b"]
Jul 20 22:28:34.809732 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:34.809692    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96l5z\" (UniqueName: \"kubernetes.io/projected/c64ecc5f-ba87-4da0-96b6-8812bcaf7cc5-kube-api-access-96l5z\") pod \"cert-manager-55b4d954d5-qzl6b\" (UID: \"c64ecc5f-ba87-4da0-96b6-8812bcaf7cc5\") " pod="cert-manager/cert-manager-55b4d954d5-qzl6b"
Jul 20 22:28:34.809912 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:34.809755    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c64ecc5f-ba87-4da0-96b6-8812bcaf7cc5-bound-sa-token\") pod \"cert-manager-55b4d954d5-qzl6b\" (UID: \"c64ecc5f-ba87-4da0-96b6-8812bcaf7cc5\") " pod="cert-manager/cert-manager-55b4d954d5-qzl6b"
Jul 20 22:28:34.823283 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:34.823261    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-h7hff"
Jul 20 22:28:34.911316 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:34.911273    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96l5z\" (UniqueName: \"kubernetes.io/projected/c64ecc5f-ba87-4da0-96b6-8812bcaf7cc5-kube-api-access-96l5z\") pod \"cert-manager-55b4d954d5-qzl6b\" (UID: \"c64ecc5f-ba87-4da0-96b6-8812bcaf7cc5\") " pod="cert-manager/cert-manager-55b4d954d5-qzl6b"
Jul 20 22:28:34.911517 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:34.911384    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c64ecc5f-ba87-4da0-96b6-8812bcaf7cc5-bound-sa-token\") pod \"cert-manager-55b4d954d5-qzl6b\" (UID: \"c64ecc5f-ba87-4da0-96b6-8812bcaf7cc5\") " pod="cert-manager/cert-manager-55b4d954d5-qzl6b"
Jul 20 22:28:34.940186 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:34.940151    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c64ecc5f-ba87-4da0-96b6-8812bcaf7cc5-bound-sa-token\") pod \"cert-manager-55b4d954d5-qzl6b\" (UID: \"c64ecc5f-ba87-4da0-96b6-8812bcaf7cc5\") " pod="cert-manager/cert-manager-55b4d954d5-qzl6b"
Jul 20 22:28:34.952252 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:34.952219    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96l5z\" (UniqueName: \"kubernetes.io/projected/c64ecc5f-ba87-4da0-96b6-8812bcaf7cc5-kube-api-access-96l5z\") pod \"cert-manager-55b4d954d5-qzl6b\" (UID: \"c64ecc5f-ba87-4da0-96b6-8812bcaf7cc5\") " pod="cert-manager/cert-manager-55b4d954d5-qzl6b"
Jul 20 22:28:35.031591 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:35.031494    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qzl6b"
Jul 20 22:28:35.181075 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:35.181043    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qzl6b"]
Jul 20 22:28:35.184248 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:28:35.184220    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc64ecc5f_ba87_4da0_96b6_8812bcaf7cc5.slice/crio-5e89b0b43545e63dbf02b9ed5433b6dbcdd888588c7887f619a925609ab15132 WatchSource:0}: Error finding container 5e89b0b43545e63dbf02b9ed5433b6dbcdd888588c7887f619a925609ab15132: Status 404 returned error can't find the container with id 5e89b0b43545e63dbf02b9ed5433b6dbcdd888588c7887f619a925609ab15132
Jul 20 22:28:35.847491 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:35.847450    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qzl6b" event={"ID":"c64ecc5f-ba87-4da0-96b6-8812bcaf7cc5","Type":"ContainerStarted","Data":"2585c56640191b97d4a83a392af9b3f23891388e68b68ec339677ecef13040b5"}
Jul 20 22:28:35.847491 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:35.847489    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qzl6b" event={"ID":"c64ecc5f-ba87-4da0-96b6-8812bcaf7cc5","Type":"ContainerStarted","Data":"5e89b0b43545e63dbf02b9ed5433b6dbcdd888588c7887f619a925609ab15132"}
Jul 20 22:28:35.867047 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:35.866997    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-qzl6b" podStartSLOduration=1.866979357 podStartE2EDuration="1.866979357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:28:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:28:35.866135826 +0000 UTC m=+329.164352396" watchObservedRunningTime="2026-07-20 22:28:35.866979357 +0000 UTC m=+329.165195926"
Jul 20 22:28:59.839598 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:59.839520    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x"]
Jul 20 22:28:59.843039 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:59.843020    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x"
Jul 20 22:28:59.848644 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:59.848603    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 20 22:28:59.849907 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:59.849681    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5rcrj\""
Jul 20 22:28:59.849907 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:59.849895    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 20 22:28:59.850034 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:59.850008    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 20 22:28:59.850181 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:59.850164    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 20 22:28:59.885838 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:59.885798    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x"]
Jul 20 22:28:59.932579 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:59.932541    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3e7e111c-8336-48f9-8790-f7c24fa8b21d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b4989886d-fkx5x\" (UID: \"3e7e111c-8336-48f9-8790-f7c24fa8b21d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x"
Jul 20 22:28:59.932766 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:59.932597    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e7e111c-8336-48f9-8790-f7c24fa8b21d-tmp\") pod \"opendatahub-operator-controller-manager-6b4989886d-fkx5x\" (UID: \"3e7e111c-8336-48f9-8790-f7c24fa8b21d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x"
Jul 20 22:28:59.932766 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:59.932666    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3e7e111c-8336-48f9-8790-f7c24fa8b21d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b4989886d-fkx5x\" (UID: \"3e7e111c-8336-48f9-8790-f7c24fa8b21d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x"
Jul 20 22:28:59.932766 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:59.932684    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frs5f\" (UniqueName: \"kubernetes.io/projected/3e7e111c-8336-48f9-8790-f7c24fa8b21d-kube-api-access-frs5f\") pod \"opendatahub-operator-controller-manager-6b4989886d-fkx5x\" (UID: \"3e7e111c-8336-48f9-8790-f7c24fa8b21d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x"
Jul 20 22:28:59.932875 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:28:59.932776    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3e7e111c-8336-48f9-8790-f7c24fa8b21d-manifests\") pod \"opendatahub-operator-controller-manager-6b4989886d-fkx5x\" (UID: \"3e7e111c-8336-48f9-8790-f7c24fa8b21d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x"
Jul 20 22:29:00.033251 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:00.033211    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e7e111c-8336-48f9-8790-f7c24fa8b21d-tmp\") pod \"opendatahub-operator-controller-manager-6b4989886d-fkx5x\" (UID: \"3e7e111c-8336-48f9-8790-f7c24fa8b21d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x"
Jul 20 22:29:00.033251 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:00.033260    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3e7e111c-8336-48f9-8790-f7c24fa8b21d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b4989886d-fkx5x\" (UID: \"3e7e111c-8336-48f9-8790-f7c24fa8b21d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x"
Jul 20 22:29:00.033485 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:00.033278    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frs5f\" (UniqueName: \"kubernetes.io/projected/3e7e111c-8336-48f9-8790-f7c24fa8b21d-kube-api-access-frs5f\") pod \"opendatahub-operator-controller-manager-6b4989886d-fkx5x\" (UID: \"3e7e111c-8336-48f9-8790-f7c24fa8b21d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x"
Jul 20 22:29:00.033485 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:00.033328    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3e7e111c-8336-48f9-8790-f7c24fa8b21d-manifests\") pod \"opendatahub-operator-controller-manager-6b4989886d-fkx5x\" (UID: \"3e7e111c-8336-48f9-8790-f7c24fa8b21d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x"
Jul 20 22:29:00.033485 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:00.033356    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3e7e111c-8336-48f9-8790-f7c24fa8b21d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b4989886d-fkx5x\" (UID: \"3e7e111c-8336-48f9-8790-f7c24fa8b21d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x"
Jul 20 22:29:00.033796 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:00.033765    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3e7e111c-8336-48f9-8790-f7c24fa8b21d-manifests\") pod \"opendatahub-operator-controller-manager-6b4989886d-fkx5x\" (UID: \"3e7e111c-8336-48f9-8790-f7c24fa8b21d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x"
Jul 20 22:29:00.035698 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:00.035668    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e7e111c-8336-48f9-8790-f7c24fa8b21d-tmp\") pod \"opendatahub-operator-controller-manager-6b4989886d-fkx5x\" (UID: \"3e7e111c-8336-48f9-8790-f7c24fa8b21d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x"
Jul 20 22:29:00.035762 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:00.035743    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3e7e111c-8336-48f9-8790-f7c24fa8b21d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b4989886d-fkx5x\" (UID: \"3e7e111c-8336-48f9-8790-f7c24fa8b21d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x"
Jul 20 22:29:00.035853 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:00.035838    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3e7e111c-8336-48f9-8790-f7c24fa8b21d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b4989886d-fkx5x\" (UID: \"3e7e111c-8336-48f9-8790-f7c24fa8b21d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x"
Jul 20 22:29:00.042267 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:00.042239    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frs5f\" (UniqueName: \"kubernetes.io/projected/3e7e111c-8336-48f9-8790-f7c24fa8b21d-kube-api-access-frs5f\") pod \"opendatahub-operator-controller-manager-6b4989886d-fkx5x\" (UID: \"3e7e111c-8336-48f9-8790-f7c24fa8b21d\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x"
Jul 20 22:29:00.153577 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:00.153492    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x"
Jul 20 22:29:00.322708 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:00.322647    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x"]
Jul 20 22:29:00.325059 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:29:00.325021    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e7e111c_8336_48f9_8790_f7c24fa8b21d.slice/crio-0cd0250244d56feed324eed901244c49228202f66c842f3e08d4ee10cb53edca WatchSource:0}: Error finding container 0cd0250244d56feed324eed901244c49228202f66c842f3e08d4ee10cb53edca: Status 404 returned error can't find the container with id 0cd0250244d56feed324eed901244c49228202f66c842f3e08d4ee10cb53edca
Jul 20 22:29:00.957784 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:00.957740    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x" event={"ID":"3e7e111c-8336-48f9-8790-f7c24fa8b21d","Type":"ContainerStarted","Data":"0cd0250244d56feed324eed901244c49228202f66c842f3e08d4ee10cb53edca"}
Jul 20 22:29:03.973728 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:03.973688    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x" event={"ID":"3e7e111c-8336-48f9-8790-f7c24fa8b21d","Type":"ContainerStarted","Data":"094eb00d8b5f44cb7424e34417a1fba4d4358f8b0fbdc8ecfe927866f09e7e3b"}
Jul 20 22:29:04.978944 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:04.978909    2556 generic.go:356] "Generic (PLEG): container finished" podID="3e7e111c-8336-48f9-8790-f7c24fa8b21d" containerID="094eb00d8b5f44cb7424e34417a1fba4d4358f8b0fbdc8ecfe927866f09e7e3b" exitCode=0
Jul 20 22:29:04.979384 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:04.979004    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x" event={"ID":"3e7e111c-8336-48f9-8790-f7c24fa8b21d","Type":"ContainerDied","Data":"094eb00d8b5f44cb7424e34417a1fba4d4358f8b0fbdc8ecfe927866f09e7e3b"}
Jul 20 22:29:05.985024 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:05.984990    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x" event={"ID":"3e7e111c-8336-48f9-8790-f7c24fa8b21d","Type":"ContainerStarted","Data":"d87877927cd6dd74779e043ffcb5a96fbd272c8f337f686207553b784c31287e"}
Jul 20 22:29:05.985424 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:05.985111    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x"
Jul 20 22:29:06.011371 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:06.011318    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x" podStartSLOduration=2.5569302670000003 podStartE2EDuration="7.011299986s" totalImagesPullingTime="3.390814971s" totalInitContainerRuntime="1.063554748s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:28:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:29:06.010222038 +0000 UTC m=+359.308438607" watchObservedRunningTime="2026-07-20 22:29:06.011299986 +0000 UTC m=+359.309516634"
Jul 20 22:29:16.991208 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:16.991180    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b4989886d-fkx5x"
Jul 20 22:29:26.887696 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:26.887664    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f85f98759-fzrk2"]
Jul 20 22:29:26.896424 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:26.896405    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f85f98759-fzrk2"
Jul 20 22:29:26.903676 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:26.903571    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 20 22:29:26.903676 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:26.903640    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 20 22:29:26.903676 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:26.903651    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 20 22:29:26.903676 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:26.903675    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 20 22:29:26.903908 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:26.903653    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 20 22:29:26.905357 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:26.905343    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-npv5z\""
Jul 20 22:29:26.936519 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:26.936486    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f85f98759-fzrk2"]
Jul 20 22:29:26.979116 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:26.979086    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7fdee320-440f-4b46-8559-3005a4b97be8-metrics-cert\") pod \"lws-controller-manager-7f85f98759-fzrk2\" (UID: \"7fdee320-440f-4b46-8559-3005a4b97be8\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-fzrk2"
Jul 20 22:29:26.979276 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:26.979138    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ngdl\" (UniqueName: \"kubernetes.io/projected/7fdee320-440f-4b46-8559-3005a4b97be8-kube-api-access-5ngdl\") pod \"lws-controller-manager-7f85f98759-fzrk2\" (UID: \"7fdee320-440f-4b46-8559-3005a4b97be8\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-fzrk2"
Jul 20 22:29:26.979276 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:26.979187    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7fdee320-440f-4b46-8559-3005a4b97be8-manager-config\") pod \"lws-controller-manager-7f85f98759-fzrk2\" (UID: \"7fdee320-440f-4b46-8559-3005a4b97be8\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-fzrk2"
Jul 20 22:29:26.979276 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:26.979250    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fdee320-440f-4b46-8559-3005a4b97be8-cert\") pod \"lws-controller-manager-7f85f98759-fzrk2\" (UID: \"7fdee320-440f-4b46-8559-3005a4b97be8\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-fzrk2"
Jul 20 22:29:27.080372 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:27.080339    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fdee320-440f-4b46-8559-3005a4b97be8-cert\") pod \"lws-controller-manager-7f85f98759-fzrk2\" (UID: \"7fdee320-440f-4b46-8559-3005a4b97be8\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-fzrk2"
Jul 20 22:29:27.080566 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:27.080383    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7fdee320-440f-4b46-8559-3005a4b97be8-metrics-cert\") pod \"lws-controller-manager-7f85f98759-fzrk2\" (UID: \"7fdee320-440f-4b46-8559-3005a4b97be8\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-fzrk2"
Jul 20 22:29:27.080566 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:27.080434    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ngdl\" (UniqueName: \"kubernetes.io/projected/7fdee320-440f-4b46-8559-3005a4b97be8-kube-api-access-5ngdl\") pod \"lws-controller-manager-7f85f98759-fzrk2\" (UID: \"7fdee320-440f-4b46-8559-3005a4b97be8\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-fzrk2"
Jul 20 22:29:27.080566 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:27.080461    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7fdee320-440f-4b46-8559-3005a4b97be8-manager-config\") pod \"lws-controller-manager-7f85f98759-fzrk2\" (UID: \"7fdee320-440f-4b46-8559-3005a4b97be8\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-fzrk2"
Jul 20 22:29:27.081175 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:27.081149    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7fdee320-440f-4b46-8559-3005a4b97be8-manager-config\") pod \"lws-controller-manager-7f85f98759-fzrk2\" (UID: \"7fdee320-440f-4b46-8559-3005a4b97be8\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-fzrk2"
Jul 20 22:29:27.082840 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:27.082822    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7fdee320-440f-4b46-8559-3005a4b97be8-metrics-cert\") pod \"lws-controller-manager-7f85f98759-fzrk2\" (UID: \"7fdee320-440f-4b46-8559-3005a4b97be8\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-fzrk2"
Jul 20 22:29:27.082954 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:27.082854    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fdee320-440f-4b46-8559-3005a4b97be8-cert\") pod \"lws-controller-manager-7f85f98759-fzrk2\" (UID: \"7fdee320-440f-4b46-8559-3005a4b97be8\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-fzrk2"
Jul 20 22:29:27.091081 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:27.091053    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ngdl\" (UniqueName: \"kubernetes.io/projected/7fdee320-440f-4b46-8559-3005a4b97be8-kube-api-access-5ngdl\") pod \"lws-controller-manager-7f85f98759-fzrk2\" (UID: \"7fdee320-440f-4b46-8559-3005a4b97be8\") " pod="openshift-lws-operator/lws-controller-manager-7f85f98759-fzrk2"
Jul 20 22:29:27.205519 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:27.205490    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f85f98759-fzrk2"
Jul 20 22:29:27.347590 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:27.347449    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f85f98759-fzrk2"]
Jul 20 22:29:27.350008 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:29:27.349971    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fdee320_440f_4b46_8559_3005a4b97be8.slice/crio-8a29276ad1a4bc6b5d32b9d763ad8fd46f7bef03053e49c228defbc90288c67d WatchSource:0}: Error finding container 8a29276ad1a4bc6b5d32b9d763ad8fd46f7bef03053e49c228defbc90288c67d: Status 404 returned error can't find the container with id 8a29276ad1a4bc6b5d32b9d763ad8fd46f7bef03053e49c228defbc90288c67d
Jul 20 22:29:28.078930 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:28.078892    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f85f98759-fzrk2" event={"ID":"7fdee320-440f-4b46-8559-3005a4b97be8","Type":"ContainerStarted","Data":"8a29276ad1a4bc6b5d32b9d763ad8fd46f7bef03053e49c228defbc90288c67d"}
Jul 20 22:29:30.090091 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:30.090052    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f85f98759-fzrk2" event={"ID":"7fdee320-440f-4b46-8559-3005a4b97be8","Type":"ContainerStarted","Data":"acf6545f041494b9187c042e773f71dd2e6839706dbab703d4911aa7bfc226c0"}
Jul 20 22:29:30.090560 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:30.090215    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7f85f98759-fzrk2"
Jul 20 22:29:30.127020 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:30.126913    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7f85f98759-fzrk2" podStartSLOduration=1.619554077 podStartE2EDuration="4.126894419s" totalImagesPullingTime="2.507340342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:29:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:29:30.124792338 +0000 UTC m=+383.423008908" watchObservedRunningTime="2026-07-20 22:29:30.126894419 +0000 UTC m=+383.425110989"
Jul 20 22:29:30.791544 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:30.791502    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-76f85576d5-5mjpz"]
Jul 20 22:29:30.794004 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:30.793987    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-76f85576d5-5mjpz"
Jul 20 22:29:30.797711 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:30.797688    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 22:29:30.798032 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:30.798010    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 20 22:29:30.798168 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:30.798100    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-m2wht\""
Jul 20 22:29:30.798334 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:30.798306    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 22:29:30.798400 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:30.798343    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 20 22:29:30.824149 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:30.824119    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-76f85576d5-5mjpz"]
Jul 20 22:29:30.916717 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:30.916684    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c8a573e-d601-4406-a0ca-270f5622b82f-tls-certs\") pod \"kube-auth-proxy-76f85576d5-5mjpz\" (UID: \"1c8a573e-d601-4406-a0ca-270f5622b82f\") " pod="openshift-ingress/kube-auth-proxy-76f85576d5-5mjpz"
Jul 20 22:29:30.916885 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:30.916817    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c8a573e-d601-4406-a0ca-270f5622b82f-tmp\") pod \"kube-auth-proxy-76f85576d5-5mjpz\" (UID: \"1c8a573e-d601-4406-a0ca-270f5622b82f\") " pod="openshift-ingress/kube-auth-proxy-76f85576d5-5mjpz"
Jul 20 22:29:30.916885 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:30.916851    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdgbc\" (UniqueName: \"kubernetes.io/projected/1c8a573e-d601-4406-a0ca-270f5622b82f-kube-api-access-gdgbc\") pod \"kube-auth-proxy-76f85576d5-5mjpz\" (UID: \"1c8a573e-d601-4406-a0ca-270f5622b82f\") " pod="openshift-ingress/kube-auth-proxy-76f85576d5-5mjpz"
Jul 20 22:29:31.018303 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:31.018267    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c8a573e-d601-4406-a0ca-270f5622b82f-tmp\") pod \"kube-auth-proxy-76f85576d5-5mjpz\" (UID: \"1c8a573e-d601-4406-a0ca-270f5622b82f\") " pod="openshift-ingress/kube-auth-proxy-76f85576d5-5mjpz"
Jul 20 22:29:31.018303 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:31.018307    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdgbc\" (UniqueName: \"kubernetes.io/projected/1c8a573e-d601-4406-a0ca-270f5622b82f-kube-api-access-gdgbc\") pod \"kube-auth-proxy-76f85576d5-5mjpz\" (UID: \"1c8a573e-d601-4406-a0ca-270f5622b82f\") " pod="openshift-ingress/kube-auth-proxy-76f85576d5-5mjpz"
Jul 20 22:29:31.018670 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:31.018335    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c8a573e-d601-4406-a0ca-270f5622b82f-tls-certs\") pod \"kube-auth-proxy-76f85576d5-5mjpz\" (UID: \"1c8a573e-d601-4406-a0ca-270f5622b82f\") " pod="openshift-ingress/kube-auth-proxy-76f85576d5-5mjpz"
Jul 20 22:29:31.018670 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:29:31.018477    2556 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 20 22:29:31.018670 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:29:31.018555    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c8a573e-d601-4406-a0ca-270f5622b82f-tls-certs podName:1c8a573e-d601-4406-a0ca-270f5622b82f nodeName:}" failed. No retries permitted until 2026-07-20 22:29:31.518534723 +0000 UTC m=+384.816751273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1c8a573e-d601-4406-a0ca-270f5622b82f-tls-certs") pod "kube-auth-proxy-76f85576d5-5mjpz" (UID: "1c8a573e-d601-4406-a0ca-270f5622b82f") : secret "kube-auth-proxy-tls" not found
Jul 20 22:29:31.020516 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:31.020498    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c8a573e-d601-4406-a0ca-270f5622b82f-tmp\") pod \"kube-auth-proxy-76f85576d5-5mjpz\" (UID: \"1c8a573e-d601-4406-a0ca-270f5622b82f\") " pod="openshift-ingress/kube-auth-proxy-76f85576d5-5mjpz"
Jul 20 22:29:31.111051 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:31.110978    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdgbc\" (UniqueName: \"kubernetes.io/projected/1c8a573e-d601-4406-a0ca-270f5622b82f-kube-api-access-gdgbc\") pod \"kube-auth-proxy-76f85576d5-5mjpz\" (UID: \"1c8a573e-d601-4406-a0ca-270f5622b82f\") " pod="openshift-ingress/kube-auth-proxy-76f85576d5-5mjpz"
Jul 20 22:29:31.523190 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:31.523156    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c8a573e-d601-4406-a0ca-270f5622b82f-tls-certs\") pod \"kube-auth-proxy-76f85576d5-5mjpz\" (UID: \"1c8a573e-d601-4406-a0ca-270f5622b82f\") " pod="openshift-ingress/kube-auth-proxy-76f85576d5-5mjpz"
Jul 20 22:29:31.525529 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:31.525507    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c8a573e-d601-4406-a0ca-270f5622b82f-tls-certs\") pod \"kube-auth-proxy-76f85576d5-5mjpz\" (UID: \"1c8a573e-d601-4406-a0ca-270f5622b82f\") " pod="openshift-ingress/kube-auth-proxy-76f85576d5-5mjpz"
Jul 20 22:29:31.703756 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:31.703719    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-76f85576d5-5mjpz"
Jul 20 22:29:31.887824 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:29:31.887796    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c8a573e_d601_4406_a0ca_270f5622b82f.slice/crio-3740deb20288a2295b66541fcebad94bde4c47b1abe38de93f3ecaf69248ce22 WatchSource:0}: Error finding container 3740deb20288a2295b66541fcebad94bde4c47b1abe38de93f3ecaf69248ce22: Status 404 returned error can't find the container with id 3740deb20288a2295b66541fcebad94bde4c47b1abe38de93f3ecaf69248ce22
Jul 20 22:29:31.896574 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:31.896551    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-76f85576d5-5mjpz"]
Jul 20 22:29:32.099934 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:32.099855    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-76f85576d5-5mjpz" event={"ID":"1c8a573e-d601-4406-a0ca-270f5622b82f","Type":"ContainerStarted","Data":"3740deb20288a2295b66541fcebad94bde4c47b1abe38de93f3ecaf69248ce22"}
Jul 20 22:29:35.117059 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:35.116970    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-76f85576d5-5mjpz" event={"ID":"1c8a573e-d601-4406-a0ca-270f5622b82f","Type":"ContainerStarted","Data":"a6a26a0f371b614ac17988f25432a908bd5a7953ad9ce81458a7bd26c0bb9205"}
Jul 20 22:29:35.158694 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:35.158638    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-76f85576d5-5mjpz" podStartSLOduration=2.276363937 podStartE2EDuration="5.15862327s" totalImagesPullingTime="2.882259333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:29:35.157220991 +0000 UTC m=+388.455437561" watchObservedRunningTime="2026-07-20 22:29:35.15862327 +0000 UTC m=+388.456839831"
Jul 20 22:29:41.096686 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:29:41.096649    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7f85f98759-fzrk2"
Jul 20 22:31:00.984338 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:00.984309    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6dsg4"]
Jul 20 22:31:00.987511 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:00.987494    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6dsg4"
Jul 20 22:31:00.991234 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:00.991215    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 22:31:00.991379 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:00.991355    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pfcnt\""
Jul 20 22:31:00.991684 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:00.991671    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 22:31:01.009422 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:01.009394    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6dsg4"]
Jul 20 22:31:01.109044 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:01.109009    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fqrx\" (UniqueName: \"kubernetes.io/projected/c4594969-7e4c-4081-b5ea-4b727efbe8c2-kube-api-access-4fqrx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6dsg4\" (UID: \"c4594969-7e4c-4081-b5ea-4b727efbe8c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6dsg4"
Jul 20 22:31:01.109044 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:01.109047    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4594969-7e4c-4081-b5ea-4b727efbe8c2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6dsg4\" (UID: \"c4594969-7e4c-4081-b5ea-4b727efbe8c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6dsg4"
Jul 20 22:31:01.209982 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:01.209943    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fqrx\" (UniqueName: \"kubernetes.io/projected/c4594969-7e4c-4081-b5ea-4b727efbe8c2-kube-api-access-4fqrx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6dsg4\" (UID: \"c4594969-7e4c-4081-b5ea-4b727efbe8c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6dsg4"
Jul 20 22:31:01.209982 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:01.209987    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4594969-7e4c-4081-b5ea-4b727efbe8c2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6dsg4\" (UID: \"c4594969-7e4c-4081-b5ea-4b727efbe8c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6dsg4"
Jul 20 22:31:01.210374 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:01.210353    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4594969-7e4c-4081-b5ea-4b727efbe8c2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6dsg4\" (UID: \"c4594969-7e4c-4081-b5ea-4b727efbe8c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6dsg4"
Jul 20 22:31:01.228064 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:01.228032    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fqrx\" (UniqueName: \"kubernetes.io/projected/c4594969-7e4c-4081-b5ea-4b727efbe8c2-kube-api-access-4fqrx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6dsg4\" (UID: \"c4594969-7e4c-4081-b5ea-4b727efbe8c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6dsg4"
Jul 20 22:31:01.297579 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:01.297482    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6dsg4"
Jul 20 22:31:01.451551 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:01.451517    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6dsg4"]
Jul 20 22:31:01.459115 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:31:01.459080    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4594969_7e4c_4081_b5ea_4b727efbe8c2.slice/crio-147536a97061e8d9026ad168e88ed5db807a371f93ae4f334c3ca9088bafdfd6 WatchSource:0}: Error finding container 147536a97061e8d9026ad168e88ed5db807a371f93ae4f334c3ca9088bafdfd6: Status 404 returned error can't find the container with id 147536a97061e8d9026ad168e88ed5db807a371f93ae4f334c3ca9088bafdfd6
Jul 20 22:31:01.490503 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:01.490469    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6dsg4" event={"ID":"c4594969-7e4c-4081-b5ea-4b727efbe8c2","Type":"ContainerStarted","Data":"147536a97061e8d9026ad168e88ed5db807a371f93ae4f334c3ca9088bafdfd6"}
Jul 20 22:31:07.524262 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:07.524223    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6dsg4" event={"ID":"c4594969-7e4c-4081-b5ea-4b727efbe8c2","Type":"ContainerStarted","Data":"3a431a3a5b5487121ff534eebc3eb2eeedeca5a4a476fe53a5a9166fa06331fa"}
Jul 20 22:31:07.524647 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:07.524317    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6dsg4"
Jul 20 22:31:07.549882 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:07.549834    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6dsg4" podStartSLOduration=2.441937534 podStartE2EDuration="7.549816269s" totalImagesPullingTime="5.107878735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:31:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:31:07.548650199 +0000 UTC m=+480.846866770" watchObservedRunningTime="2026-07-20 22:31:07.549816269 +0000 UTC m=+480.848032838"
Jul 20 22:31:18.532705 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:18.532672    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6dsg4"
Jul 20 22:31:20.484419 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:20.484376    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6dsg4"]
Jul 20 22:31:20.484917 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:20.484594    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6dsg4" podUID="c4594969-7e4c-4081-b5ea-4b727efbe8c2" containerName="manager" containerID="cri-o://3a431a3a5b5487121ff534eebc3eb2eeedeca5a4a476fe53a5a9166fa06331fa" gracePeriod=2
Jul 20 22:31:20.501550 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:20.501519    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6dsg4"]
Jul 20 22:31:20.568696 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:20.568661    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987"]
Jul 20 22:31:20.569025 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:20.569010    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4594969-7e4c-4081-b5ea-4b727efbe8c2" containerName="manager"
Jul 20 22:31:20.569072 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:20.569028    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4594969-7e4c-4081-b5ea-4b727efbe8c2" containerName="manager"
Jul 20 22:31:20.569115 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:20.569084    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4594969-7e4c-4081-b5ea-4b727efbe8c2" containerName="manager"
Jul 20 22:31:20.572181 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:20.572159    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987"
Jul 20 22:31:20.577333 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:31:20.577298    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6dsg4\" is forbidden: User \"system:node:ip-10-0-133-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-74.ec2.internal' and this object" podUID="c4594969-7e4c-4081-b5ea-4b727efbe8c2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6dsg4"
Jul 20 22:31:20.595158 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:20.595130    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987"]
Jul 20 22:31:20.686231 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:20.686197    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91d120b5-fc7c-48e2-9872-92875550d2fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vn987\" (UID: \"91d120b5-fc7c-48e2-9872-92875550d2fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987"
Jul 20 22:31:20.686387 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:20.686248    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qng9l\" (UniqueName: \"kubernetes.io/projected/91d120b5-fc7c-48e2-9872-92875550d2fc-kube-api-access-qng9l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vn987\" (UID: \"91d120b5-fc7c-48e2-9872-92875550d2fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987"
Jul 20 22:31:20.735360 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:20.735290    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6dsg4"
Jul 20 22:31:20.737749 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:31:20.737713    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6dsg4\" is forbidden: User \"system:node:ip-10-0-133-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-74.ec2.internal' and this object" podUID="c4594969-7e4c-4081-b5ea-4b727efbe8c2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6dsg4"
Jul 20 22:31:20.787181 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:20.787142    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91d120b5-fc7c-48e2-9872-92875550d2fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vn987\" (UID: \"91d120b5-fc7c-48e2-9872-92875550d2fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987"
Jul 20 22:31:20.787181 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:20.787190    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qng9l\" (UniqueName: \"kubernetes.io/projected/91d120b5-fc7c-48e2-9872-92875550d2fc-kube-api-access-qng9l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vn987\" (UID: \"91d120b5-fc7c-48e2-9872-92875550d2fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987"
Jul 20 22:31:20.787548 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:20.787530    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91d120b5-fc7c-48e2-9872-92875550d2fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vn987\" (UID: \"91d120b5-fc7c-48e2-9872-92875550d2fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987"
Jul 20 22:31:20.796341 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:20.796314    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qng9l\" (UniqueName: \"kubernetes.io/projected/91d120b5-fc7c-48e2-9872-92875550d2fc-kube-api-access-qng9l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vn987\" (UID: \"91d120b5-fc7c-48e2-9872-92875550d2fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987"
Jul 20 22:31:20.882755 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:20.882715    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987"
Jul 20 22:31:20.887945 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:20.887921    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fqrx\" (UniqueName: \"kubernetes.io/projected/c4594969-7e4c-4081-b5ea-4b727efbe8c2-kube-api-access-4fqrx\") pod \"c4594969-7e4c-4081-b5ea-4b727efbe8c2\" (UID: \"c4594969-7e4c-4081-b5ea-4b727efbe8c2\") "
Jul 20 22:31:20.888020 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:20.887991    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4594969-7e4c-4081-b5ea-4b727efbe8c2-extensions-socket-volume\") pod \"c4594969-7e4c-4081-b5ea-4b727efbe8c2\" (UID: \"c4594969-7e4c-4081-b5ea-4b727efbe8c2\") "
Jul 20 22:31:20.888360 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:20.888334    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4594969-7e4c-4081-b5ea-4b727efbe8c2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c4594969-7e4c-4081-b5ea-4b727efbe8c2" (UID: "c4594969-7e4c-4081-b5ea-4b727efbe8c2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:31:20.890185 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:20.890163    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4594969-7e4c-4081-b5ea-4b727efbe8c2-kube-api-access-4fqrx" (OuterVolumeSpecName: "kube-api-access-4fqrx") pod "c4594969-7e4c-4081-b5ea-4b727efbe8c2" (UID: "c4594969-7e4c-4081-b5ea-4b727efbe8c2"). InnerVolumeSpecName "kube-api-access-4fqrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:31:20.989343 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:20.989255    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fqrx\" (UniqueName: \"kubernetes.io/projected/c4594969-7e4c-4081-b5ea-4b727efbe8c2-kube-api-access-4fqrx\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:31:20.989343 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:20.989283    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4594969-7e4c-4081-b5ea-4b727efbe8c2-extensions-socket-volume\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:31:21.030422 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:21.030391    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987"]
Jul 20 22:31:21.034053 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:31:21.034020    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91d120b5_fc7c_48e2_9872_92875550d2fc.slice/crio-7017039e6d1ec4f0e6c7c9ddb41fd21e46ea951a6245003f930d53ad099128bd WatchSource:0}: Error finding container 7017039e6d1ec4f0e6c7c9ddb41fd21e46ea951a6245003f930d53ad099128bd: Status 404 returned error can't find the container with id 7017039e6d1ec4f0e6c7c9ddb41fd21e46ea951a6245003f930d53ad099128bd
Jul 20 22:31:21.206575 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:21.206538    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4594969-7e4c-4081-b5ea-4b727efbe8c2" path="/var/lib/kubelet/pods/c4594969-7e4c-4081-b5ea-4b727efbe8c2/volumes"
Jul 20 22:31:21.589066 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:21.589025    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987" event={"ID":"91d120b5-fc7c-48e2-9872-92875550d2fc","Type":"ContainerStarted","Data":"39b1a5f57fd244c08de96fb5bf4c5c0c15039cd1bcebc7ce4a824b7241fe4a8e"}
Jul 20 22:31:21.589555 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:21.589132    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987" event={"ID":"91d120b5-fc7c-48e2-9872-92875550d2fc","Type":"ContainerStarted","Data":"7017039e6d1ec4f0e6c7c9ddb41fd21e46ea951a6245003f930d53ad099128bd"}
Jul 20 22:31:21.589555 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:21.589170    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987"
Jul 20 22:31:21.590452 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:21.590412    2556 generic.go:356] "Generic (PLEG): container finished" podID="c4594969-7e4c-4081-b5ea-4b727efbe8c2" containerID="3a431a3a5b5487121ff534eebc3eb2eeedeca5a4a476fe53a5a9166fa06331fa" exitCode=0
Jul 20 22:31:21.590582 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:21.590468    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6dsg4"
Jul 20 22:31:21.590582 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:21.590491    2556 scope.go:117] "RemoveContainer" containerID="3a431a3a5b5487121ff534eebc3eb2eeedeca5a4a476fe53a5a9166fa06331fa"
Jul 20 22:31:21.600490 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:21.600472    2556 scope.go:117] "RemoveContainer" containerID="3a431a3a5b5487121ff534eebc3eb2eeedeca5a4a476fe53a5a9166fa06331fa"
Jul 20 22:31:21.600872 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:31:21.600850    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a431a3a5b5487121ff534eebc3eb2eeedeca5a4a476fe53a5a9166fa06331fa\": container with ID starting with 3a431a3a5b5487121ff534eebc3eb2eeedeca5a4a476fe53a5a9166fa06331fa not found: ID does not exist" containerID="3a431a3a5b5487121ff534eebc3eb2eeedeca5a4a476fe53a5a9166fa06331fa"
Jul 20 22:31:21.600958 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:21.600884    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a431a3a5b5487121ff534eebc3eb2eeedeca5a4a476fe53a5a9166fa06331fa"} err="failed to get container status \"3a431a3a5b5487121ff534eebc3eb2eeedeca5a4a476fe53a5a9166fa06331fa\": rpc error: code = NotFound desc = could not find container \"3a431a3a5b5487121ff534eebc3eb2eeedeca5a4a476fe53a5a9166fa06331fa\": container with ID starting with 3a431a3a5b5487121ff534eebc3eb2eeedeca5a4a476fe53a5a9166fa06331fa not found: ID does not exist"
Jul 20 22:31:21.617691 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:21.617633    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987" podStartSLOduration=1.617594869 podStartE2EDuration="1.617594869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:31:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:31:21.615564426 +0000 UTC m=+494.913781006" watchObservedRunningTime="2026-07-20 22:31:21.617594869 +0000 UTC m=+494.915811439"
Jul 20 22:31:21.692963 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:21.692933    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n"]
Jul 20 22:31:21.697926 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:21.697904    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n"
Jul 20 22:31:21.715684 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:21.715656    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n"]
Jul 20 22:31:21.794956 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:21.794917    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttc9k\" (UniqueName: \"kubernetes.io/projected/42610eb7-aaa8-4282-80fa-913814bf78a4-kube-api-access-ttc9k\") pod \"kuadrant-operator-controller-manager-86878c769f-w7s8n\" (UID: \"42610eb7-aaa8-4282-80fa-913814bf78a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n"
Jul 20 22:31:21.795150 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:21.795050    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42610eb7-aaa8-4282-80fa-913814bf78a4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w7s8n\" (UID: \"42610eb7-aaa8-4282-80fa-913814bf78a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n"
Jul 20 22:31:21.896330 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:21.896242    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42610eb7-aaa8-4282-80fa-913814bf78a4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w7s8n\" (UID: \"42610eb7-aaa8-4282-80fa-913814bf78a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n"
Jul 20 22:31:21.896330 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:21.896298    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttc9k\" (UniqueName: \"kubernetes.io/projected/42610eb7-aaa8-4282-80fa-913814bf78a4-kube-api-access-ttc9k\") pod \"kuadrant-operator-controller-manager-86878c769f-w7s8n\" (UID: \"42610eb7-aaa8-4282-80fa-913814bf78a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n"
Jul 20 22:31:21.896661 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:21.896637    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42610eb7-aaa8-4282-80fa-913814bf78a4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w7s8n\" (UID: \"42610eb7-aaa8-4282-80fa-913814bf78a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n"
Jul 20 22:31:21.910110 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:21.910074    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttc9k\" (UniqueName: \"kubernetes.io/projected/42610eb7-aaa8-4282-80fa-913814bf78a4-kube-api-access-ttc9k\") pod \"kuadrant-operator-controller-manager-86878c769f-w7s8n\" (UID: \"42610eb7-aaa8-4282-80fa-913814bf78a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n"
Jul 20 22:31:22.008697 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:22.008657    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n"
Jul 20 22:31:22.175069 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:22.174692    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n"]
Jul 20 22:31:22.175444 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:31:22.175404    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42610eb7_aaa8_4282_80fa_913814bf78a4.slice/crio-727dc4781fe028084f13496264036fe2fe10447468a88fac0119d0dd138eea15 WatchSource:0}: Error finding container 727dc4781fe028084f13496264036fe2fe10447468a88fac0119d0dd138eea15: Status 404 returned error can't find the container with id 727dc4781fe028084f13496264036fe2fe10447468a88fac0119d0dd138eea15
Jul 20 22:31:22.600187 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:22.599358    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n" event={"ID":"42610eb7-aaa8-4282-80fa-913814bf78a4","Type":"ContainerStarted","Data":"d5b4aedebb4e99e7e043e1bf1105b9222334ae3dcc1d5fd156aac0ac16fa345f"}
Jul 20 22:31:22.600187 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:22.599426    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n"
Jul 20 22:31:22.600187 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:22.599451    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n" event={"ID":"42610eb7-aaa8-4282-80fa-913814bf78a4","Type":"ContainerStarted","Data":"727dc4781fe028084f13496264036fe2fe10447468a88fac0119d0dd138eea15"}
Jul 20 22:31:22.627930 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:22.627878    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n" podStartSLOduration=1.62786187 podStartE2EDuration="1.62786187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:31:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:31:22.627386447 +0000 UTC m=+495.925603022" watchObservedRunningTime="2026-07-20 22:31:22.62786187 +0000 UTC m=+495.926078439"
Jul 20 22:31:32.601504 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:32.601455    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987"
Jul 20 22:31:33.605895 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:33.605864    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n"
Jul 20 22:31:33.669797 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:33.669764    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987"]
Jul 20 22:31:33.670023 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:33.669999    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987" podUID="91d120b5-fc7c-48e2-9872-92875550d2fc" containerName="manager" containerID="cri-o://39b1a5f57fd244c08de96fb5bf4c5c0c15039cd1bcebc7ce4a824b7241fe4a8e" gracePeriod=10
Jul 20 22:31:33.938818 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:33.938795    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987"
Jul 20 22:31:34.007575 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:34.007534    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91d120b5-fc7c-48e2-9872-92875550d2fc-extensions-socket-volume\") pod \"91d120b5-fc7c-48e2-9872-92875550d2fc\" (UID: \"91d120b5-fc7c-48e2-9872-92875550d2fc\") "
Jul 20 22:31:34.007801 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:34.007602    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qng9l\" (UniqueName: \"kubernetes.io/projected/91d120b5-fc7c-48e2-9872-92875550d2fc-kube-api-access-qng9l\") pod \"91d120b5-fc7c-48e2-9872-92875550d2fc\" (UID: \"91d120b5-fc7c-48e2-9872-92875550d2fc\") "
Jul 20 22:31:34.008020 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:34.007996    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91d120b5-fc7c-48e2-9872-92875550d2fc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "91d120b5-fc7c-48e2-9872-92875550d2fc" (UID: "91d120b5-fc7c-48e2-9872-92875550d2fc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:31:34.009770 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:34.009748    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91d120b5-fc7c-48e2-9872-92875550d2fc-kube-api-access-qng9l" (OuterVolumeSpecName: "kube-api-access-qng9l") pod "91d120b5-fc7c-48e2-9872-92875550d2fc" (UID: "91d120b5-fc7c-48e2-9872-92875550d2fc"). InnerVolumeSpecName "kube-api-access-qng9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:31:34.108461 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:34.108423    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qng9l\" (UniqueName: \"kubernetes.io/projected/91d120b5-fc7c-48e2-9872-92875550d2fc-kube-api-access-qng9l\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:31:34.108461 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:34.108453    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91d120b5-fc7c-48e2-9872-92875550d2fc-extensions-socket-volume\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:31:34.657011 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:34.656976    2556 generic.go:356] "Generic (PLEG): container finished" podID="91d120b5-fc7c-48e2-9872-92875550d2fc" containerID="39b1a5f57fd244c08de96fb5bf4c5c0c15039cd1bcebc7ce4a824b7241fe4a8e" exitCode=0
Jul 20 22:31:34.657437 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:34.657026    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987"
Jul 20 22:31:34.657437 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:34.657039    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987" event={"ID":"91d120b5-fc7c-48e2-9872-92875550d2fc","Type":"ContainerDied","Data":"39b1a5f57fd244c08de96fb5bf4c5c0c15039cd1bcebc7ce4a824b7241fe4a8e"}
Jul 20 22:31:34.657437 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:34.657092    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987" event={"ID":"91d120b5-fc7c-48e2-9872-92875550d2fc","Type":"ContainerDied","Data":"7017039e6d1ec4f0e6c7c9ddb41fd21e46ea951a6245003f930d53ad099128bd"}
Jul 20 22:31:34.657437 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:34.657125    2556 scope.go:117] "RemoveContainer" containerID="39b1a5f57fd244c08de96fb5bf4c5c0c15039cd1bcebc7ce4a824b7241fe4a8e"
Jul 20 22:31:34.665779 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:34.665768    2556 scope.go:117] "RemoveContainer" containerID="39b1a5f57fd244c08de96fb5bf4c5c0c15039cd1bcebc7ce4a824b7241fe4a8e"
Jul 20 22:31:34.666007 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:31:34.665990    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39b1a5f57fd244c08de96fb5bf4c5c0c15039cd1bcebc7ce4a824b7241fe4a8e\": container with ID starting with 39b1a5f57fd244c08de96fb5bf4c5c0c15039cd1bcebc7ce4a824b7241fe4a8e not found: ID does not exist" containerID="39b1a5f57fd244c08de96fb5bf4c5c0c15039cd1bcebc7ce4a824b7241fe4a8e"
Jul 20 22:31:34.666055 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:34.666018    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39b1a5f57fd244c08de96fb5bf4c5c0c15039cd1bcebc7ce4a824b7241fe4a8e"} err="failed to get container status \"39b1a5f57fd244c08de96fb5bf4c5c0c15039cd1bcebc7ce4a824b7241fe4a8e\": rpc error: code = NotFound desc = could not find container \"39b1a5f57fd244c08de96fb5bf4c5c0c15039cd1bcebc7ce4a824b7241fe4a8e\": container with ID starting with 39b1a5f57fd244c08de96fb5bf4c5c0c15039cd1bcebc7ce4a824b7241fe4a8e not found: ID does not exist"
Jul 20 22:31:34.694389 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:34.694349    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987"]
Jul 20 22:31:34.706382 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:34.706349    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vn987"]
Jul 20 22:31:35.206499 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:35.206464    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91d120b5-fc7c-48e2-9872-92875550d2fc" path="/var/lib/kubelet/pods/91d120b5-fc7c-48e2-9872-92875550d2fc/volumes"
Jul 20 22:31:52.859920 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:52.859883    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-mk5cp"]
Jul 20 22:31:52.860508 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:52.860263    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91d120b5-fc7c-48e2-9872-92875550d2fc" containerName="manager"
Jul 20 22:31:52.860508 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:52.860277    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="91d120b5-fc7c-48e2-9872-92875550d2fc" containerName="manager"
Jul 20 22:31:52.860508 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:52.860334    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="91d120b5-fc7c-48e2-9872-92875550d2fc" containerName="manager"
Jul 20 22:31:52.864790 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:52.864770    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mk5cp"
Jul 20 22:31:52.868104 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:52.868084    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nkzw6\""
Jul 20 22:31:52.876163 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:52.876139    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mk5cp"]
Jul 20 22:31:52.962925 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:52.962891    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58dss\" (UniqueName: \"kubernetes.io/projected/09a10d04-70ca-4b5a-946f-b08fd7b3b1b4-kube-api-access-58dss\") pod \"authorino-58cd955675-mk5cp\" (UID: \"09a10d04-70ca-4b5a-946f-b08fd7b3b1b4\") " pod="kuadrant-system/authorino-58cd955675-mk5cp"
Jul 20 22:31:53.063669 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:53.063637    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58dss\" (UniqueName: \"kubernetes.io/projected/09a10d04-70ca-4b5a-946f-b08fd7b3b1b4-kube-api-access-58dss\") pod \"authorino-58cd955675-mk5cp\" (UID: \"09a10d04-70ca-4b5a-946f-b08fd7b3b1b4\") " pod="kuadrant-system/authorino-58cd955675-mk5cp"
Jul 20 22:31:53.074683 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:53.074656    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58dss\" (UniqueName: \"kubernetes.io/projected/09a10d04-70ca-4b5a-946f-b08fd7b3b1b4-kube-api-access-58dss\") pod \"authorino-58cd955675-mk5cp\" (UID: \"09a10d04-70ca-4b5a-946f-b08fd7b3b1b4\") " pod="kuadrant-system/authorino-58cd955675-mk5cp"
Jul 20 22:31:53.155409 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:53.155328    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-dxcqv"]
Jul 20 22:31:53.158665 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:53.158649    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dxcqv"
Jul 20 22:31:53.174135 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:53.174106    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mk5cp"
Jul 20 22:31:53.176055 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:53.176031    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dxcqv"]
Jul 20 22:31:53.265203 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:53.265172    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z86q\" (UniqueName: \"kubernetes.io/projected/a371506a-cc12-4b50-85d2-8e832eaa173c-kube-api-access-8z86q\") pod \"authorino-75d556bd77-dxcqv\" (UID: \"a371506a-cc12-4b50-85d2-8e832eaa173c\") " pod="kuadrant-system/authorino-75d556bd77-dxcqv"
Jul 20 22:31:53.312441 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:53.312413    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mk5cp"]
Jul 20 22:31:53.314471 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:31:53.314439    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09a10d04_70ca_4b5a_946f_b08fd7b3b1b4.slice/crio-a4d899f4e673f2274004895c828b7a6107de3d8c3ee08a6ab736be82e5653858 WatchSource:0}: Error finding container a4d899f4e673f2274004895c828b7a6107de3d8c3ee08a6ab736be82e5653858: Status 404 returned error can't find the container with id a4d899f4e673f2274004895c828b7a6107de3d8c3ee08a6ab736be82e5653858
Jul 20 22:31:53.366056 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:53.366013    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z86q\" (UniqueName: \"kubernetes.io/projected/a371506a-cc12-4b50-85d2-8e832eaa173c-kube-api-access-8z86q\") pod \"authorino-75d556bd77-dxcqv\" (UID: \"a371506a-cc12-4b50-85d2-8e832eaa173c\") " pod="kuadrant-system/authorino-75d556bd77-dxcqv"
Jul 20 22:31:53.378013 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:53.377979    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z86q\" (UniqueName: \"kubernetes.io/projected/a371506a-cc12-4b50-85d2-8e832eaa173c-kube-api-access-8z86q\") pod \"authorino-75d556bd77-dxcqv\" (UID: \"a371506a-cc12-4b50-85d2-8e832eaa173c\") " pod="kuadrant-system/authorino-75d556bd77-dxcqv"
Jul 20 22:31:53.467627 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:53.467580    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dxcqv"
Jul 20 22:31:53.598685 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:53.598658    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dxcqv"]
Jul 20 22:31:53.601135 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:31:53.601111    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda371506a_cc12_4b50_85d2_8e832eaa173c.slice/crio-773bb7449ec344093f555101a7455aa3664d2e785f130f72c8db1c31c06eb2b7 WatchSource:0}: Error finding container 773bb7449ec344093f555101a7455aa3664d2e785f130f72c8db1c31c06eb2b7: Status 404 returned error can't find the container with id 773bb7449ec344093f555101a7455aa3664d2e785f130f72c8db1c31c06eb2b7
Jul 20 22:31:53.747055 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:53.746961    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mk5cp" event={"ID":"09a10d04-70ca-4b5a-946f-b08fd7b3b1b4","Type":"ContainerStarted","Data":"a4d899f4e673f2274004895c828b7a6107de3d8c3ee08a6ab736be82e5653858"}
Jul 20 22:31:53.748061 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:53.748035    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dxcqv" event={"ID":"a371506a-cc12-4b50-85d2-8e832eaa173c","Type":"ContainerStarted","Data":"773bb7449ec344093f555101a7455aa3664d2e785f130f72c8db1c31c06eb2b7"}
Jul 20 22:31:57.774356 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:57.774318    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mk5cp" event={"ID":"09a10d04-70ca-4b5a-946f-b08fd7b3b1b4","Type":"ContainerStarted","Data":"ff448737a774e3cb92761d166e5d4e838b694b1a32a38819415c92622a40b566"}
Jul 20 22:31:57.775861 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:57.775835    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dxcqv" event={"ID":"a371506a-cc12-4b50-85d2-8e832eaa173c","Type":"ContainerStarted","Data":"b29d6bc2707090d460ddb97549652a89801c8cac31ced5364fffd4815c03cafd"}
Jul 20 22:31:57.794033 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:57.793979    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-mk5cp" podStartSLOduration=2.359970083 podStartE2EDuration="5.793964616s" totalImagesPullingTime="3.433994533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:31:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:31:57.791469871 +0000 UTC m=+531.089686440" watchObservedRunningTime="2026-07-20 22:31:57.793964616 +0000 UTC m=+531.092181185"
Jul 20 22:31:57.809417 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:57.809360    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-dxcqv" podStartSLOduration=1.65042527 podStartE2EDuration="4.809339949s" totalImagesPullingTime="3.158914679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:31:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:31:57.808175837 +0000 UTC m=+531.106392444" watchObservedRunningTime="2026-07-20 22:31:57.809339949 +0000 UTC m=+531.107556535"
Jul 20 22:31:57.841598 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:57.841565    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mk5cp"]
Jul 20 22:31:59.785303 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:31:59.785227    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-mk5cp" podUID="09a10d04-70ca-4b5a-946f-b08fd7b3b1b4" containerName="authorino" containerID="cri-o://ff448737a774e3cb92761d166e5d4e838b694b1a32a38819415c92622a40b566" gracePeriod=30
Jul 20 22:32:00.039579 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:00.039515    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mk5cp"
Jul 20 22:32:00.129440 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:00.129402    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58dss\" (UniqueName: \"kubernetes.io/projected/09a10d04-70ca-4b5a-946f-b08fd7b3b1b4-kube-api-access-58dss\") pod \"09a10d04-70ca-4b5a-946f-b08fd7b3b1b4\" (UID: \"09a10d04-70ca-4b5a-946f-b08fd7b3b1b4\") "
Jul 20 22:32:00.131487 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:00.131455    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09a10d04-70ca-4b5a-946f-b08fd7b3b1b4-kube-api-access-58dss" (OuterVolumeSpecName: "kube-api-access-58dss") pod "09a10d04-70ca-4b5a-946f-b08fd7b3b1b4" (UID: "09a10d04-70ca-4b5a-946f-b08fd7b3b1b4"). InnerVolumeSpecName "kube-api-access-58dss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:32:00.230473 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:00.230437    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58dss\" (UniqueName: \"kubernetes.io/projected/09a10d04-70ca-4b5a-946f-b08fd7b3b1b4-kube-api-access-58dss\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:32:00.790597 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:00.790565    2556 generic.go:356] "Generic (PLEG): container finished" podID="09a10d04-70ca-4b5a-946f-b08fd7b3b1b4" containerID="ff448737a774e3cb92761d166e5d4e838b694b1a32a38819415c92622a40b566" exitCode=0
Jul 20 22:32:00.791009 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:00.790624    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mk5cp"
Jul 20 22:32:00.791009 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:00.790663    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mk5cp" event={"ID":"09a10d04-70ca-4b5a-946f-b08fd7b3b1b4","Type":"ContainerDied","Data":"ff448737a774e3cb92761d166e5d4e838b694b1a32a38819415c92622a40b566"}
Jul 20 22:32:00.791009 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:00.790711    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mk5cp" event={"ID":"09a10d04-70ca-4b5a-946f-b08fd7b3b1b4","Type":"ContainerDied","Data":"a4d899f4e673f2274004895c828b7a6107de3d8c3ee08a6ab736be82e5653858"}
Jul 20 22:32:00.791009 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:00.790730    2556 scope.go:117] "RemoveContainer" containerID="ff448737a774e3cb92761d166e5d4e838b694b1a32a38819415c92622a40b566"
Jul 20 22:32:00.799397 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:00.799379    2556 scope.go:117] "RemoveContainer" containerID="ff448737a774e3cb92761d166e5d4e838b694b1a32a38819415c92622a40b566"
Jul 20 22:32:00.799696 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:32:00.799677    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff448737a774e3cb92761d166e5d4e838b694b1a32a38819415c92622a40b566\": container with ID starting with ff448737a774e3cb92761d166e5d4e838b694b1a32a38819415c92622a40b566 not found: ID does not exist" containerID="ff448737a774e3cb92761d166e5d4e838b694b1a32a38819415c92622a40b566"
Jul 20 22:32:00.799752 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:00.799708    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff448737a774e3cb92761d166e5d4e838b694b1a32a38819415c92622a40b566"} err="failed to get container status \"ff448737a774e3cb92761d166e5d4e838b694b1a32a38819415c92622a40b566\": rpc error: code = NotFound desc = could not find container \"ff448737a774e3cb92761d166e5d4e838b694b1a32a38819415c92622a40b566\": container with ID starting with ff448737a774e3cb92761d166e5d4e838b694b1a32a38819415c92622a40b566 not found: ID does not exist"
Jul 20 22:32:00.815986 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:00.815960    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mk5cp"]
Jul 20 22:32:00.819686 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:00.819666    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-mk5cp"]
Jul 20 22:32:01.211753 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:01.211720    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09a10d04-70ca-4b5a-946f-b08fd7b3b1b4" path="/var/lib/kubelet/pods/09a10d04-70ca-4b5a-946f-b08fd7b3b1b4/volumes"
Jul 20 22:32:26.499589 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.499557    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hn5bs"]
Jul 20 22:32:26.500056 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.499928    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09a10d04-70ca-4b5a-946f-b08fd7b3b1b4" containerName="authorino"
Jul 20 22:32:26.500056 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.499940    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="09a10d04-70ca-4b5a-946f-b08fd7b3b1b4" containerName="authorino"
Jul 20 22:32:26.500056 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.500008    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="09a10d04-70ca-4b5a-946f-b08fd7b3b1b4" containerName="authorino"
Jul 20 22:32:26.503867 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.503850    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hn5bs"
Jul 20 22:32:26.511124 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.510867    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hn5bs"]
Jul 20 22:32:26.569797 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.569764    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjdzz\" (UniqueName: \"kubernetes.io/projected/475c1555-6673-4a00-abd8-f04ea95d843f-kube-api-access-wjdzz\") pod \"authorino-5d4b67c446-hn5bs\" (UID: \"475c1555-6673-4a00-abd8-f04ea95d843f\") " pod="kuadrant-system/authorino-5d4b67c446-hn5bs"
Jul 20 22:32:26.671118 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.671089    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjdzz\" (UniqueName: \"kubernetes.io/projected/475c1555-6673-4a00-abd8-f04ea95d843f-kube-api-access-wjdzz\") pod \"authorino-5d4b67c446-hn5bs\" (UID: \"475c1555-6673-4a00-abd8-f04ea95d843f\") " pod="kuadrant-system/authorino-5d4b67c446-hn5bs"
Jul 20 22:32:26.679399 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.679370    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjdzz\" (UniqueName: \"kubernetes.io/projected/475c1555-6673-4a00-abd8-f04ea95d843f-kube-api-access-wjdzz\") pod \"authorino-5d4b67c446-hn5bs\" (UID: \"475c1555-6673-4a00-abd8-f04ea95d843f\") " pod="kuadrant-system/authorino-5d4b67c446-hn5bs"
Jul 20 22:32:26.729100 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.729063    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hn5bs"]
Jul 20 22:32:26.729351 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.729337    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hn5bs"
Jul 20 22:32:26.758231 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.758163    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-79cd745dd9-j2v7v"]
Jul 20 22:32:26.760922 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.760905    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79cd745dd9-j2v7v"
Jul 20 22:32:26.769427 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.769401    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79cd745dd9-j2v7v"]
Jul 20 22:32:26.771798 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.771665    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2vc7\" (UniqueName: \"kubernetes.io/projected/4d768ae2-88e4-46f1-8d49-13debdbdc760-kube-api-access-q2vc7\") pod \"authorino-79cd745dd9-j2v7v\" (UID: \"4d768ae2-88e4-46f1-8d49-13debdbdc760\") " pod="kuadrant-system/authorino-79cd745dd9-j2v7v"
Jul 20 22:32:26.862649 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.862597    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hn5bs"]
Jul 20 22:32:26.865440 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:32:26.865407    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod475c1555_6673_4a00_abd8_f04ea95d843f.slice/crio-c42126e2577edfd30aa1d44080349e86d0649453ab01b074f42e57249f6080cc WatchSource:0}: Error finding container c42126e2577edfd30aa1d44080349e86d0649453ab01b074f42e57249f6080cc: Status 404 returned error can't find the container with id c42126e2577edfd30aa1d44080349e86d0649453ab01b074f42e57249f6080cc
Jul 20 22:32:26.872643 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.872620    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2vc7\" (UniqueName: \"kubernetes.io/projected/4d768ae2-88e4-46f1-8d49-13debdbdc760-kube-api-access-q2vc7\") pod \"authorino-79cd745dd9-j2v7v\" (UID: \"4d768ae2-88e4-46f1-8d49-13debdbdc760\") " pod="kuadrant-system/authorino-79cd745dd9-j2v7v"
Jul 20 22:32:26.880258 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.880238    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2vc7\" (UniqueName: \"kubernetes.io/projected/4d768ae2-88e4-46f1-8d49-13debdbdc760-kube-api-access-q2vc7\") pod \"authorino-79cd745dd9-j2v7v\" (UID: \"4d768ae2-88e4-46f1-8d49-13debdbdc760\") " pod="kuadrant-system/authorino-79cd745dd9-j2v7v"
Jul 20 22:32:26.910119 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.910085    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hn5bs" event={"ID":"475c1555-6673-4a00-abd8-f04ea95d843f","Type":"ContainerStarted","Data":"c42126e2577edfd30aa1d44080349e86d0649453ab01b074f42e57249f6080cc"}
Jul 20 22:32:26.945501 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.945462    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-79cd745dd9-j2v7v"]
Jul 20 22:32:26.946151 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.946137    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79cd745dd9-j2v7v"
Jul 20 22:32:26.976061 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.976018    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-ffbd57b9c-9wbkp"]
Jul 20 22:32:26.979018 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.978998    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ffbd57b9c-9wbkp"
Jul 20 22:32:26.981521 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.981499    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 20 22:32:26.990682 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:26.990658    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-ffbd57b9c-9wbkp"]
Jul 20 22:32:27.074296 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:27.074264    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvxxs\" (UniqueName: \"kubernetes.io/projected/aadb9091-2a3b-454f-8a7b-556ad894f615-kube-api-access-lvxxs\") pod \"authorino-ffbd57b9c-9wbkp\" (UID: \"aadb9091-2a3b-454f-8a7b-556ad894f615\") " pod="kuadrant-system/authorino-ffbd57b9c-9wbkp"
Jul 20 22:32:27.074296 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:27.074297    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aadb9091-2a3b-454f-8a7b-556ad894f615-tls-cert\") pod \"authorino-ffbd57b9c-9wbkp\" (UID: \"aadb9091-2a3b-454f-8a7b-556ad894f615\") " pod="kuadrant-system/authorino-ffbd57b9c-9wbkp"
Jul 20 22:32:27.083802 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:27.083781    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-79cd745dd9-j2v7v"]
Jul 20 22:32:27.086214 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:32:27.086190    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d768ae2_88e4_46f1_8d49_13debdbdc760.slice/crio-4eb0b5de8249e4b84e1cbc30e65e0ac4926380f35e360bd4cf12d2d35f2e055b WatchSource:0}: Error finding container 4eb0b5de8249e4b84e1cbc30e65e0ac4926380f35e360bd4cf12d2d35f2e055b: Status 404 returned error can't find the container with id 4eb0b5de8249e4b84e1cbc30e65e0ac4926380f35e360bd4cf12d2d35f2e055b
Jul 20 22:32:27.175690 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:27.175652    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvxxs\" (UniqueName: \"kubernetes.io/projected/aadb9091-2a3b-454f-8a7b-556ad894f615-kube-api-access-lvxxs\") pod \"authorino-ffbd57b9c-9wbkp\" (UID: \"aadb9091-2a3b-454f-8a7b-556ad894f615\") " pod="kuadrant-system/authorino-ffbd57b9c-9wbkp"
Jul 20 22:32:27.175690 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:27.175690    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aadb9091-2a3b-454f-8a7b-556ad894f615-tls-cert\") pod \"authorino-ffbd57b9c-9wbkp\" (UID: \"aadb9091-2a3b-454f-8a7b-556ad894f615\") " pod="kuadrant-system/authorino-ffbd57b9c-9wbkp"
Jul 20 22:32:27.178482 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:27.178455    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aadb9091-2a3b-454f-8a7b-556ad894f615-tls-cert\") pod \"authorino-ffbd57b9c-9wbkp\" (UID: \"aadb9091-2a3b-454f-8a7b-556ad894f615\") " pod="kuadrant-system/authorino-ffbd57b9c-9wbkp"
Jul 20 22:32:27.183890 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:27.183866    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvxxs\" (UniqueName: \"kubernetes.io/projected/aadb9091-2a3b-454f-8a7b-556ad894f615-kube-api-access-lvxxs\") pod \"authorino-ffbd57b9c-9wbkp\" (UID: \"aadb9091-2a3b-454f-8a7b-556ad894f615\") " pod="kuadrant-system/authorino-ffbd57b9c-9wbkp"
Jul 20 22:32:27.289935 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:27.289905    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ffbd57b9c-9wbkp"
Jul 20 22:32:27.439867 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:27.439842    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-ffbd57b9c-9wbkp"]
Jul 20 22:32:27.441563 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:32:27.441534    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaadb9091_2a3b_454f_8a7b_556ad894f615.slice/crio-c2bfaf30bed54e9468fe9527ff426970e036c8385bef07845803d359bb4f36a4 WatchSource:0}: Error finding container c2bfaf30bed54e9468fe9527ff426970e036c8385bef07845803d359bb4f36a4: Status 404 returned error can't find the container with id c2bfaf30bed54e9468fe9527ff426970e036c8385bef07845803d359bb4f36a4
Jul 20 22:32:27.916688 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:27.916649    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ffbd57b9c-9wbkp" event={"ID":"aadb9091-2a3b-454f-8a7b-556ad894f615","Type":"ContainerStarted","Data":"69b20b540785f335cc3960817af9c35a4b777965936f505604b4731e3be01f19"}
Jul 20 22:32:27.917165 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:27.916700    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ffbd57b9c-9wbkp" event={"ID":"aadb9091-2a3b-454f-8a7b-556ad894f615","Type":"ContainerStarted","Data":"c2bfaf30bed54e9468fe9527ff426970e036c8385bef07845803d359bb4f36a4"}
Jul 20 22:32:27.918422 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:27.918394    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79cd745dd9-j2v7v" event={"ID":"4d768ae2-88e4-46f1-8d49-13debdbdc760","Type":"ContainerStarted","Data":"db747cac70a6c7c4713d87ff325716858a50e2a34604afd16ac5d084dc019793"}
Jul 20 22:32:27.918546 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:27.918412    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-79cd745dd9-j2v7v" podUID="4d768ae2-88e4-46f1-8d49-13debdbdc760" containerName="authorino" containerID="cri-o://db747cac70a6c7c4713d87ff325716858a50e2a34604afd16ac5d084dc019793" gracePeriod=30
Jul 20 22:32:27.918546 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:27.918433    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79cd745dd9-j2v7v" event={"ID":"4d768ae2-88e4-46f1-8d49-13debdbdc760","Type":"ContainerStarted","Data":"4eb0b5de8249e4b84e1cbc30e65e0ac4926380f35e360bd4cf12d2d35f2e055b"}
Jul 20 22:32:27.920273 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:27.920246    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hn5bs" event={"ID":"475c1555-6673-4a00-abd8-f04ea95d843f","Type":"ContainerStarted","Data":"bec8b1f4573197cfa9a257062f1421691dba5427e93fd606f7d4e613ea35fa0e"}
Jul 20 22:32:27.920381 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:27.920324    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-hn5bs" podUID="475c1555-6673-4a00-abd8-f04ea95d843f" containerName="authorino" containerID="cri-o://bec8b1f4573197cfa9a257062f1421691dba5427e93fd606f7d4e613ea35fa0e" gracePeriod=30
Jul 20 22:32:27.957640 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:27.957558    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-ffbd57b9c-9wbkp" podStartSLOduration=1.6081668690000002 podStartE2EDuration="1.957541285s" totalImagesPullingTime="349.374416ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:32:27.939874025 +0000 UTC m=+561.238090596" watchObservedRunningTime="2026-07-20 22:32:27.957541285 +0000 UTC m=+561.255757884"
Jul 20 22:32:27.959039 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:27.959004    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-hn5bs" podStartSLOduration=1.584479846 podStartE2EDuration="1.958990433s" totalImagesPullingTime="374.510587ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:32:27.957274184 +0000 UTC m=+561.255490754" watchObservedRunningTime="2026-07-20 22:32:27.958990433 +0000 UTC m=+561.257207048"
Jul 20 22:32:27.976041 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:27.976011    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dxcqv"]
Jul 20 22:32:27.976263 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:27.976236    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-dxcqv" podUID="a371506a-cc12-4b50-85d2-8e832eaa173c" containerName="authorino" containerID="cri-o://b29d6bc2707090d460ddb97549652a89801c8cac31ced5364fffd4815c03cafd" gracePeriod=30
Jul 20 22:32:27.984251 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:27.984200    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-79cd745dd9-j2v7v" podStartSLOduration=1.6977014129999999 podStartE2EDuration="1.984179752s" totalImagesPullingTime="286.478339ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:32:27.983646693 +0000 UTC m=+561.281863261" watchObservedRunningTime="2026-07-20 22:32:27.984179752 +0000 UTC m=+561.282396325"
Jul 20 22:32:28.243362 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.243341    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hn5bs"
Jul 20 22:32:28.247450 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.247419    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79cd745dd9-j2v7v"
Jul 20 22:32:28.255428 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.255411    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dxcqv"
Jul 20 22:32:28.285249 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.285218    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjdzz\" (UniqueName: \"kubernetes.io/projected/475c1555-6673-4a00-abd8-f04ea95d843f-kube-api-access-wjdzz\") pod \"475c1555-6673-4a00-abd8-f04ea95d843f\" (UID: \"475c1555-6673-4a00-abd8-f04ea95d843f\") "
Jul 20 22:32:28.285398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.285271    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2vc7\" (UniqueName: \"kubernetes.io/projected/4d768ae2-88e4-46f1-8d49-13debdbdc760-kube-api-access-q2vc7\") pod \"4d768ae2-88e4-46f1-8d49-13debdbdc760\" (UID: \"4d768ae2-88e4-46f1-8d49-13debdbdc760\") "
Jul 20 22:32:28.285398 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.285296    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8z86q\" (UniqueName: \"kubernetes.io/projected/a371506a-cc12-4b50-85d2-8e832eaa173c-kube-api-access-8z86q\") pod \"a371506a-cc12-4b50-85d2-8e832eaa173c\" (UID: \"a371506a-cc12-4b50-85d2-8e832eaa173c\") "
Jul 20 22:32:28.287431 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.287400    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d768ae2-88e4-46f1-8d49-13debdbdc760-kube-api-access-q2vc7" (OuterVolumeSpecName: "kube-api-access-q2vc7") pod "4d768ae2-88e4-46f1-8d49-13debdbdc760" (UID: "4d768ae2-88e4-46f1-8d49-13debdbdc760"). InnerVolumeSpecName "kube-api-access-q2vc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:32:28.287585 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.287464    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a371506a-cc12-4b50-85d2-8e832eaa173c-kube-api-access-8z86q" (OuterVolumeSpecName: "kube-api-access-8z86q") pod "a371506a-cc12-4b50-85d2-8e832eaa173c" (UID: "a371506a-cc12-4b50-85d2-8e832eaa173c"). InnerVolumeSpecName "kube-api-access-8z86q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:32:28.287585 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.287472    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/475c1555-6673-4a00-abd8-f04ea95d843f-kube-api-access-wjdzz" (OuterVolumeSpecName: "kube-api-access-wjdzz") pod "475c1555-6673-4a00-abd8-f04ea95d843f" (UID: "475c1555-6673-4a00-abd8-f04ea95d843f"). InnerVolumeSpecName "kube-api-access-wjdzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:32:28.386144 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.386061    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2vc7\" (UniqueName: \"kubernetes.io/projected/4d768ae2-88e4-46f1-8d49-13debdbdc760-kube-api-access-q2vc7\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:32:28.386144 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.386087    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8z86q\" (UniqueName: \"kubernetes.io/projected/a371506a-cc12-4b50-85d2-8e832eaa173c-kube-api-access-8z86q\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:32:28.386144 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.386101    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjdzz\" (UniqueName: \"kubernetes.io/projected/475c1555-6673-4a00-abd8-f04ea95d843f-kube-api-access-wjdzz\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:32:28.929752 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.929724    2556 generic.go:356] "Generic (PLEG): container finished" podID="4d768ae2-88e4-46f1-8d49-13debdbdc760" containerID="db747cac70a6c7c4713d87ff325716858a50e2a34604afd16ac5d084dc019793" exitCode=0
Jul 20 22:32:28.930179 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.929765    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79cd745dd9-j2v7v"
Jul 20 22:32:28.930179 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.929798    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79cd745dd9-j2v7v" event={"ID":"4d768ae2-88e4-46f1-8d49-13debdbdc760","Type":"ContainerDied","Data":"db747cac70a6c7c4713d87ff325716858a50e2a34604afd16ac5d084dc019793"}
Jul 20 22:32:28.930179 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.929836    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79cd745dd9-j2v7v" event={"ID":"4d768ae2-88e4-46f1-8d49-13debdbdc760","Type":"ContainerDied","Data":"4eb0b5de8249e4b84e1cbc30e65e0ac4926380f35e360bd4cf12d2d35f2e055b"}
Jul 20 22:32:28.930179 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.929854    2556 scope.go:117] "RemoveContainer" containerID="db747cac70a6c7c4713d87ff325716858a50e2a34604afd16ac5d084dc019793"
Jul 20 22:32:28.931125 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.931101    2556 generic.go:356] "Generic (PLEG): container finished" podID="a371506a-cc12-4b50-85d2-8e832eaa173c" containerID="b29d6bc2707090d460ddb97549652a89801c8cac31ced5364fffd4815c03cafd" exitCode=0
Jul 20 22:32:28.931198 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.931141    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dxcqv"
Jul 20 22:32:28.931244 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.931190    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dxcqv" event={"ID":"a371506a-cc12-4b50-85d2-8e832eaa173c","Type":"ContainerDied","Data":"b29d6bc2707090d460ddb97549652a89801c8cac31ced5364fffd4815c03cafd"}
Jul 20 22:32:28.931244 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.931229    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dxcqv" event={"ID":"a371506a-cc12-4b50-85d2-8e832eaa173c","Type":"ContainerDied","Data":"773bb7449ec344093f555101a7455aa3664d2e785f130f72c8db1c31c06eb2b7"}
Jul 20 22:32:28.932510 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.932484    2556 generic.go:356] "Generic (PLEG): container finished" podID="475c1555-6673-4a00-abd8-f04ea95d843f" containerID="bec8b1f4573197cfa9a257062f1421691dba5427e93fd606f7d4e613ea35fa0e" exitCode=0
Jul 20 22:32:28.932646 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.932525    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hn5bs"
Jul 20 22:32:28.932646 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.932565    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hn5bs" event={"ID":"475c1555-6673-4a00-abd8-f04ea95d843f","Type":"ContainerDied","Data":"bec8b1f4573197cfa9a257062f1421691dba5427e93fd606f7d4e613ea35fa0e"}
Jul 20 22:32:28.932646 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.932622    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hn5bs" event={"ID":"475c1555-6673-4a00-abd8-f04ea95d843f","Type":"ContainerDied","Data":"c42126e2577edfd30aa1d44080349e86d0649453ab01b074f42e57249f6080cc"}
Jul 20 22:32:28.939020 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.938795    2556 scope.go:117] "RemoveContainer" containerID="db747cac70a6c7c4713d87ff325716858a50e2a34604afd16ac5d084dc019793"
Jul 20 22:32:28.939819 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:32:28.939793    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db747cac70a6c7c4713d87ff325716858a50e2a34604afd16ac5d084dc019793\": container with ID starting with db747cac70a6c7c4713d87ff325716858a50e2a34604afd16ac5d084dc019793 not found: ID does not exist" containerID="db747cac70a6c7c4713d87ff325716858a50e2a34604afd16ac5d084dc019793"
Jul 20 22:32:28.939992 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.939941    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db747cac70a6c7c4713d87ff325716858a50e2a34604afd16ac5d084dc019793"} err="failed to get container status \"db747cac70a6c7c4713d87ff325716858a50e2a34604afd16ac5d084dc019793\": rpc error: code = NotFound desc = could not find container \"db747cac70a6c7c4713d87ff325716858a50e2a34604afd16ac5d084dc019793\": container with ID starting with db747cac70a6c7c4713d87ff325716858a50e2a34604afd16ac5d084dc019793 not found: ID does not exist"
Jul 20 22:32:28.939992 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.939993    2556 scope.go:117] "RemoveContainer" containerID="b29d6bc2707090d460ddb97549652a89801c8cac31ced5364fffd4815c03cafd"
Jul 20 22:32:28.948671 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.948650    2556 scope.go:117] "RemoveContainer" containerID="b29d6bc2707090d460ddb97549652a89801c8cac31ced5364fffd4815c03cafd"
Jul 20 22:32:28.948976 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:32:28.948951    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b29d6bc2707090d460ddb97549652a89801c8cac31ced5364fffd4815c03cafd\": container with ID starting with b29d6bc2707090d460ddb97549652a89801c8cac31ced5364fffd4815c03cafd not found: ID does not exist" containerID="b29d6bc2707090d460ddb97549652a89801c8cac31ced5364fffd4815c03cafd"
Jul 20 22:32:28.949061 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.948985    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b29d6bc2707090d460ddb97549652a89801c8cac31ced5364fffd4815c03cafd"} err="failed to get container status \"b29d6bc2707090d460ddb97549652a89801c8cac31ced5364fffd4815c03cafd\": rpc error: code = NotFound desc = could not find container \"b29d6bc2707090d460ddb97549652a89801c8cac31ced5364fffd4815c03cafd\": container with ID starting with b29d6bc2707090d460ddb97549652a89801c8cac31ced5364fffd4815c03cafd not found: ID does not exist"
Jul 20 22:32:28.949061 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.949007    2556 scope.go:117] "RemoveContainer" containerID="bec8b1f4573197cfa9a257062f1421691dba5427e93fd606f7d4e613ea35fa0e"
Jul 20 22:32:28.955099 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.955076    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-79cd745dd9-j2v7v"]
Jul 20 22:32:28.958056 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.958037    2556 scope.go:117] "RemoveContainer" containerID="bec8b1f4573197cfa9a257062f1421691dba5427e93fd606f7d4e613ea35fa0e"
Jul 20 22:32:28.958356 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:32:28.958337    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bec8b1f4573197cfa9a257062f1421691dba5427e93fd606f7d4e613ea35fa0e\": container with ID starting with bec8b1f4573197cfa9a257062f1421691dba5427e93fd606f7d4e613ea35fa0e not found: ID does not exist" containerID="bec8b1f4573197cfa9a257062f1421691dba5427e93fd606f7d4e613ea35fa0e"
Jul 20 22:32:28.958401 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.958366    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bec8b1f4573197cfa9a257062f1421691dba5427e93fd606f7d4e613ea35fa0e"} err="failed to get container status \"bec8b1f4573197cfa9a257062f1421691dba5427e93fd606f7d4e613ea35fa0e\": rpc error: code = NotFound desc = could not find container \"bec8b1f4573197cfa9a257062f1421691dba5427e93fd606f7d4e613ea35fa0e\": container with ID starting with bec8b1f4573197cfa9a257062f1421691dba5427e93fd606f7d4e613ea35fa0e not found: ID does not exist"
Jul 20 22:32:28.958687 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.958670    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-79cd745dd9-j2v7v"]
Jul 20 22:32:28.969486 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.969460    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dxcqv"]
Jul 20 22:32:28.974361 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.974332    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dxcqv"]
Jul 20 22:32:28.985063 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.985038    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hn5bs"]
Jul 20 22:32:28.989105 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:28.989086    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hn5bs"]
Jul 20 22:32:29.206535 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:29.206462    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="475c1555-6673-4a00-abd8-f04ea95d843f" path="/var/lib/kubelet/pods/475c1555-6673-4a00-abd8-f04ea95d843f/volumes"
Jul 20 22:32:29.206808 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:29.206795    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d768ae2-88e4-46f1-8d49-13debdbdc760" path="/var/lib/kubelet/pods/4d768ae2-88e4-46f1-8d49-13debdbdc760/volumes"
Jul 20 22:32:29.207072 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:32:29.207061    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a371506a-cc12-4b50-85d2-8e832eaa173c" path="/var/lib/kubelet/pods/a371506a-cc12-4b50-85d2-8e832eaa173c/volumes"
Jul 20 22:33:06.040680 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.040644    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6b8fbcb956-ng7pl"]
Jul 20 22:33:06.041159 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.040994    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a371506a-cc12-4b50-85d2-8e832eaa173c" containerName="authorino"
Jul 20 22:33:06.041159 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.041004    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a371506a-cc12-4b50-85d2-8e832eaa173c" containerName="authorino"
Jul 20 22:33:06.041159 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.041023    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d768ae2-88e4-46f1-8d49-13debdbdc760" containerName="authorino"
Jul 20 22:33:06.041159 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.041028    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d768ae2-88e4-46f1-8d49-13debdbdc760" containerName="authorino"
Jul 20 22:33:06.041159 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.041038    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="475c1555-6673-4a00-abd8-f04ea95d843f" containerName="authorino"
Jul 20 22:33:06.041159 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.041044    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="475c1555-6673-4a00-abd8-f04ea95d843f" containerName="authorino"
Jul 20 22:33:06.041159 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.041104    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="475c1555-6673-4a00-abd8-f04ea95d843f" containerName="authorino"
Jul 20 22:33:06.041159 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.041110    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d768ae2-88e4-46f1-8d49-13debdbdc760" containerName="authorino"
Jul 20 22:33:06.041159 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.041117    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a371506a-cc12-4b50-85d2-8e832eaa173c" containerName="authorino"
Jul 20 22:33:06.043113 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.043097    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b8fbcb956-ng7pl"
Jul 20 22:33:06.047310 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.047286    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 22:33:06.047446 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.047314    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 20 22:33:06.047736 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.047720    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-t8h7m\""
Jul 20 22:33:06.047800 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.047771    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 22:33:06.055600 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.055575    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b8fbcb956-ng7pl"]
Jul 20 22:33:06.225101 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.225064    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5bf95ac-7fbd-4724-a752-1dcdd5a9280f-maas-api-tls\") pod \"maas-api-6b8fbcb956-ng7pl\" (UID: \"b5bf95ac-7fbd-4724-a752-1dcdd5a9280f\") " pod="odh-ai-gateway-infra/maas-api-6b8fbcb956-ng7pl"
Jul 20 22:33:06.225264 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.225109    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gg7w\" (UniqueName: \"kubernetes.io/projected/b5bf95ac-7fbd-4724-a752-1dcdd5a9280f-kube-api-access-7gg7w\") pod \"maas-api-6b8fbcb956-ng7pl\" (UID: \"b5bf95ac-7fbd-4724-a752-1dcdd5a9280f\") " pod="odh-ai-gateway-infra/maas-api-6b8fbcb956-ng7pl"
Jul 20 22:33:06.225264 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.225230    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5bf95ac-7fbd-4724-a752-1dcdd5a9280f-openshift-service-ca\") pod \"maas-api-6b8fbcb956-ng7pl\" (UID: \"b5bf95ac-7fbd-4724-a752-1dcdd5a9280f\") " pod="odh-ai-gateway-infra/maas-api-6b8fbcb956-ng7pl"
Jul 20 22:33:06.325954 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.325857    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5bf95ac-7fbd-4724-a752-1dcdd5a9280f-maas-api-tls\") pod \"maas-api-6b8fbcb956-ng7pl\" (UID: \"b5bf95ac-7fbd-4724-a752-1dcdd5a9280f\") " pod="odh-ai-gateway-infra/maas-api-6b8fbcb956-ng7pl"
Jul 20 22:33:06.325954 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.325912    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gg7w\" (UniqueName: \"kubernetes.io/projected/b5bf95ac-7fbd-4724-a752-1dcdd5a9280f-kube-api-access-7gg7w\") pod \"maas-api-6b8fbcb956-ng7pl\" (UID: \"b5bf95ac-7fbd-4724-a752-1dcdd5a9280f\") " pod="odh-ai-gateway-infra/maas-api-6b8fbcb956-ng7pl"
Jul 20 22:33:06.326185 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.326000    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5bf95ac-7fbd-4724-a752-1dcdd5a9280f-openshift-service-ca\") pod \"maas-api-6b8fbcb956-ng7pl\" (UID: \"b5bf95ac-7fbd-4724-a752-1dcdd5a9280f\") " pod="odh-ai-gateway-infra/maas-api-6b8fbcb956-ng7pl"
Jul 20 22:33:06.326626 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.326588    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5bf95ac-7fbd-4724-a752-1dcdd5a9280f-openshift-service-ca\") pod \"maas-api-6b8fbcb956-ng7pl\" (UID: \"b5bf95ac-7fbd-4724-a752-1dcdd5a9280f\") " pod="odh-ai-gateway-infra/maas-api-6b8fbcb956-ng7pl"
Jul 20 22:33:06.328249 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.328221    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5bf95ac-7fbd-4724-a752-1dcdd5a9280f-maas-api-tls\") pod \"maas-api-6b8fbcb956-ng7pl\" (UID: \"b5bf95ac-7fbd-4724-a752-1dcdd5a9280f\") " pod="odh-ai-gateway-infra/maas-api-6b8fbcb956-ng7pl"
Jul 20 22:33:06.334809 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.334787    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gg7w\" (UniqueName: \"kubernetes.io/projected/b5bf95ac-7fbd-4724-a752-1dcdd5a9280f-kube-api-access-7gg7w\") pod \"maas-api-6b8fbcb956-ng7pl\" (UID: \"b5bf95ac-7fbd-4724-a752-1dcdd5a9280f\") " pod="odh-ai-gateway-infra/maas-api-6b8fbcb956-ng7pl"
Jul 20 22:33:06.353740 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.353715    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b8fbcb956-ng7pl"
Jul 20 22:33:06.494822 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:06.494798    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b8fbcb956-ng7pl"]
Jul 20 22:33:06.497886 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:33:06.497858    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5bf95ac_7fbd_4724_a752_1dcdd5a9280f.slice/crio-8dc2d952f8134273c1c639fff4623bce714c3676ee409b541f7e1627c7f2e58e WatchSource:0}: Error finding container 8dc2d952f8134273c1c639fff4623bce714c3676ee409b541f7e1627c7f2e58e: Status 404 returned error can't find the container with id 8dc2d952f8134273c1c639fff4623bce714c3676ee409b541f7e1627c7f2e58e
Jul 20 22:33:07.121114 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:07.121079    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b8fbcb956-ng7pl" event={"ID":"b5bf95ac-7fbd-4724-a752-1dcdd5a9280f","Type":"ContainerStarted","Data":"8dc2d952f8134273c1c639fff4623bce714c3676ee409b541f7e1627c7f2e58e"}
Jul 20 22:33:09.133026 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:09.132933    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b8fbcb956-ng7pl" event={"ID":"b5bf95ac-7fbd-4724-a752-1dcdd5a9280f","Type":"ContainerStarted","Data":"6e6db368a62cd73c56abc85ba5d3baf79cd3867e81ff402b181fe4f1d03ec290"}
Jul 20 22:33:09.133417 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:09.133032    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6b8fbcb956-ng7pl"
Jul 20 22:33:09.150049 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:09.149997    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6b8fbcb956-ng7pl" podStartSLOduration=0.863762229 podStartE2EDuration="3.149982328s" totalImagesPullingTime="2.286220099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:33:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:33:09.14805197 +0000 UTC m=+602.446268540" watchObservedRunningTime="2026-07-20 22:33:09.149982328 +0000 UTC m=+602.448198897"
Jul 20 22:33:15.143319 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:15.143293    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6b8fbcb956-ng7pl"
Jul 20 22:33:31.592462 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.592387    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"]
Jul 20 22:33:31.595784 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.595764    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:33:31.599066 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.599040    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 20 22:33:31.599066 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.599065    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z682z\""
Jul 20 22:33:31.599247 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.599091    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 20 22:33:31.599247 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.599172    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 20 22:33:31.608197 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.608174    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"]
Jul 20 22:33:31.654815 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.654782    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftnw8\" (UniqueName: \"kubernetes.io/projected/66f7bff1-0f18-44b4-8b58-a5423d78a926-kube-api-access-ftnw8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v7vfv\" (UID: \"66f7bff1-0f18-44b4-8b58-a5423d78a926\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:33:31.654993 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.654831    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66f7bff1-0f18-44b4-8b58-a5423d78a926-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v7vfv\" (UID: \"66f7bff1-0f18-44b4-8b58-a5423d78a926\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:33:31.654993 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.654876    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66f7bff1-0f18-44b4-8b58-a5423d78a926-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v7vfv\" (UID: \"66f7bff1-0f18-44b4-8b58-a5423d78a926\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:33:31.654993 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.654890    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66f7bff1-0f18-44b4-8b58-a5423d78a926-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v7vfv\" (UID: \"66f7bff1-0f18-44b4-8b58-a5423d78a926\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:33:31.654993 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.654916    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66f7bff1-0f18-44b4-8b58-a5423d78a926-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v7vfv\" (UID: \"66f7bff1-0f18-44b4-8b58-a5423d78a926\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:33:31.655142 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.655000    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66f7bff1-0f18-44b4-8b58-a5423d78a926-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v7vfv\" (UID: \"66f7bff1-0f18-44b4-8b58-a5423d78a926\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:33:31.756106 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.756073    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66f7bff1-0f18-44b4-8b58-a5423d78a926-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v7vfv\" (UID: \"66f7bff1-0f18-44b4-8b58-a5423d78a926\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:33:31.756283 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.756111    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66f7bff1-0f18-44b4-8b58-a5423d78a926-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v7vfv\" (UID: \"66f7bff1-0f18-44b4-8b58-a5423d78a926\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:33:31.756283 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.756147    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66f7bff1-0f18-44b4-8b58-a5423d78a926-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v7vfv\" (UID: \"66f7bff1-0f18-44b4-8b58-a5423d78a926\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:33:31.756283 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.756186    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66f7bff1-0f18-44b4-8b58-a5423d78a926-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v7vfv\" (UID: \"66f7bff1-0f18-44b4-8b58-a5423d78a926\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:33:31.756283 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.756257    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftnw8\" (UniqueName: \"kubernetes.io/projected/66f7bff1-0f18-44b4-8b58-a5423d78a926-kube-api-access-ftnw8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v7vfv\" (UID: \"66f7bff1-0f18-44b4-8b58-a5423d78a926\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:33:31.756476 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.756303    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66f7bff1-0f18-44b4-8b58-a5423d78a926-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v7vfv\" (UID: \"66f7bff1-0f18-44b4-8b58-a5423d78a926\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:33:31.756579 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.756553    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66f7bff1-0f18-44b4-8b58-a5423d78a926-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v7vfv\" (UID: \"66f7bff1-0f18-44b4-8b58-a5423d78a926\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:33:31.756668 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.756562    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66f7bff1-0f18-44b4-8b58-a5423d78a926-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v7vfv\" (UID: \"66f7bff1-0f18-44b4-8b58-a5423d78a926\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:33:31.756668 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.756651    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66f7bff1-0f18-44b4-8b58-a5423d78a926-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v7vfv\" (UID: \"66f7bff1-0f18-44b4-8b58-a5423d78a926\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:33:31.758535 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.758513    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66f7bff1-0f18-44b4-8b58-a5423d78a926-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v7vfv\" (UID: \"66f7bff1-0f18-44b4-8b58-a5423d78a926\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:33:31.758928 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.758908    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66f7bff1-0f18-44b4-8b58-a5423d78a926-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v7vfv\" (UID: \"66f7bff1-0f18-44b4-8b58-a5423d78a926\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:33:31.765749 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.765726    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftnw8\" (UniqueName: \"kubernetes.io/projected/66f7bff1-0f18-44b4-8b58-a5423d78a926-kube-api-access-ftnw8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v7vfv\" (UID: \"66f7bff1-0f18-44b4-8b58-a5423d78a926\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:33:31.906260 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:31.906167    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:33:32.041224 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:32.041181    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"]
Jul 20 22:33:32.045789 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:33:32.045753    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f7bff1_0f18_44b4_8b58_a5423d78a926.slice/crio-2ca1814325804ab81e827f1140e837bed2581d3097fd96c922642693b9c0e423 WatchSource:0}: Error finding container 2ca1814325804ab81e827f1140e837bed2581d3097fd96c922642693b9c0e423: Status 404 returned error can't find the container with id 2ca1814325804ab81e827f1140e837bed2581d3097fd96c922642693b9c0e423
Jul 20 22:33:32.047101 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:32.047082    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 22:33:32.243839 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:32.243793    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv" event={"ID":"66f7bff1-0f18-44b4-8b58-a5423d78a926","Type":"ContainerStarted","Data":"2ca1814325804ab81e827f1140e837bed2581d3097fd96c922642693b9c0e423"}
Jul 20 22:33:33.250968 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:33.250932    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv" event={"ID":"66f7bff1-0f18-44b4-8b58-a5423d78a926","Type":"ContainerStarted","Data":"665355751c9e645133abcf4f78bd4dfe750e885889456cbd4453503a701a7955"}
Jul 20 22:33:41.907170 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:41.907134    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:33:41.907754 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:41.907211    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:33:41.919870 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:41.919847    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:33:41.940287 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:41.940219    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv" podStartSLOduration=9.860027846 podStartE2EDuration="10.940200919s" totalImagesPullingTime="1.080173073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:33:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:33:33.292021901 +0000 UTC m=+626.590238471" watchObservedRunningTime="2026-07-20 22:33:41.940200919 +0000 UTC m=+635.238417488"
Jul 20 22:33:42.303111 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:33:42.303085    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v7vfv"
Jul 20 22:34:07.010062 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.010032    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"]
Jul 20 22:34:07.013475 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.013458    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:07.015870 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.015846    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 20 22:34:07.031346 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.031317    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"]
Jul 20 22:34:07.058976 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.058948    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc458428-5e77-4a8f-b356-4a2626d24013-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk\" (UID: \"fc458428-5e77-4a8f-b356-4a2626d24013\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:07.058976 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.058981    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc458428-5e77-4a8f-b356-4a2626d24013-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk\" (UID: \"fc458428-5e77-4a8f-b356-4a2626d24013\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:07.059170 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.059004    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc458428-5e77-4a8f-b356-4a2626d24013-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk\" (UID: \"fc458428-5e77-4a8f-b356-4a2626d24013\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:07.059170 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.059091    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc458428-5e77-4a8f-b356-4a2626d24013-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk\" (UID: \"fc458428-5e77-4a8f-b356-4a2626d24013\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:07.059170 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.059128    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9hcr\" (UniqueName: \"kubernetes.io/projected/fc458428-5e77-4a8f-b356-4a2626d24013-kube-api-access-m9hcr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk\" (UID: \"fc458428-5e77-4a8f-b356-4a2626d24013\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:07.059274 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.059212    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc458428-5e77-4a8f-b356-4a2626d24013-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk\" (UID: \"fc458428-5e77-4a8f-b356-4a2626d24013\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:07.160558 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.160519    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc458428-5e77-4a8f-b356-4a2626d24013-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk\" (UID: \"fc458428-5e77-4a8f-b356-4a2626d24013\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:07.160558 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.160568    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9hcr\" (UniqueName: \"kubernetes.io/projected/fc458428-5e77-4a8f-b356-4a2626d24013-kube-api-access-m9hcr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk\" (UID: \"fc458428-5e77-4a8f-b356-4a2626d24013\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:07.160846 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.160655    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc458428-5e77-4a8f-b356-4a2626d24013-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk\" (UID: \"fc458428-5e77-4a8f-b356-4a2626d24013\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:07.160846 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.160677    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc458428-5e77-4a8f-b356-4a2626d24013-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk\" (UID: \"fc458428-5e77-4a8f-b356-4a2626d24013\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:07.160846 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.160696    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc458428-5e77-4a8f-b356-4a2626d24013-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk\" (UID: \"fc458428-5e77-4a8f-b356-4a2626d24013\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:07.160846 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.160715    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc458428-5e77-4a8f-b356-4a2626d24013-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk\" (UID: \"fc458428-5e77-4a8f-b356-4a2626d24013\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:07.161052 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.161024    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc458428-5e77-4a8f-b356-4a2626d24013-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk\" (UID: \"fc458428-5e77-4a8f-b356-4a2626d24013\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:07.161093 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.161070    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc458428-5e77-4a8f-b356-4a2626d24013-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk\" (UID: \"fc458428-5e77-4a8f-b356-4a2626d24013\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:07.161127 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.161107    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc458428-5e77-4a8f-b356-4a2626d24013-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk\" (UID: \"fc458428-5e77-4a8f-b356-4a2626d24013\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:07.162841 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.162818    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc458428-5e77-4a8f-b356-4a2626d24013-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk\" (UID: \"fc458428-5e77-4a8f-b356-4a2626d24013\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:07.163084 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.163068    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc458428-5e77-4a8f-b356-4a2626d24013-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk\" (UID: \"fc458428-5e77-4a8f-b356-4a2626d24013\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:07.170252 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.170222    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9hcr\" (UniqueName: \"kubernetes.io/projected/fc458428-5e77-4a8f-b356-4a2626d24013-kube-api-access-m9hcr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk\" (UID: \"fc458428-5e77-4a8f-b356-4a2626d24013\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:07.323958 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.323868    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:07.457393 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:07.457364    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"]
Jul 20 22:34:07.460297 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:34:07.460269    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc458428_5e77_4a8f_b356_4a2626d24013.slice/crio-da327ad5f9810b10c4490134ea547e5a0dfe4c3630f6ea2a6bf6f64ed7e6a59d WatchSource:0}: Error finding container da327ad5f9810b10c4490134ea547e5a0dfe4c3630f6ea2a6bf6f64ed7e6a59d: Status 404 returned error can't find the container with id da327ad5f9810b10c4490134ea547e5a0dfe4c3630f6ea2a6bf6f64ed7e6a59d
Jul 20 22:34:08.421234 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:08.421197    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk" event={"ID":"fc458428-5e77-4a8f-b356-4a2626d24013","Type":"ContainerStarted","Data":"1381fcfe757866d2acfb9568303a89b05b47aa385281e852333af6fd6e3ff6a8"}
Jul 20 22:34:08.421638 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:08.421258    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk" event={"ID":"fc458428-5e77-4a8f-b356-4a2626d24013","Type":"ContainerStarted","Data":"da327ad5f9810b10c4490134ea547e5a0dfe4c3630f6ea2a6bf6f64ed7e6a59d"}
Jul 20 22:34:08.444279 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:08.444225    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk" podStartSLOduration=2.288686738 podStartE2EDuration="2.444208495s" totalImagesPullingTime="155.521757ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:34:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:34:08.442548056 +0000 UTC m=+661.740764627" watchObservedRunningTime="2026-07-20 22:34:08.444208495 +0000 UTC m=+661.742425065"
Jul 20 22:34:17.324765 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:17.324727    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:17.325278 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:17.324796    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:17.337580 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:17.337553    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:17.477275 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:17.477245    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk"
Jul 20 22:34:25.599250 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:25.599210    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"]
Jul 20 22:34:25.602276 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:25.602255    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:34:25.604748 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:25.604729    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 20 22:34:25.616034 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:25.616014    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"]
Jul 20 22:34:25.741454 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:25.741422    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88ce2853-b431-4e52-a42e-d2ebc87a1c2a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f\" (UID: \"88ce2853-b431-4e52-a42e-d2ebc87a1c2a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:34:25.741662 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:25.741465    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88ce2853-b431-4e52-a42e-d2ebc87a1c2a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f\" (UID: \"88ce2853-b431-4e52-a42e-d2ebc87a1c2a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:34:25.741662 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:25.741488    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88ce2853-b431-4e52-a42e-d2ebc87a1c2a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f\" (UID: \"88ce2853-b431-4e52-a42e-d2ebc87a1c2a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:34:25.741662 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:25.741600    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88ce2853-b431-4e52-a42e-d2ebc87a1c2a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f\" (UID: \"88ce2853-b431-4e52-a42e-d2ebc87a1c2a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:34:25.741801 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:25.741661    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn25x\" (UniqueName: \"kubernetes.io/projected/88ce2853-b431-4e52-a42e-d2ebc87a1c2a-kube-api-access-mn25x\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f\" (UID: \"88ce2853-b431-4e52-a42e-d2ebc87a1c2a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:34:25.741801 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:25.741721    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88ce2853-b431-4e52-a42e-d2ebc87a1c2a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f\" (UID: \"88ce2853-b431-4e52-a42e-d2ebc87a1c2a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:34:25.842992 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:25.842960    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88ce2853-b431-4e52-a42e-d2ebc87a1c2a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f\" (UID: \"88ce2853-b431-4e52-a42e-d2ebc87a1c2a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:34:25.843162 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:25.843003    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn25x\" (UniqueName: \"kubernetes.io/projected/88ce2853-b431-4e52-a42e-d2ebc87a1c2a-kube-api-access-mn25x\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f\" (UID: \"88ce2853-b431-4e52-a42e-d2ebc87a1c2a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:34:25.843162 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:25.843031    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88ce2853-b431-4e52-a42e-d2ebc87a1c2a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f\" (UID: \"88ce2853-b431-4e52-a42e-d2ebc87a1c2a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:34:25.843162 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:25.843052    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88ce2853-b431-4e52-a42e-d2ebc87a1c2a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f\" (UID: \"88ce2853-b431-4e52-a42e-d2ebc87a1c2a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:34:25.843162 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:25.843078    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88ce2853-b431-4e52-a42e-d2ebc87a1c2a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f\" (UID: \"88ce2853-b431-4e52-a42e-d2ebc87a1c2a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:34:25.843162 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:25.843096    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88ce2853-b431-4e52-a42e-d2ebc87a1c2a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f\" (UID: \"88ce2853-b431-4e52-a42e-d2ebc87a1c2a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:34:25.843484 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:25.843456    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88ce2853-b431-4e52-a42e-d2ebc87a1c2a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f\" (UID: \"88ce2853-b431-4e52-a42e-d2ebc87a1c2a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:34:25.843484 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:25.843477    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88ce2853-b431-4e52-a42e-d2ebc87a1c2a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f\" (UID: \"88ce2853-b431-4e52-a42e-d2ebc87a1c2a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:34:25.843576 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:25.843535    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88ce2853-b431-4e52-a42e-d2ebc87a1c2a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f\" (UID: \"88ce2853-b431-4e52-a42e-d2ebc87a1c2a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:34:25.845141 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:25.845120    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88ce2853-b431-4e52-a42e-d2ebc87a1c2a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f\" (UID: \"88ce2853-b431-4e52-a42e-d2ebc87a1c2a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:34:25.845559 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:25.845545    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88ce2853-b431-4e52-a42e-d2ebc87a1c2a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f\" (UID: \"88ce2853-b431-4e52-a42e-d2ebc87a1c2a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:34:25.852650 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:25.852578    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn25x\" (UniqueName: \"kubernetes.io/projected/88ce2853-b431-4e52-a42e-d2ebc87a1c2a-kube-api-access-mn25x\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f\" (UID: \"88ce2853-b431-4e52-a42e-d2ebc87a1c2a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:34:25.915718 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:25.915678    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:34:26.051264 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:26.051236    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"]
Jul 20 22:34:26.053015 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:34:26.052989    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88ce2853_b431_4e52_a42e_d2ebc87a1c2a.slice/crio-f344c5b15572cccbf04609be6807ecd711632ed3771eda24ca0e33c76a703680 WatchSource:0}: Error finding container f344c5b15572cccbf04609be6807ecd711632ed3771eda24ca0e33c76a703680: Status 404 returned error can't find the container with id f344c5b15572cccbf04609be6807ecd711632ed3771eda24ca0e33c76a703680
Jul 20 22:34:26.519148 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:26.519056    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f" event={"ID":"88ce2853-b431-4e52-a42e-d2ebc87a1c2a","Type":"ContainerStarted","Data":"1bbe4244f458cb1a21905ece74e585085df7a1506acb5498c135062208a1a9e1"}
Jul 20 22:34:26.519148 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:26.519099    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f" event={"ID":"88ce2853-b431-4e52-a42e-d2ebc87a1c2a","Type":"ContainerStarted","Data":"f344c5b15572cccbf04609be6807ecd711632ed3771eda24ca0e33c76a703680"}
Jul 20 22:34:26.546676 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:26.546589    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f" podStartSLOduration=1.391436667 podStartE2EDuration="1.546571341s" totalImagesPullingTime="155.134674ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:34:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:34:26.543035967 +0000 UTC m=+679.841252536" watchObservedRunningTime="2026-07-20 22:34:26.546571341 +0000 UTC m=+679.844787911"
Jul 20 22:34:35.915890 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:35.915856    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:34:35.916269 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:35.915906    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:34:35.928547 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:35.928523    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:34:36.580931 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:34:36.580902    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f"
Jul 20 22:35:37.920671 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:37.920637    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d5978c6dd-7snxp"]
Jul 20 22:35:37.924059 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:37.924040    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d5978c6dd-7snxp"
Jul 20 22:35:37.935443 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:37.935418    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d5978c6dd-7snxp"]
Jul 20 22:35:38.117833 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:38.117783    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qslsm\" (UniqueName: \"kubernetes.io/projected/b4e4792e-a668-49a6-ace9-941219d7f881-kube-api-access-qslsm\") pod \"authorino-6d5978c6dd-7snxp\" (UID: \"b4e4792e-a668-49a6-ace9-941219d7f881\") " pod="kuadrant-system/authorino-6d5978c6dd-7snxp"
Jul 20 22:35:38.118045 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:38.117904    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b4e4792e-a668-49a6-ace9-941219d7f881-tls-cert\") pod \"authorino-6d5978c6dd-7snxp\" (UID: \"b4e4792e-a668-49a6-ace9-941219d7f881\") " pod="kuadrant-system/authorino-6d5978c6dd-7snxp"
Jul 20 22:35:38.219235 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:38.219199    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b4e4792e-a668-49a6-ace9-941219d7f881-tls-cert\") pod \"authorino-6d5978c6dd-7snxp\" (UID: \"b4e4792e-a668-49a6-ace9-941219d7f881\") " pod="kuadrant-system/authorino-6d5978c6dd-7snxp"
Jul 20 22:35:38.219425 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:38.219305    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qslsm\" (UniqueName: \"kubernetes.io/projected/b4e4792e-a668-49a6-ace9-941219d7f881-kube-api-access-qslsm\") pod \"authorino-6d5978c6dd-7snxp\" (UID: \"b4e4792e-a668-49a6-ace9-941219d7f881\") " pod="kuadrant-system/authorino-6d5978c6dd-7snxp"
Jul 20 22:35:38.221848 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:38.221827    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b4e4792e-a668-49a6-ace9-941219d7f881-tls-cert\") pod \"authorino-6d5978c6dd-7snxp\" (UID: \"b4e4792e-a668-49a6-ace9-941219d7f881\") " pod="kuadrant-system/authorino-6d5978c6dd-7snxp"
Jul 20 22:35:38.229830 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:38.229805    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qslsm\" (UniqueName: \"kubernetes.io/projected/b4e4792e-a668-49a6-ace9-941219d7f881-kube-api-access-qslsm\") pod \"authorino-6d5978c6dd-7snxp\" (UID: \"b4e4792e-a668-49a6-ace9-941219d7f881\") " pod="kuadrant-system/authorino-6d5978c6dd-7snxp"
Jul 20 22:35:38.232533 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:38.232507    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d5978c6dd-7snxp"
Jul 20 22:35:38.372907 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:38.372880    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d5978c6dd-7snxp"]
Jul 20 22:35:38.375578 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:35:38.375549    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4e4792e_a668_49a6_ace9_941219d7f881.slice/crio-1812e33a9b94ad538fab3732204933afdb51d2518ed6239ea60d53458f3579d9 WatchSource:0}: Error finding container 1812e33a9b94ad538fab3732204933afdb51d2518ed6239ea60d53458f3579d9: Status 404 returned error can't find the container with id 1812e33a9b94ad538fab3732204933afdb51d2518ed6239ea60d53458f3579d9
Jul 20 22:35:38.868740 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:38.868700    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d5978c6dd-7snxp" event={"ID":"b4e4792e-a668-49a6-ace9-941219d7f881","Type":"ContainerStarted","Data":"1812e33a9b94ad538fab3732204933afdb51d2518ed6239ea60d53458f3579d9"}
Jul 20 22:35:39.877748 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:39.877708    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d5978c6dd-7snxp" event={"ID":"b4e4792e-a668-49a6-ace9-941219d7f881","Type":"ContainerStarted","Data":"9b8a6ea986c0925422e30817d27ab2de1a84d88ab983d7bdc9e64a58f8e15c49"}
Jul 20 22:35:39.904879 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:39.904816    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6d5978c6dd-7snxp" podStartSLOduration=2.448489956 podStartE2EDuration="2.904793072s" totalImagesPullingTime="456.303116ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:35:39.901785844 +0000 UTC m=+753.200002412" watchObservedRunningTime="2026-07-20 22:35:39.904793072 +0000 UTC m=+753.203009645"
Jul 20 22:35:39.955873 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:39.955835    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-ffbd57b9c-9wbkp"]
Jul 20 22:35:39.956098 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:39.956071    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-ffbd57b9c-9wbkp" podUID="aadb9091-2a3b-454f-8a7b-556ad894f615" containerName="authorino" containerID="cri-o://69b20b540785f335cc3960817af9c35a4b777965936f505604b4731e3be01f19" gracePeriod=30
Jul 20 22:35:40.231602 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:40.231571    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ffbd57b9c-9wbkp"
Jul 20 22:35:40.339572 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:40.339532    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvxxs\" (UniqueName: \"kubernetes.io/projected/aadb9091-2a3b-454f-8a7b-556ad894f615-kube-api-access-lvxxs\") pod \"aadb9091-2a3b-454f-8a7b-556ad894f615\" (UID: \"aadb9091-2a3b-454f-8a7b-556ad894f615\") "
Jul 20 22:35:40.339770 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:40.339579    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aadb9091-2a3b-454f-8a7b-556ad894f615-tls-cert\") pod \"aadb9091-2a3b-454f-8a7b-556ad894f615\" (UID: \"aadb9091-2a3b-454f-8a7b-556ad894f615\") "
Jul 20 22:35:40.341709 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:40.341678    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aadb9091-2a3b-454f-8a7b-556ad894f615-kube-api-access-lvxxs" (OuterVolumeSpecName: "kube-api-access-lvxxs") pod "aadb9091-2a3b-454f-8a7b-556ad894f615" (UID: "aadb9091-2a3b-454f-8a7b-556ad894f615"). InnerVolumeSpecName "kube-api-access-lvxxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:35:40.350664 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:40.350633    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aadb9091-2a3b-454f-8a7b-556ad894f615-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "aadb9091-2a3b-454f-8a7b-556ad894f615" (UID: "aadb9091-2a3b-454f-8a7b-556ad894f615"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:35:40.440885 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:40.440843    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvxxs\" (UniqueName: \"kubernetes.io/projected/aadb9091-2a3b-454f-8a7b-556ad894f615-kube-api-access-lvxxs\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:35:40.440885 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:40.440883    2556 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aadb9091-2a3b-454f-8a7b-556ad894f615-tls-cert\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:35:40.883502 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:40.883463    2556 generic.go:356] "Generic (PLEG): container finished" podID="aadb9091-2a3b-454f-8a7b-556ad894f615" containerID="69b20b540785f335cc3960817af9c35a4b777965936f505604b4731e3be01f19" exitCode=0
Jul 20 22:35:40.883969 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:40.883528    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ffbd57b9c-9wbkp"
Jul 20 22:35:40.883969 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:40.883548    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ffbd57b9c-9wbkp" event={"ID":"aadb9091-2a3b-454f-8a7b-556ad894f615","Type":"ContainerDied","Data":"69b20b540785f335cc3960817af9c35a4b777965936f505604b4731e3be01f19"}
Jul 20 22:35:40.883969 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:40.883591    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ffbd57b9c-9wbkp" event={"ID":"aadb9091-2a3b-454f-8a7b-556ad894f615","Type":"ContainerDied","Data":"c2bfaf30bed54e9468fe9527ff426970e036c8385bef07845803d359bb4f36a4"}
Jul 20 22:35:40.883969 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:40.883622    2556 scope.go:117] "RemoveContainer" containerID="69b20b540785f335cc3960817af9c35a4b777965936f505604b4731e3be01f19"
Jul 20 22:35:40.893450 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:40.893427    2556 scope.go:117] "RemoveContainer" containerID="69b20b540785f335cc3960817af9c35a4b777965936f505604b4731e3be01f19"
Jul 20 22:35:40.893856 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:35:40.893836    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69b20b540785f335cc3960817af9c35a4b777965936f505604b4731e3be01f19\": container with ID starting with 69b20b540785f335cc3960817af9c35a4b777965936f505604b4731e3be01f19 not found: ID does not exist" containerID="69b20b540785f335cc3960817af9c35a4b777965936f505604b4731e3be01f19"
Jul 20 22:35:40.893940 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:40.893869    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69b20b540785f335cc3960817af9c35a4b777965936f505604b4731e3be01f19"} err="failed to get container status \"69b20b540785f335cc3960817af9c35a4b777965936f505604b4731e3be01f19\": rpc error: code = NotFound desc = could not find container \"69b20b540785f335cc3960817af9c35a4b777965936f505604b4731e3be01f19\": container with ID starting with 69b20b540785f335cc3960817af9c35a4b777965936f505604b4731e3be01f19 not found: ID does not exist"
Jul 20 22:35:40.910128 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:40.910095    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-ffbd57b9c-9wbkp"]
Jul 20 22:35:40.911886 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:40.911844    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-ffbd57b9c-9wbkp"]
Jul 20 22:35:41.207895 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:35:41.207863    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aadb9091-2a3b-454f-8a7b-556ad894f615" path="/var/lib/kubelet/pods/aadb9091-2a3b-454f-8a7b-556ad894f615/volumes"
Jul 20 22:42:33.931058 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:42:33.930960    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n"]
Jul 20 22:42:33.931602 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:42:33.931180    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n" podUID="42610eb7-aaa8-4282-80fa-913814bf78a4" containerName="manager" containerID="cri-o://d5b4aedebb4e99e7e043e1bf1105b9222334ae3dcc1d5fd156aac0ac16fa345f" gracePeriod=10
Jul 20 22:42:37.084554 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:42:37.084526    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n"
Jul 20 22:42:37.207246 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:42:37.207215    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42610eb7-aaa8-4282-80fa-913814bf78a4-extensions-socket-volume\") pod \"42610eb7-aaa8-4282-80fa-913814bf78a4\" (UID: \"42610eb7-aaa8-4282-80fa-913814bf78a4\") "
Jul 20 22:42:37.207424 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:42:37.207310    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttc9k\" (UniqueName: \"kubernetes.io/projected/42610eb7-aaa8-4282-80fa-913814bf78a4-kube-api-access-ttc9k\") pod \"42610eb7-aaa8-4282-80fa-913814bf78a4\" (UID: \"42610eb7-aaa8-4282-80fa-913814bf78a4\") "
Jul 20 22:42:37.207585 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:42:37.207561    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42610eb7-aaa8-4282-80fa-913814bf78a4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "42610eb7-aaa8-4282-80fa-913814bf78a4" (UID: "42610eb7-aaa8-4282-80fa-913814bf78a4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:42:37.209289 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:42:37.209263    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42610eb7-aaa8-4282-80fa-913814bf78a4-kube-api-access-ttc9k" (OuterVolumeSpecName: "kube-api-access-ttc9k") pod "42610eb7-aaa8-4282-80fa-913814bf78a4" (UID: "42610eb7-aaa8-4282-80fa-913814bf78a4"). InnerVolumeSpecName "kube-api-access-ttc9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:42:37.309089 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:42:37.309048    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/42610eb7-aaa8-4282-80fa-913814bf78a4-extensions-socket-volume\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:42:37.309089 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:42:37.309082    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttc9k\" (UniqueName: \"kubernetes.io/projected/42610eb7-aaa8-4282-80fa-913814bf78a4-kube-api-access-ttc9k\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:42:37.931036 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:42:37.930997    2556 generic.go:356] "Generic (PLEG): container finished" podID="42610eb7-aaa8-4282-80fa-913814bf78a4" containerID="d5b4aedebb4e99e7e043e1bf1105b9222334ae3dcc1d5fd156aac0ac16fa345f" exitCode=0
Jul 20 22:42:37.931209 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:42:37.931052    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n"
Jul 20 22:42:37.931209 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:42:37.931081    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n" event={"ID":"42610eb7-aaa8-4282-80fa-913814bf78a4","Type":"ContainerDied","Data":"d5b4aedebb4e99e7e043e1bf1105b9222334ae3dcc1d5fd156aac0ac16fa345f"}
Jul 20 22:42:37.931209 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:42:37.931138    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n" event={"ID":"42610eb7-aaa8-4282-80fa-913814bf78a4","Type":"ContainerDied","Data":"727dc4781fe028084f13496264036fe2fe10447468a88fac0119d0dd138eea15"}
Jul 20 22:42:37.931209 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:42:37.931161    2556 scope.go:117] "RemoveContainer" containerID="d5b4aedebb4e99e7e043e1bf1105b9222334ae3dcc1d5fd156aac0ac16fa345f"
Jul 20 22:42:37.940804 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:42:37.940787    2556 scope.go:117] "RemoveContainer" containerID="d5b4aedebb4e99e7e043e1bf1105b9222334ae3dcc1d5fd156aac0ac16fa345f"
Jul 20 22:42:37.941098 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:42:37.941075    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5b4aedebb4e99e7e043e1bf1105b9222334ae3dcc1d5fd156aac0ac16fa345f\": container with ID starting with d5b4aedebb4e99e7e043e1bf1105b9222334ae3dcc1d5fd156aac0ac16fa345f not found: ID does not exist" containerID="d5b4aedebb4e99e7e043e1bf1105b9222334ae3dcc1d5fd156aac0ac16fa345f"
Jul 20 22:42:37.941236 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:42:37.941106    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b4aedebb4e99e7e043e1bf1105b9222334ae3dcc1d5fd156aac0ac16fa345f"} err="failed to get container status \"d5b4aedebb4e99e7e043e1bf1105b9222334ae3dcc1d5fd156aac0ac16fa345f\": rpc error: code = NotFound desc = could not find container \"d5b4aedebb4e99e7e043e1bf1105b9222334ae3dcc1d5fd156aac0ac16fa345f\": container with ID starting with d5b4aedebb4e99e7e043e1bf1105b9222334ae3dcc1d5fd156aac0ac16fa345f not found: ID does not exist"
Jul 20 22:42:37.959484 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:42:37.959452    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n"]
Jul 20 22:42:37.961083 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:42:37.961052    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w7s8n"]
Jul 20 22:42:39.207072 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:42:39.207035    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42610eb7-aaa8-4282-80fa-913814bf78a4" path="/var/lib/kubelet/pods/42610eb7-aaa8-4282-80fa-913814bf78a4/volumes"
Jul 20 22:43:35.016513 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:43:35.016479    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqmdl"]
Jul 20 22:43:35.016969 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:43:35.016862    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aadb9091-2a3b-454f-8a7b-556ad894f615" containerName="authorino"
Jul 20 22:43:35.016969 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:43:35.016873    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="aadb9091-2a3b-454f-8a7b-556ad894f615" containerName="authorino"
Jul 20 22:43:35.016969 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:43:35.016898    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42610eb7-aaa8-4282-80fa-913814bf78a4" containerName="manager"
Jul 20 22:43:35.016969 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:43:35.016903    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="42610eb7-aaa8-4282-80fa-913814bf78a4" containerName="manager"
Jul 20 22:43:35.016969 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:43:35.016955    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="aadb9091-2a3b-454f-8a7b-556ad894f615" containerName="authorino"
Jul 20 22:43:35.016969 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:43:35.016966    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="42610eb7-aaa8-4282-80fa-913814bf78a4" containerName="manager"
Jul 20 22:43:35.019889 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:43:35.019874    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqmdl"
Jul 20 22:43:35.022482 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:43:35.022462    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pfcnt\""
Jul 20 22:43:35.039897 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:43:35.039872    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqmdl"]
Jul 20 22:43:35.041479 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:43:35.041445    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djql6\" (UniqueName: \"kubernetes.io/projected/20fb47f4-a5b3-4fa0-bb9c-e7595c1dca64-kube-api-access-djql6\") pod \"kuadrant-operator-controller-manager-86878c769f-pqmdl\" (UID: \"20fb47f4-a5b3-4fa0-bb9c-e7595c1dca64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqmdl"
Jul 20 22:43:35.041588 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:43:35.041509    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20fb47f4-a5b3-4fa0-bb9c-e7595c1dca64-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pqmdl\" (UID: \"20fb47f4-a5b3-4fa0-bb9c-e7595c1dca64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqmdl"
Jul 20 22:43:35.142017 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:43:35.141975    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djql6\" (UniqueName: \"kubernetes.io/projected/20fb47f4-a5b3-4fa0-bb9c-e7595c1dca64-kube-api-access-djql6\") pod \"kuadrant-operator-controller-manager-86878c769f-pqmdl\" (UID: \"20fb47f4-a5b3-4fa0-bb9c-e7595c1dca64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqmdl"
Jul 20 22:43:35.142199 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:43:35.142070    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20fb47f4-a5b3-4fa0-bb9c-e7595c1dca64-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pqmdl\" (UID: \"20fb47f4-a5b3-4fa0-bb9c-e7595c1dca64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqmdl"
Jul 20 22:43:35.142482 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:43:35.142462    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20fb47f4-a5b3-4fa0-bb9c-e7595c1dca64-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pqmdl\" (UID: \"20fb47f4-a5b3-4fa0-bb9c-e7595c1dca64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqmdl"
Jul 20 22:43:35.154480 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:43:35.154460    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djql6\" (UniqueName: \"kubernetes.io/projected/20fb47f4-a5b3-4fa0-bb9c-e7595c1dca64-kube-api-access-djql6\") pod \"kuadrant-operator-controller-manager-86878c769f-pqmdl\" (UID: \"20fb47f4-a5b3-4fa0-bb9c-e7595c1dca64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqmdl"
Jul 20 22:43:35.330008 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:43:35.329911    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqmdl"
Jul 20 22:43:35.471150 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:43:35.471124    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqmdl"]
Jul 20 22:43:35.472955 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:43:35.472931    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20fb47f4_a5b3_4fa0_bb9c_e7595c1dca64.slice/crio-8a6abe61b68cb0555d5a1953b85a8d94bbdeac4c060bac9e53ecc3efb141de74 WatchSource:0}: Error finding container 8a6abe61b68cb0555d5a1953b85a8d94bbdeac4c060bac9e53ecc3efb141de74: Status 404 returned error can't find the container with id 8a6abe61b68cb0555d5a1953b85a8d94bbdeac4c060bac9e53ecc3efb141de74
Jul 20 22:43:36.212750 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:43:36.212712    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqmdl" event={"ID":"20fb47f4-a5b3-4fa0-bb9c-e7595c1dca64","Type":"ContainerStarted","Data":"d79c4ab9f39647abc7039ebd1bb9e09865223508fbe7f4db1874863a3243f77d"}
Jul 20 22:43:36.213246 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:43:36.212761    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqmdl" event={"ID":"20fb47f4-a5b3-4fa0-bb9c-e7595c1dca64","Type":"ContainerStarted","Data":"8a6abe61b68cb0555d5a1953b85a8d94bbdeac4c060bac9e53ecc3efb141de74"}
Jul 20 22:43:36.213246 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:43:36.212880    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqmdl"
Jul 20 22:43:36.233828 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:43:36.233776    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqmdl" podStartSLOduration=2.233760059 podStartE2EDuration="2.233760059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:43:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:43:36.233330889 +0000 UTC m=+1229.531547460" watchObservedRunningTime="2026-07-20 22:43:36.233760059 +0000 UTC m=+1229.531976629"
Jul 20 22:43:47.219952 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:43:47.219920    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pqmdl"
Jul 20 22:46:35.605241 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:35.605206    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"]
Jul 20 22:46:35.608790 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:35.608774    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:46:35.611195 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:35.611172    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-ab4fc927-kserve-self-signed-certs\""
Jul 20 22:46:35.624892 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:35.624867    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"]
Jul 20 22:46:35.632262 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:35.632239    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-home\") pod \"e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") " pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:46:35.632379 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:35.632278    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz46x\" (UniqueName: \"kubernetes.io/projected/16b3bff6-22fe-4986-9443-6339aebed283-kube-api-access-lz46x\") pod \"e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") " pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:46:35.632379 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:35.632299    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-tmp-dir\") pod \"e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") " pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:46:35.632379 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:35.632342    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-model-cache\") pod \"e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") " pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:46:35.632379 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:35.632367    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16b3bff6-22fe-4986-9443-6339aebed283-tls-certs\") pod \"e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") " pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:46:35.632532 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:35.632400    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-dshm\") pod \"e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") " pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:46:35.733468 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:35.733431    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-dshm\") pod \"e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") " pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:46:35.733669 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:35.733509    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-home\") pod \"e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") " pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:46:35.733669 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:35.733539    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz46x\" (UniqueName: \"kubernetes.io/projected/16b3bff6-22fe-4986-9443-6339aebed283-kube-api-access-lz46x\") pod \"e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") " pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:46:35.733669 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:35.733563    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-tmp-dir\") pod \"e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") " pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:46:35.733669 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:35.733600    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-model-cache\") pod \"e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") " pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:46:35.733669 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:35.733640    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16b3bff6-22fe-4986-9443-6339aebed283-tls-certs\") pod \"e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") " pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:46:35.733985 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:35.733958    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-home\") pod \"e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") " pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:46:35.734074 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:35.734004    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-tmp-dir\") pod \"e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") " pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:46:35.734074 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:35.734034    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-model-cache\") pod \"e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") " pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:46:35.735725 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:35.735699    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-dshm\") pod \"e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") " pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:46:35.735962 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:35.735945    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16b3bff6-22fe-4986-9443-6339aebed283-tls-certs\") pod \"e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") " pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:46:35.743001 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:35.742977    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz46x\" (UniqueName: \"kubernetes.io/projected/16b3bff6-22fe-4986-9443-6339aebed283-kube-api-access-lz46x\") pod \"e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") " pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:46:35.919771 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:35.919687    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:46:36.063549 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:36.063522    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"]
Jul 20 22:46:36.065142 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:46:36.065113    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16b3bff6_22fe_4986_9443_6339aebed283.slice/crio-14a3a5f6d4838be12fbd8ecf0a20b529f4b67c2a74950ac44c43fe04cd5d2c9d WatchSource:0}: Error finding container 14a3a5f6d4838be12fbd8ecf0a20b529f4b67c2a74950ac44c43fe04cd5d2c9d: Status 404 returned error can't find the container with id 14a3a5f6d4838be12fbd8ecf0a20b529f4b67c2a74950ac44c43fe04cd5d2c9d
Jul 20 22:46:36.091664 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:36.091632    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg" event={"ID":"16b3bff6-22fe-4986-9443-6339aebed283","Type":"ContainerStarted","Data":"14a3a5f6d4838be12fbd8ecf0a20b529f4b67c2a74950ac44c43fe04cd5d2c9d"}
Jul 20 22:46:37.098127 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:37.098087    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg" event={"ID":"16b3bff6-22fe-4986-9443-6339aebed283","Type":"ContainerStarted","Data":"cb4c6c23fe348d602bfb5935cb1d99a6b93bd593d292b38decaa7ce990164c4c"}
Jul 20 22:46:37.120380 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:37.120327    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg" podStartSLOduration=2.120309706 podStartE2EDuration="2.120309706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:46:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:46:37.117459868 +0000 UTC m=+1410.415676438" watchObservedRunningTime="2026-07-20 22:46:37.120309706 +0000 UTC m=+1410.418526275"
Jul 20 22:46:45.920269 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:45.920230    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:46:45.920766 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:45.920284    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:46:45.932912 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:45.932884    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:46:46.155805 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:46:46.155777    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:47:03.806482 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:03.806400    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"]
Jul 20 22:47:18.827852 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:18.827805    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg" podUID="16b3bff6-22fe-4986-9443-6339aebed283" containerName="main" containerID="cri-o://cb4c6c23fe348d602bfb5935cb1d99a6b93bd593d292b38decaa7ce990164c4c" gracePeriod=45
Jul 20 22:47:19.089515 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.089452    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:47:19.142065 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.142033    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-model-cache\") pod \"16b3bff6-22fe-4986-9443-6339aebed283\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") "
Jul 20 22:47:19.142233 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.142085    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lz46x\" (UniqueName: \"kubernetes.io/projected/16b3bff6-22fe-4986-9443-6339aebed283-kube-api-access-lz46x\") pod \"16b3bff6-22fe-4986-9443-6339aebed283\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") "
Jul 20 22:47:19.142233 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.142128    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16b3bff6-22fe-4986-9443-6339aebed283-tls-certs\") pod \"16b3bff6-22fe-4986-9443-6339aebed283\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") "
Jul 20 22:47:19.142233 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.142143    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-dshm\") pod \"16b3bff6-22fe-4986-9443-6339aebed283\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") "
Jul 20 22:47:19.142233 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.142176    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-home\") pod \"16b3bff6-22fe-4986-9443-6339aebed283\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") "
Jul 20 22:47:19.142450 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.142251    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-tmp-dir\") pod \"16b3bff6-22fe-4986-9443-6339aebed283\" (UID: \"16b3bff6-22fe-4986-9443-6339aebed283\") "
Jul 20 22:47:19.142450 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.142313    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-model-cache" (OuterVolumeSpecName: "model-cache") pod "16b3bff6-22fe-4986-9443-6339aebed283" (UID: "16b3bff6-22fe-4986-9443-6339aebed283"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:47:19.142559 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.142516    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "16b3bff6-22fe-4986-9443-6339aebed283" (UID: "16b3bff6-22fe-4986-9443-6339aebed283"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:47:19.142559 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.142534    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-home" (OuterVolumeSpecName: "home") pod "16b3bff6-22fe-4986-9443-6339aebed283" (UID: "16b3bff6-22fe-4986-9443-6339aebed283"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:47:19.142697 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.142621    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-model-cache\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:47:19.144364 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.144344    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16b3bff6-22fe-4986-9443-6339aebed283-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "16b3bff6-22fe-4986-9443-6339aebed283" (UID: "16b3bff6-22fe-4986-9443-6339aebed283"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:47:19.144484 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.144462    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-dshm" (OuterVolumeSpecName: "dshm") pod "16b3bff6-22fe-4986-9443-6339aebed283" (UID: "16b3bff6-22fe-4986-9443-6339aebed283"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:47:19.144525 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.144473    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16b3bff6-22fe-4986-9443-6339aebed283-kube-api-access-lz46x" (OuterVolumeSpecName: "kube-api-access-lz46x") pod "16b3bff6-22fe-4986-9443-6339aebed283" (UID: "16b3bff6-22fe-4986-9443-6339aebed283"). InnerVolumeSpecName "kube-api-access-lz46x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:47:19.243393 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.243359    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-home\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:47:19.243393 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.243391    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-tmp-dir\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:47:19.243393 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.243400    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lz46x\" (UniqueName: \"kubernetes.io/projected/16b3bff6-22fe-4986-9443-6339aebed283-kube-api-access-lz46x\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:47:19.243393 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.243411    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16b3bff6-22fe-4986-9443-6339aebed283-tls-certs\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:47:19.243697 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.243420    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16b3bff6-22fe-4986-9443-6339aebed283-dshm\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:47:19.298618 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.298585    2556 generic.go:356] "Generic (PLEG): container finished" podID="16b3bff6-22fe-4986-9443-6339aebed283" containerID="cb4c6c23fe348d602bfb5935cb1d99a6b93bd593d292b38decaa7ce990164c4c" exitCode=0
Jul 20 22:47:19.298768 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.298646    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"
Jul 20 22:47:19.298768 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.298664    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg" event={"ID":"16b3bff6-22fe-4986-9443-6339aebed283","Type":"ContainerDied","Data":"cb4c6c23fe348d602bfb5935cb1d99a6b93bd593d292b38decaa7ce990164c4c"}
Jul 20 22:47:19.298768 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.298701    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg" event={"ID":"16b3bff6-22fe-4986-9443-6339aebed283","Type":"ContainerDied","Data":"14a3a5f6d4838be12fbd8ecf0a20b529f4b67c2a74950ac44c43fe04cd5d2c9d"}
Jul 20 22:47:19.298768 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.298719    2556 scope.go:117] "RemoveContainer" containerID="cb4c6c23fe348d602bfb5935cb1d99a6b93bd593d292b38decaa7ce990164c4c"
Jul 20 22:47:19.307376 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.307359    2556 scope.go:117] "RemoveContainer" containerID="cb4c6c23fe348d602bfb5935cb1d99a6b93bd593d292b38decaa7ce990164c4c"
Jul 20 22:47:19.307642 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:47:19.307623    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb4c6c23fe348d602bfb5935cb1d99a6b93bd593d292b38decaa7ce990164c4c\": container with ID starting with cb4c6c23fe348d602bfb5935cb1d99a6b93bd593d292b38decaa7ce990164c4c not found: ID does not exist" containerID="cb4c6c23fe348d602bfb5935cb1d99a6b93bd593d292b38decaa7ce990164c4c"
Jul 20 22:47:19.307706 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.307648    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb4c6c23fe348d602bfb5935cb1d99a6b93bd593d292b38decaa7ce990164c4c"} err="failed to get container status \"cb4c6c23fe348d602bfb5935cb1d99a6b93bd593d292b38decaa7ce990164c4c\": rpc error: code = NotFound desc = could not find container \"cb4c6c23fe348d602bfb5935cb1d99a6b93bd593d292b38decaa7ce990164c4c\": container with ID starting with cb4c6c23fe348d602bfb5935cb1d99a6b93bd593d292b38decaa7ce990164c4c not found: ID does not exist"
Jul 20 22:47:19.320649 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.317465    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"]
Jul 20 22:47:19.324142 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:19.323994    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-ab4fc927-kserve-f69677659-67ccg"]
Jul 20 22:47:21.208251 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:47:21.208216    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16b3bff6-22fe-4986-9443-6339aebed283" path="/var/lib/kubelet/pods/16b3bff6-22fe-4986-9443-6339aebed283/volumes"
Jul 20 22:50:45.391387 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:45.391351    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt"]
Jul 20 22:50:45.393710 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:45.391810    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16b3bff6-22fe-4986-9443-6339aebed283" containerName="main"
Jul 20 22:50:45.393710 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:45.391823    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="16b3bff6-22fe-4986-9443-6339aebed283" containerName="main"
Jul 20 22:50:45.393710 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:45.391896    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="16b3bff6-22fe-4986-9443-6339aebed283" containerName="main"
Jul 20 22:50:45.395117 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:45.395102    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt"
Jul 20 22:50:45.398096 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:45.398074    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-23458506-serving-cert\""
Jul 20 22:50:45.415837 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:45.415803    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt"]
Jul 20 22:50:45.499839 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:45.499800    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c652328-7a35-4999-9c3e-942838c43d3e-maas-api-tls\") pod \"maas-api-e2e-ait-23458506-547c64fd94-mcrqt\" (UID: \"9c652328-7a35-4999-9c3e-942838c43d3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt"
Jul 20 22:50:45.500048 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:45.499921    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c652328-7a35-4999-9c3e-942838c43d3e-openshift-service-ca\") pod \"maas-api-e2e-ait-23458506-547c64fd94-mcrqt\" (UID: \"9c652328-7a35-4999-9c3e-942838c43d3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt"
Jul 20 22:50:45.500048 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:45.499975    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7n62\" (UniqueName: \"kubernetes.io/projected/9c652328-7a35-4999-9c3e-942838c43d3e-kube-api-access-w7n62\") pod \"maas-api-e2e-ait-23458506-547c64fd94-mcrqt\" (UID: \"9c652328-7a35-4999-9c3e-942838c43d3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt"
Jul 20 22:50:45.600857 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:45.600821    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c652328-7a35-4999-9c3e-942838c43d3e-openshift-service-ca\") pod \"maas-api-e2e-ait-23458506-547c64fd94-mcrqt\" (UID: \"9c652328-7a35-4999-9c3e-942838c43d3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt"
Jul 20 22:50:45.601034 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:45.600873    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7n62\" (UniqueName: \"kubernetes.io/projected/9c652328-7a35-4999-9c3e-942838c43d3e-kube-api-access-w7n62\") pod \"maas-api-e2e-ait-23458506-547c64fd94-mcrqt\" (UID: \"9c652328-7a35-4999-9c3e-942838c43d3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt"
Jul 20 22:50:45.601034 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:45.600909    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c652328-7a35-4999-9c3e-942838c43d3e-maas-api-tls\") pod \"maas-api-e2e-ait-23458506-547c64fd94-mcrqt\" (UID: \"9c652328-7a35-4999-9c3e-942838c43d3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt"
Jul 20 22:50:45.601546 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:45.601528    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c652328-7a35-4999-9c3e-942838c43d3e-openshift-service-ca\") pod \"maas-api-e2e-ait-23458506-547c64fd94-mcrqt\" (UID: \"9c652328-7a35-4999-9c3e-942838c43d3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt"
Jul 20 22:50:45.603295 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:45.603279    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c652328-7a35-4999-9c3e-942838c43d3e-maas-api-tls\") pod \"maas-api-e2e-ait-23458506-547c64fd94-mcrqt\" (UID: \"9c652328-7a35-4999-9c3e-942838c43d3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt"
Jul 20 22:50:45.613120 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:45.613093    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7n62\" (UniqueName: \"kubernetes.io/projected/9c652328-7a35-4999-9c3e-942838c43d3e-kube-api-access-w7n62\") pod \"maas-api-e2e-ait-23458506-547c64fd94-mcrqt\" (UID: \"9c652328-7a35-4999-9c3e-942838c43d3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt"
Jul 20 22:50:45.705465 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:45.705430    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt"
Jul 20 22:50:45.849386 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:45.848576    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt"]
Jul 20 22:50:45.851328 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:50:45.851292    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c652328_7a35_4999_9c3e_942838c43d3e.slice/crio-81b78b931f38888cf2e51d69c8c63da7431332ae6cb4816c450c6dfb5317bb9b WatchSource:0}: Error finding container 81b78b931f38888cf2e51d69c8c63da7431332ae6cb4816c450c6dfb5317bb9b: Status 404 returned error can't find the container with id 81b78b931f38888cf2e51d69c8c63da7431332ae6cb4816c450c6dfb5317bb9b
Jul 20 22:50:45.852555 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:45.852536    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 22:50:46.328796 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:46.328763    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt" event={"ID":"9c652328-7a35-4999-9c3e-942838c43d3e","Type":"ContainerStarted","Data":"4b60cc7331af7db5c07628c392e3e397e34ebd1cac94c5e355d4db237911fdbc"}
Jul 20 22:50:46.328992 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:46.328818    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt" event={"ID":"9c652328-7a35-4999-9c3e-942838c43d3e","Type":"ContainerStarted","Data":"81b78b931f38888cf2e51d69c8c63da7431332ae6cb4816c450c6dfb5317bb9b"}
Jul 20 22:50:46.328992 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:46.328839    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt"
Jul 20 22:50:46.353420 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:46.353360    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt" podStartSLOduration=0.956373711 podStartE2EDuration="1.35334378s" totalImagesPullingTime="396.970069ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:50:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:50:46.35123233 +0000 UTC m=+1659.649448900" watchObservedRunningTime="2026-07-20 22:50:46.35334378 +0000 UTC m=+1659.651560349"
Jul 20 22:50:52.339100 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:50:52.339071    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt"
Jul 20 22:51:21.175974 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:21.175943    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt"]
Jul 20 22:51:21.176600 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:21.176201    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt" podUID="9c652328-7a35-4999-9c3e-942838c43d3e" containerName="maas-api" containerID="cri-o://4b60cc7331af7db5c07628c392e3e397e34ebd1cac94c5e355d4db237911fdbc" gracePeriod=30
Jul 20 22:51:21.431695 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:21.431665    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt"
Jul 20 22:51:21.494976 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:21.494936    2556 generic.go:356] "Generic (PLEG): container finished" podID="9c652328-7a35-4999-9c3e-942838c43d3e" containerID="4b60cc7331af7db5c07628c392e3e397e34ebd1cac94c5e355d4db237911fdbc" exitCode=0
Jul 20 22:51:21.495159 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:21.494979    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt"
Jul 20 22:51:21.495159 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:21.495082    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt" event={"ID":"9c652328-7a35-4999-9c3e-942838c43d3e","Type":"ContainerDied","Data":"4b60cc7331af7db5c07628c392e3e397e34ebd1cac94c5e355d4db237911fdbc"}
Jul 20 22:51:21.495250 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:21.495165    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt" event={"ID":"9c652328-7a35-4999-9c3e-942838c43d3e","Type":"ContainerDied","Data":"81b78b931f38888cf2e51d69c8c63da7431332ae6cb4816c450c6dfb5317bb9b"}
Jul 20 22:51:21.495250 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:21.495197    2556 scope.go:117] "RemoveContainer" containerID="4b60cc7331af7db5c07628c392e3e397e34ebd1cac94c5e355d4db237911fdbc"
Jul 20 22:51:21.504899 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:21.504878    2556 scope.go:117] "RemoveContainer" containerID="4b60cc7331af7db5c07628c392e3e397e34ebd1cac94c5e355d4db237911fdbc"
Jul 20 22:51:21.505163 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:51:21.505141    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b60cc7331af7db5c07628c392e3e397e34ebd1cac94c5e355d4db237911fdbc\": container with ID starting with 4b60cc7331af7db5c07628c392e3e397e34ebd1cac94c5e355d4db237911fdbc not found: ID does not exist" containerID="4b60cc7331af7db5c07628c392e3e397e34ebd1cac94c5e355d4db237911fdbc"
Jul 20 22:51:21.505218 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:21.505172    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b60cc7331af7db5c07628c392e3e397e34ebd1cac94c5e355d4db237911fdbc"} err="failed to get container status \"4b60cc7331af7db5c07628c392e3e397e34ebd1cac94c5e355d4db237911fdbc\": rpc error: code = NotFound desc = could not find container \"4b60cc7331af7db5c07628c392e3e397e34ebd1cac94c5e355d4db237911fdbc\": container with ID starting with 4b60cc7331af7db5c07628c392e3e397e34ebd1cac94c5e355d4db237911fdbc not found: ID does not exist"
Jul 20 22:51:21.551828 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:21.551796    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c652328-7a35-4999-9c3e-942838c43d3e-maas-api-tls\") pod \"9c652328-7a35-4999-9c3e-942838c43d3e\" (UID: \"9c652328-7a35-4999-9c3e-942838c43d3e\") "
Jul 20 22:51:21.552017 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:21.551884    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c652328-7a35-4999-9c3e-942838c43d3e-openshift-service-ca\") pod \"9c652328-7a35-4999-9c3e-942838c43d3e\" (UID: \"9c652328-7a35-4999-9c3e-942838c43d3e\") "
Jul 20 22:51:21.552017 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:21.551941    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7n62\" (UniqueName: \"kubernetes.io/projected/9c652328-7a35-4999-9c3e-942838c43d3e-kube-api-access-w7n62\") pod \"9c652328-7a35-4999-9c3e-942838c43d3e\" (UID: \"9c652328-7a35-4999-9c3e-942838c43d3e\") "
Jul 20 22:51:21.552298 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:21.552271    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c652328-7a35-4999-9c3e-942838c43d3e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9c652328-7a35-4999-9c3e-942838c43d3e" (UID: "9c652328-7a35-4999-9c3e-942838c43d3e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:51:21.554067 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:21.554039    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c652328-7a35-4999-9c3e-942838c43d3e-kube-api-access-w7n62" (OuterVolumeSpecName: "kube-api-access-w7n62") pod "9c652328-7a35-4999-9c3e-942838c43d3e" (UID: "9c652328-7a35-4999-9c3e-942838c43d3e"). InnerVolumeSpecName "kube-api-access-w7n62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:51:21.554191 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:21.554165    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c652328-7a35-4999-9c3e-942838c43d3e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9c652328-7a35-4999-9c3e-942838c43d3e" (UID: "9c652328-7a35-4999-9c3e-942838c43d3e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:51:21.652649 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:21.652596    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c652328-7a35-4999-9c3e-942838c43d3e-maas-api-tls\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:51:21.652649 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:21.652642    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c652328-7a35-4999-9c3e-942838c43d3e-openshift-service-ca\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:51:21.652649 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:21.652653    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7n62\" (UniqueName: \"kubernetes.io/projected/9c652328-7a35-4999-9c3e-942838c43d3e-kube-api-access-w7n62\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:51:21.822788 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:21.822757    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt"]
Jul 20 22:51:21.831084 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:21.831064    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-23458506-547c64fd94-mcrqt"]
Jul 20 22:51:23.206772 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:23.206737    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c652328-7a35-4999-9c3e-942838c43d3e" path="/var/lib/kubelet/pods/9c652328-7a35-4999-9c3e-942838c43d3e/volumes"
Jul 20 22:51:29.690798 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:29.690724    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld"]
Jul 20 22:51:29.691330 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:29.691296    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c652328-7a35-4999-9c3e-942838c43d3e" containerName="maas-api"
Jul 20 22:51:29.691330 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:29.691311    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c652328-7a35-4999-9c3e-942838c43d3e" containerName="maas-api"
Jul 20 22:51:29.691461 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:29.691423    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c652328-7a35-4999-9c3e-942838c43d3e" containerName="maas-api"
Jul 20 22:51:29.696413 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:29.696390    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld"
Jul 20 22:51:29.698549 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:29.698527    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-55938262-serving-cert\""
Jul 20 22:51:29.704989 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:29.704965    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld"]
Jul 20 22:51:29.830699 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:29.830666    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73d4928c-489f-4ff2-a62e-2a365d5d6350-openshift-service-ca\") pod \"maas-api-e2e-migrate-55938262-878bc4f58-npnld\" (UID: \"73d4928c-489f-4ff2-a62e-2a365d5d6350\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld"
Jul 20 22:51:29.830877 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:29.830728    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73d4928c-489f-4ff2-a62e-2a365d5d6350-maas-api-tls\") pod \"maas-api-e2e-migrate-55938262-878bc4f58-npnld\" (UID: \"73d4928c-489f-4ff2-a62e-2a365d5d6350\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld"
Jul 20 22:51:29.830877 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:29.830835    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfklq\" (UniqueName: \"kubernetes.io/projected/73d4928c-489f-4ff2-a62e-2a365d5d6350-kube-api-access-nfklq\") pod \"maas-api-e2e-migrate-55938262-878bc4f58-npnld\" (UID: \"73d4928c-489f-4ff2-a62e-2a365d5d6350\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld"
Jul 20 22:51:29.932169 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:29.932134    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73d4928c-489f-4ff2-a62e-2a365d5d6350-maas-api-tls\") pod \"maas-api-e2e-migrate-55938262-878bc4f58-npnld\" (UID: \"73d4928c-489f-4ff2-a62e-2a365d5d6350\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld"
Jul 20 22:51:29.932374 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:29.932192    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfklq\" (UniqueName: \"kubernetes.io/projected/73d4928c-489f-4ff2-a62e-2a365d5d6350-kube-api-access-nfklq\") pod \"maas-api-e2e-migrate-55938262-878bc4f58-npnld\" (UID: \"73d4928c-489f-4ff2-a62e-2a365d5d6350\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld"
Jul 20 22:51:29.932374 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:29.932251    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73d4928c-489f-4ff2-a62e-2a365d5d6350-openshift-service-ca\") pod \"maas-api-e2e-migrate-55938262-878bc4f58-npnld\" (UID: \"73d4928c-489f-4ff2-a62e-2a365d5d6350\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld"
Jul 20 22:51:29.932374 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:51:29.932308    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-serving-cert: secret "maas-api-e2e-migrate-55938262-serving-cert" not found
Jul 20 22:51:29.932545 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:51:29.932399    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73d4928c-489f-4ff2-a62e-2a365d5d6350-maas-api-tls podName:73d4928c-489f-4ff2-a62e-2a365d5d6350 nodeName:}" failed. No retries permitted until 2026-07-20 22:51:30.432378088 +0000 UTC m=+1703.730594636 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/73d4928c-489f-4ff2-a62e-2a365d5d6350-maas-api-tls") pod "maas-api-e2e-migrate-55938262-878bc4f58-npnld" (UID: "73d4928c-489f-4ff2-a62e-2a365d5d6350") : secret "maas-api-e2e-migrate-55938262-serving-cert" not found
Jul 20 22:51:29.932850 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:29.932833    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73d4928c-489f-4ff2-a62e-2a365d5d6350-openshift-service-ca\") pod \"maas-api-e2e-migrate-55938262-878bc4f58-npnld\" (UID: \"73d4928c-489f-4ff2-a62e-2a365d5d6350\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld"
Jul 20 22:51:29.942299 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:29.942239    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfklq\" (UniqueName: \"kubernetes.io/projected/73d4928c-489f-4ff2-a62e-2a365d5d6350-kube-api-access-nfklq\") pod \"maas-api-e2e-migrate-55938262-878bc4f58-npnld\" (UID: \"73d4928c-489f-4ff2-a62e-2a365d5d6350\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld"
Jul 20 22:51:30.437073 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:30.437048    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73d4928c-489f-4ff2-a62e-2a365d5d6350-maas-api-tls\") pod \"maas-api-e2e-migrate-55938262-878bc4f58-npnld\" (UID: \"73d4928c-489f-4ff2-a62e-2a365d5d6350\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld"
Jul 20 22:51:30.437249 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:51:30.437162    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-serving-cert: secret "maas-api-e2e-migrate-55938262-serving-cert" not found
Jul 20 22:51:30.437249 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:51:30.437218    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73d4928c-489f-4ff2-a62e-2a365d5d6350-maas-api-tls podName:73d4928c-489f-4ff2-a62e-2a365d5d6350 nodeName:}" failed. No retries permitted until 2026-07-20 22:51:31.437200717 +0000 UTC m=+1704.735417271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/73d4928c-489f-4ff2-a62e-2a365d5d6350-maas-api-tls") pod "maas-api-e2e-migrate-55938262-878bc4f58-npnld" (UID: "73d4928c-489f-4ff2-a62e-2a365d5d6350") : secret "maas-api-e2e-migrate-55938262-serving-cert" not found
Jul 20 22:51:31.448905 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:31.448870    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73d4928c-489f-4ff2-a62e-2a365d5d6350-maas-api-tls\") pod \"maas-api-e2e-migrate-55938262-878bc4f58-npnld\" (UID: \"73d4928c-489f-4ff2-a62e-2a365d5d6350\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld"
Jul 20 22:51:31.451449 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:31.451426    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73d4928c-489f-4ff2-a62e-2a365d5d6350-maas-api-tls\") pod \"maas-api-e2e-migrate-55938262-878bc4f58-npnld\" (UID: \"73d4928c-489f-4ff2-a62e-2a365d5d6350\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld"
Jul 20 22:51:31.507330 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:31.507296    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld"
Jul 20 22:51:31.641621 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:31.641584    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld"]
Jul 20 22:51:31.643953 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:51:31.643927    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d4928c_489f_4ff2_a62e_2a365d5d6350.slice/crio-a67a07c3c9e9b0c7492661f3ce357eef28d720c07964b6e2ea10327453e6f59c WatchSource:0}: Error finding container a67a07c3c9e9b0c7492661f3ce357eef28d720c07964b6e2ea10327453e6f59c: Status 404 returned error can't find the container with id a67a07c3c9e9b0c7492661f3ce357eef28d720c07964b6e2ea10327453e6f59c
Jul 20 22:51:32.553083 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:32.553048    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld" event={"ID":"73d4928c-489f-4ff2-a62e-2a365d5d6350","Type":"ContainerStarted","Data":"4ad4d1c40aaa7abb88609220be633b17574b9acfbf441f338a1c5bd7500daa59"}
Jul 20 22:51:32.553492 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:32.553101    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld" event={"ID":"73d4928c-489f-4ff2-a62e-2a365d5d6350","Type":"ContainerStarted","Data":"a67a07c3c9e9b0c7492661f3ce357eef28d720c07964b6e2ea10327453e6f59c"}
Jul 20 22:51:32.553492 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:32.553182    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld"
Jul 20 22:51:32.572330 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:32.572282    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld" podStartSLOduration=3.270288975 podStartE2EDuration="3.572265023s" totalImagesPullingTime="301.976048ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:51:32.570348953 +0000 UTC m=+1705.868565545" watchObservedRunningTime="2026-07-20 22:51:32.572265023 +0000 UTC m=+1705.870481593"
Jul 20 22:51:38.563432 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:51:38.563398    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld"
Jul 20 22:52:05.034360 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:05.034330    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld"]
Jul 20 22:52:05.034829 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:05.034538    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld" podUID="73d4928c-489f-4ff2-a62e-2a365d5d6350" containerName="maas-api" containerID="cri-o://4ad4d1c40aaa7abb88609220be633b17574b9acfbf441f338a1c5bd7500daa59" gracePeriod=30
Jul 20 22:52:05.283665 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:05.283640    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld"
Jul 20 22:52:05.358533 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:05.358449    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73d4928c-489f-4ff2-a62e-2a365d5d6350-maas-api-tls\") pod \"73d4928c-489f-4ff2-a62e-2a365d5d6350\" (UID: \"73d4928c-489f-4ff2-a62e-2a365d5d6350\") "
Jul 20 22:52:05.358533 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:05.358512    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73d4928c-489f-4ff2-a62e-2a365d5d6350-openshift-service-ca\") pod \"73d4928c-489f-4ff2-a62e-2a365d5d6350\" (UID: \"73d4928c-489f-4ff2-a62e-2a365d5d6350\") "
Jul 20 22:52:05.358780 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:05.358573    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfklq\" (UniqueName: \"kubernetes.io/projected/73d4928c-489f-4ff2-a62e-2a365d5d6350-kube-api-access-nfklq\") pod \"73d4928c-489f-4ff2-a62e-2a365d5d6350\" (UID: \"73d4928c-489f-4ff2-a62e-2a365d5d6350\") "
Jul 20 22:52:05.358912 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:05.358887    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73d4928c-489f-4ff2-a62e-2a365d5d6350-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "73d4928c-489f-4ff2-a62e-2a365d5d6350" (UID: "73d4928c-489f-4ff2-a62e-2a365d5d6350"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:52:05.360801 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:05.360766    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73d4928c-489f-4ff2-a62e-2a365d5d6350-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "73d4928c-489f-4ff2-a62e-2a365d5d6350" (UID: "73d4928c-489f-4ff2-a62e-2a365d5d6350"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:52:05.360801 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:05.360773    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73d4928c-489f-4ff2-a62e-2a365d5d6350-kube-api-access-nfklq" (OuterVolumeSpecName: "kube-api-access-nfklq") pod "73d4928c-489f-4ff2-a62e-2a365d5d6350" (UID: "73d4928c-489f-4ff2-a62e-2a365d5d6350"). InnerVolumeSpecName "kube-api-access-nfklq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:52:05.460225 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:05.460190    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73d4928c-489f-4ff2-a62e-2a365d5d6350-maas-api-tls\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:52:05.460225 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:05.460218    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73d4928c-489f-4ff2-a62e-2a365d5d6350-openshift-service-ca\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:52:05.460225 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:05.460231    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfklq\" (UniqueName: \"kubernetes.io/projected/73d4928c-489f-4ff2-a62e-2a365d5d6350-kube-api-access-nfklq\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:52:05.708886 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:05.708853    2556 generic.go:356] "Generic (PLEG): container finished" podID="73d4928c-489f-4ff2-a62e-2a365d5d6350" containerID="4ad4d1c40aaa7abb88609220be633b17574b9acfbf441f338a1c5bd7500daa59" exitCode=0
Jul 20 22:52:05.709068 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:05.708903    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld"
Jul 20 22:52:05.709068 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:05.708942    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld" event={"ID":"73d4928c-489f-4ff2-a62e-2a365d5d6350","Type":"ContainerDied","Data":"4ad4d1c40aaa7abb88609220be633b17574b9acfbf441f338a1c5bd7500daa59"}
Jul 20 22:52:05.709068 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:05.709003    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld" event={"ID":"73d4928c-489f-4ff2-a62e-2a365d5d6350","Type":"ContainerDied","Data":"a67a07c3c9e9b0c7492661f3ce357eef28d720c07964b6e2ea10327453e6f59c"}
Jul 20 22:52:05.709068 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:05.709031    2556 scope.go:117] "RemoveContainer" containerID="4ad4d1c40aaa7abb88609220be633b17574b9acfbf441f338a1c5bd7500daa59"
Jul 20 22:52:05.718435 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:05.718418    2556 scope.go:117] "RemoveContainer" containerID="4ad4d1c40aaa7abb88609220be633b17574b9acfbf441f338a1c5bd7500daa59"
Jul 20 22:52:05.718754 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:52:05.718726    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ad4d1c40aaa7abb88609220be633b17574b9acfbf441f338a1c5bd7500daa59\": container with ID starting with 4ad4d1c40aaa7abb88609220be633b17574b9acfbf441f338a1c5bd7500daa59 not found: ID does not exist" containerID="4ad4d1c40aaa7abb88609220be633b17574b9acfbf441f338a1c5bd7500daa59"
Jul 20 22:52:05.718846 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:05.718766    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ad4d1c40aaa7abb88609220be633b17574b9acfbf441f338a1c5bd7500daa59"} err="failed to get container status \"4ad4d1c40aaa7abb88609220be633b17574b9acfbf441f338a1c5bd7500daa59\": rpc error: code = NotFound desc = could not find container \"4ad4d1c40aaa7abb88609220be633b17574b9acfbf441f338a1c5bd7500daa59\": container with ID starting with 4ad4d1c40aaa7abb88609220be633b17574b9acfbf441f338a1c5bd7500daa59 not found: ID does not exist"
Jul 20 22:52:05.731486 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:05.731447    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld"]
Jul 20 22:52:05.733116 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:05.733097    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-55938262-878bc4f58-npnld"]
Jul 20 22:52:07.212811 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:07.212769    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73d4928c-489f-4ff2-a62e-2a365d5d6350" path="/var/lib/kubelet/pods/73d4928c-489f-4ff2-a62e-2a365d5d6350/volumes"
Jul 20 22:52:12.969639 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:12.966446    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679"]
Jul 20 22:52:12.970635 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:12.970146    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73d4928c-489f-4ff2-a62e-2a365d5d6350" containerName="maas-api"
Jul 20 22:52:12.970635 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:12.970177    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="73d4928c-489f-4ff2-a62e-2a365d5d6350" containerName="maas-api"
Jul 20 22:52:12.970635 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:12.970360    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="73d4928c-489f-4ff2-a62e-2a365d5d6350" containerName="maas-api"
Jul 20 22:52:12.974365 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:12.974330    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679"
Jul 20 22:52:12.977000 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:12.976980    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-cf9642a2-serving-cert\""
Jul 20 22:52:12.981517 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:12.981492    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679"]
Jul 20 22:52:13.031525 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:13.031488    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v2f6\" (UniqueName: \"kubernetes.io/projected/f82c400e-048e-4661-82ce-d60eebcf790b-kube-api-access-9v2f6\") pod \"maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679\" (UID: \"f82c400e-048e-4661-82ce-d60eebcf790b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679"
Jul 20 22:52:13.031724 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:13.031533    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f82c400e-048e-4661-82ce-d60eebcf790b-maas-api-tls\") pod \"maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679\" (UID: \"f82c400e-048e-4661-82ce-d60eebcf790b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679"
Jul 20 22:52:13.031724 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:13.031635    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f82c400e-048e-4661-82ce-d60eebcf790b-openshift-service-ca\") pod \"maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679\" (UID: \"f82c400e-048e-4661-82ce-d60eebcf790b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679"
Jul 20 22:52:13.132828 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:13.132789    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v2f6\" (UniqueName: \"kubernetes.io/projected/f82c400e-048e-4661-82ce-d60eebcf790b-kube-api-access-9v2f6\") pod \"maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679\" (UID: \"f82c400e-048e-4661-82ce-d60eebcf790b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679"
Jul 20 22:52:13.132828 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:13.132834    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f82c400e-048e-4661-82ce-d60eebcf790b-maas-api-tls\") pod \"maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679\" (UID: \"f82c400e-048e-4661-82ce-d60eebcf790b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679"
Jul 20 22:52:13.133098 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:13.132880    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f82c400e-048e-4661-82ce-d60eebcf790b-openshift-service-ca\") pod \"maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679\" (UID: \"f82c400e-048e-4661-82ce-d60eebcf790b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679"
Jul 20 22:52:13.133532 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:13.133511    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f82c400e-048e-4661-82ce-d60eebcf790b-openshift-service-ca\") pod \"maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679\" (UID: \"f82c400e-048e-4661-82ce-d60eebcf790b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679"
Jul 20 22:52:13.135266 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:13.135245    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f82c400e-048e-4661-82ce-d60eebcf790b-maas-api-tls\") pod \"maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679\" (UID: \"f82c400e-048e-4661-82ce-d60eebcf790b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679"
Jul 20 22:52:13.142509 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:13.142487    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v2f6\" (UniqueName: \"kubernetes.io/projected/f82c400e-048e-4661-82ce-d60eebcf790b-kube-api-access-9v2f6\") pod \"maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679\" (UID: \"f82c400e-048e-4661-82ce-d60eebcf790b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679"
Jul 20 22:52:13.286791 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:13.286695    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679"
Jul 20 22:52:13.425008 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:13.424981    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679"]
Jul 20 22:52:13.427199 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:52:13.427171    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf82c400e_048e_4661_82ce_d60eebcf790b.slice/crio-d1fafb4e76483e03bdf3cf845223ec654eb51baf92e7c7e6bfd5b40b60f3dea7 WatchSource:0}: Error finding container d1fafb4e76483e03bdf3cf845223ec654eb51baf92e7c7e6bfd5b40b60f3dea7: Status 404 returned error can't find the container with id d1fafb4e76483e03bdf3cf845223ec654eb51baf92e7c7e6bfd5b40b60f3dea7
Jul 20 22:52:13.751534 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:13.751498    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679" event={"ID":"f82c400e-048e-4661-82ce-d60eebcf790b","Type":"ContainerStarted","Data":"d1fafb4e76483e03bdf3cf845223ec654eb51baf92e7c7e6bfd5b40b60f3dea7"}
Jul 20 22:52:14.758589 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:14.758553    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679" event={"ID":"f82c400e-048e-4661-82ce-d60eebcf790b","Type":"ContainerStarted","Data":"ba024627c0ac0316da4bf5bec13392979539653a446af44503955cccdeed38a0"}
Jul 20 22:52:14.759105 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:14.758687    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679"
Jul 20 22:52:14.779794 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:14.779740    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679" podStartSLOduration=2.394699305 podStartE2EDuration="2.779724626s" totalImagesPullingTime="385.025321ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:52:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:52:14.778958597 +0000 UTC m=+1748.077175168" watchObservedRunningTime="2026-07-20 22:52:14.779724626 +0000 UTC m=+1748.077941234"
Jul 20 22:52:20.769393 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:20.769367    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679"
Jul 20 22:52:48.989040 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:48.989002    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679"]
Jul 20 22:52:48.989682 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:48.989273    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679" podUID="f82c400e-048e-4661-82ce-d60eebcf790b" containerName="maas-api" containerID="cri-o://ba024627c0ac0316da4bf5bec13392979539653a446af44503955cccdeed38a0" gracePeriod=30
Jul 20 22:52:49.240467 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:49.240406    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679"
Jul 20 22:52:49.375619 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:49.375565    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9v2f6\" (UniqueName: \"kubernetes.io/projected/f82c400e-048e-4661-82ce-d60eebcf790b-kube-api-access-9v2f6\") pod \"f82c400e-048e-4661-82ce-d60eebcf790b\" (UID: \"f82c400e-048e-4661-82ce-d60eebcf790b\") "
Jul 20 22:52:49.375800 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:49.375660    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f82c400e-048e-4661-82ce-d60eebcf790b-maas-api-tls\") pod \"f82c400e-048e-4661-82ce-d60eebcf790b\" (UID: \"f82c400e-048e-4661-82ce-d60eebcf790b\") "
Jul 20 22:52:49.375800 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:49.375729    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f82c400e-048e-4661-82ce-d60eebcf790b-openshift-service-ca\") pod \"f82c400e-048e-4661-82ce-d60eebcf790b\" (UID: \"f82c400e-048e-4661-82ce-d60eebcf790b\") "
Jul 20 22:52:49.376084 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:49.376055    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f82c400e-048e-4661-82ce-d60eebcf790b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f82c400e-048e-4661-82ce-d60eebcf790b" (UID: "f82c400e-048e-4661-82ce-d60eebcf790b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:52:49.377737 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:49.377711    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f82c400e-048e-4661-82ce-d60eebcf790b-kube-api-access-9v2f6" (OuterVolumeSpecName: "kube-api-access-9v2f6") pod "f82c400e-048e-4661-82ce-d60eebcf790b" (UID: "f82c400e-048e-4661-82ce-d60eebcf790b"). InnerVolumeSpecName "kube-api-access-9v2f6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:52:49.377822 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:49.377764    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f82c400e-048e-4661-82ce-d60eebcf790b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f82c400e-048e-4661-82ce-d60eebcf790b" (UID: "f82c400e-048e-4661-82ce-d60eebcf790b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:52:49.476587 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:49.476545    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9v2f6\" (UniqueName: \"kubernetes.io/projected/f82c400e-048e-4661-82ce-d60eebcf790b-kube-api-access-9v2f6\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:52:49.476587 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:49.476579    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f82c400e-048e-4661-82ce-d60eebcf790b-maas-api-tls\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:52:49.476587 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:49.476589    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f82c400e-048e-4661-82ce-d60eebcf790b-openshift-service-ca\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:52:49.931531 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:49.931497    2556 generic.go:356] "Generic (PLEG): container finished" podID="f82c400e-048e-4661-82ce-d60eebcf790b" containerID="ba024627c0ac0316da4bf5bec13392979539653a446af44503955cccdeed38a0" exitCode=0
Jul 20 22:52:49.931740 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:49.931546    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679"
Jul 20 22:52:49.931740 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:49.931584    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679" event={"ID":"f82c400e-048e-4661-82ce-d60eebcf790b","Type":"ContainerDied","Data":"ba024627c0ac0316da4bf5bec13392979539653a446af44503955cccdeed38a0"}
Jul 20 22:52:49.931740 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:49.931649    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679" event={"ID":"f82c400e-048e-4661-82ce-d60eebcf790b","Type":"ContainerDied","Data":"d1fafb4e76483e03bdf3cf845223ec654eb51baf92e7c7e6bfd5b40b60f3dea7"}
Jul 20 22:52:49.931740 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:49.931671    2556 scope.go:117] "RemoveContainer" containerID="ba024627c0ac0316da4bf5bec13392979539653a446af44503955cccdeed38a0"
Jul 20 22:52:49.940750 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:49.940729    2556 scope.go:117] "RemoveContainer" containerID="ba024627c0ac0316da4bf5bec13392979539653a446af44503955cccdeed38a0"
Jul 20 22:52:49.941073 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:52:49.941054    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba024627c0ac0316da4bf5bec13392979539653a446af44503955cccdeed38a0\": container with ID starting with ba024627c0ac0316da4bf5bec13392979539653a446af44503955cccdeed38a0 not found: ID does not exist" containerID="ba024627c0ac0316da4bf5bec13392979539653a446af44503955cccdeed38a0"
Jul 20 22:52:49.941135 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:49.941082    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba024627c0ac0316da4bf5bec13392979539653a446af44503955cccdeed38a0"} err="failed to get container status \"ba024627c0ac0316da4bf5bec13392979539653a446af44503955cccdeed38a0\": rpc error: code = NotFound desc = could not find container \"ba024627c0ac0316da4bf5bec13392979539653a446af44503955cccdeed38a0\": container with ID starting with ba024627c0ac0316da4bf5bec13392979539653a446af44503955cccdeed38a0 not found: ID does not exist"
Jul 20 22:52:49.952950 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:49.952917    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679"]
Jul 20 22:52:49.954647 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:49.954623    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cf9642a2-d4b848bdd-j7679"]
Jul 20 22:52:51.206718 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:51.206683    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f82c400e-048e-4661-82ce-d60eebcf790b" path="/var/lib/kubelet/pods/f82c400e-048e-4661-82ce-d60eebcf790b/volumes"
Jul 20 22:52:58.181917 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:58.181872    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv"]
Jul 20 22:52:58.182407 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:58.182367    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f82c400e-048e-4661-82ce-d60eebcf790b" containerName="maas-api"
Jul 20 22:52:58.182407 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:58.182383    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f82c400e-048e-4661-82ce-d60eebcf790b" containerName="maas-api"
Jul 20 22:52:58.182481 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:58.182449    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f82c400e-048e-4661-82ce-d60eebcf790b" containerName="maas-api"
Jul 20 22:52:58.186779 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:58.186761    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv"
Jul 20 22:52:58.189447 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:58.189420    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-0332ce3d-serving-cert\""
Jul 20 22:52:58.200556 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:58.200526    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv"]
Jul 20 22:52:58.263131 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:58.263093    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0a07a78-95eb-4cd7-a555-7f20cf697d16-openshift-service-ca\") pod \"maas-api-e2e-derive-0332ce3d-d877995b7-rchzv\" (UID: \"c0a07a78-95eb-4cd7-a555-7f20cf697d16\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv"
Jul 20 22:52:58.263298 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:58.263160    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0a07a78-95eb-4cd7-a555-7f20cf697d16-maas-api-tls\") pod \"maas-api-e2e-derive-0332ce3d-d877995b7-rchzv\" (UID: \"c0a07a78-95eb-4cd7-a555-7f20cf697d16\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv"
Jul 20 22:52:58.263298 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:58.263181    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsfbz\" (UniqueName: \"kubernetes.io/projected/c0a07a78-95eb-4cd7-a555-7f20cf697d16-kube-api-access-fsfbz\") pod \"maas-api-e2e-derive-0332ce3d-d877995b7-rchzv\" (UID: \"c0a07a78-95eb-4cd7-a555-7f20cf697d16\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv"
Jul 20 22:52:58.364603 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:58.364523    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0a07a78-95eb-4cd7-a555-7f20cf697d16-openshift-service-ca\") pod \"maas-api-e2e-derive-0332ce3d-d877995b7-rchzv\" (UID: \"c0a07a78-95eb-4cd7-a555-7f20cf697d16\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv"
Jul 20 22:52:58.364603 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:58.364586    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0a07a78-95eb-4cd7-a555-7f20cf697d16-maas-api-tls\") pod \"maas-api-e2e-derive-0332ce3d-d877995b7-rchzv\" (UID: \"c0a07a78-95eb-4cd7-a555-7f20cf697d16\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv"
Jul 20 22:52:58.364603 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:58.364629    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsfbz\" (UniqueName: \"kubernetes.io/projected/c0a07a78-95eb-4cd7-a555-7f20cf697d16-kube-api-access-fsfbz\") pod \"maas-api-e2e-derive-0332ce3d-d877995b7-rchzv\" (UID: \"c0a07a78-95eb-4cd7-a555-7f20cf697d16\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv"
Jul 20 22:52:58.364893 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:52:58.364753    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-serving-cert: secret "maas-api-e2e-derive-0332ce3d-serving-cert" not found
Jul 20 22:52:58.364893 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:52:58.364825    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0a07a78-95eb-4cd7-a555-7f20cf697d16-maas-api-tls podName:c0a07a78-95eb-4cd7-a555-7f20cf697d16 nodeName:}" failed. No retries permitted until 2026-07-20 22:52:58.864805219 +0000 UTC m=+1792.163021773 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c0a07a78-95eb-4cd7-a555-7f20cf697d16-maas-api-tls") pod "maas-api-e2e-derive-0332ce3d-d877995b7-rchzv" (UID: "c0a07a78-95eb-4cd7-a555-7f20cf697d16") : secret "maas-api-e2e-derive-0332ce3d-serving-cert" not found
Jul 20 22:52:58.365185 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:58.365167    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0a07a78-95eb-4cd7-a555-7f20cf697d16-openshift-service-ca\") pod \"maas-api-e2e-derive-0332ce3d-d877995b7-rchzv\" (UID: \"c0a07a78-95eb-4cd7-a555-7f20cf697d16\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv"
Jul 20 22:52:58.381394 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:58.381366    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsfbz\" (UniqueName: \"kubernetes.io/projected/c0a07a78-95eb-4cd7-a555-7f20cf697d16-kube-api-access-fsfbz\") pod \"maas-api-e2e-derive-0332ce3d-d877995b7-rchzv\" (UID: \"c0a07a78-95eb-4cd7-a555-7f20cf697d16\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv"
Jul 20 22:52:58.870636 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:58.870571    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0a07a78-95eb-4cd7-a555-7f20cf697d16-maas-api-tls\") pod \"maas-api-e2e-derive-0332ce3d-d877995b7-rchzv\" (UID: \"c0a07a78-95eb-4cd7-a555-7f20cf697d16\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv"
Jul 20 22:52:58.872970 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:58.872942    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0a07a78-95eb-4cd7-a555-7f20cf697d16-maas-api-tls\") pod \"maas-api-e2e-derive-0332ce3d-d877995b7-rchzv\" (UID: \"c0a07a78-95eb-4cd7-a555-7f20cf697d16\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv"
Jul 20 22:52:59.097461 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:59.097412    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv"
Jul 20 22:52:59.238037 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:59.237888    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv"]
Jul 20 22:52:59.240945 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:52:59.240918    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0a07a78_95eb_4cd7_a555_7f20cf697d16.slice/crio-13ca2e60058e3abc5784ccb61395a2d58a131472656fc4c6db281cd904509fc1 WatchSource:0}: Error finding container 13ca2e60058e3abc5784ccb61395a2d58a131472656fc4c6db281cd904509fc1: Status 404 returned error can't find the container with id 13ca2e60058e3abc5784ccb61395a2d58a131472656fc4c6db281cd904509fc1
Jul 20 22:52:59.982090 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:59.982056    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv" event={"ID":"c0a07a78-95eb-4cd7-a555-7f20cf697d16","Type":"ContainerStarted","Data":"011538630d7d434057f24f7d74c303a4fbc5d8b1585d09f1210965a086f9d07d"}
Jul 20 22:52:59.982279 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:59.982149    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv" event={"ID":"c0a07a78-95eb-4cd7-a555-7f20cf697d16","Type":"ContainerStarted","Data":"13ca2e60058e3abc5784ccb61395a2d58a131472656fc4c6db281cd904509fc1"}
Jul 20 22:52:59.982279 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:52:59.982249    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv"
Jul 20 22:53:00.000890 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:00.000838    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv" podStartSLOduration=1.648035449 podStartE2EDuration="2.000822866s" totalImagesPullingTime="352.787417ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:52:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:52:59.999085729 +0000 UTC m=+1793.297302299" watchObservedRunningTime="2026-07-20 22:53:00.000822866 +0000 UTC m=+1793.299039465"
Jul 20 22:53:05.992384 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:05.992352    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv"
Jul 20 22:53:33.340138 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:33.340103    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv"]
Jul 20 22:53:33.340672 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:33.340338    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv" podUID="c0a07a78-95eb-4cd7-a555-7f20cf697d16" containerName="maas-api" containerID="cri-o://011538630d7d434057f24f7d74c303a4fbc5d8b1585d09f1210965a086f9d07d" gracePeriod=30
Jul 20 22:53:33.590199 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:33.590136    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv"
Jul 20 22:53:33.696211 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:33.696172    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0a07a78-95eb-4cd7-a555-7f20cf697d16-openshift-service-ca\") pod \"c0a07a78-95eb-4cd7-a555-7f20cf697d16\" (UID: \"c0a07a78-95eb-4cd7-a555-7f20cf697d16\") "
Jul 20 22:53:33.696418 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:33.696245    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0a07a78-95eb-4cd7-a555-7f20cf697d16-maas-api-tls\") pod \"c0a07a78-95eb-4cd7-a555-7f20cf697d16\" (UID: \"c0a07a78-95eb-4cd7-a555-7f20cf697d16\") "
Jul 20 22:53:33.696418 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:33.696295    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsfbz\" (UniqueName: \"kubernetes.io/projected/c0a07a78-95eb-4cd7-a555-7f20cf697d16-kube-api-access-fsfbz\") pod \"c0a07a78-95eb-4cd7-a555-7f20cf697d16\" (UID: \"c0a07a78-95eb-4cd7-a555-7f20cf697d16\") "
Jul 20 22:53:33.696576 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:33.696553    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0a07a78-95eb-4cd7-a555-7f20cf697d16-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c0a07a78-95eb-4cd7-a555-7f20cf697d16" (UID: "c0a07a78-95eb-4cd7-a555-7f20cf697d16"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:53:33.698347 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:33.698320    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0a07a78-95eb-4cd7-a555-7f20cf697d16-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c0a07a78-95eb-4cd7-a555-7f20cf697d16" (UID: "c0a07a78-95eb-4cd7-a555-7f20cf697d16"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:53:33.698451 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:33.698398    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0a07a78-95eb-4cd7-a555-7f20cf697d16-kube-api-access-fsfbz" (OuterVolumeSpecName: "kube-api-access-fsfbz") pod "c0a07a78-95eb-4cd7-a555-7f20cf697d16" (UID: "c0a07a78-95eb-4cd7-a555-7f20cf697d16"). InnerVolumeSpecName "kube-api-access-fsfbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:53:33.797876 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:33.797833    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0a07a78-95eb-4cd7-a555-7f20cf697d16-maas-api-tls\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:53:33.797876 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:33.797868    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsfbz\" (UniqueName: \"kubernetes.io/projected/c0a07a78-95eb-4cd7-a555-7f20cf697d16-kube-api-access-fsfbz\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:53:33.797876 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:33.797879    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0a07a78-95eb-4cd7-a555-7f20cf697d16-openshift-service-ca\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:53:34.150688 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:34.150652    2556 generic.go:356] "Generic (PLEG): container finished" podID="c0a07a78-95eb-4cd7-a555-7f20cf697d16" containerID="011538630d7d434057f24f7d74c303a4fbc5d8b1585d09f1210965a086f9d07d" exitCode=0
Jul 20 22:53:34.150887 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:34.150709    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv"
Jul 20 22:53:34.150887 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:34.150732    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv" event={"ID":"c0a07a78-95eb-4cd7-a555-7f20cf697d16","Type":"ContainerDied","Data":"011538630d7d434057f24f7d74c303a4fbc5d8b1585d09f1210965a086f9d07d"}
Jul 20 22:53:34.150887 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:34.150786    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv" event={"ID":"c0a07a78-95eb-4cd7-a555-7f20cf697d16","Type":"ContainerDied","Data":"13ca2e60058e3abc5784ccb61395a2d58a131472656fc4c6db281cd904509fc1"}
Jul 20 22:53:34.150887 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:34.150815    2556 scope.go:117] "RemoveContainer" containerID="011538630d7d434057f24f7d74c303a4fbc5d8b1585d09f1210965a086f9d07d"
Jul 20 22:53:34.160274 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:34.160251    2556 scope.go:117] "RemoveContainer" containerID="011538630d7d434057f24f7d74c303a4fbc5d8b1585d09f1210965a086f9d07d"
Jul 20 22:53:34.160573 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:53:34.160556    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"011538630d7d434057f24f7d74c303a4fbc5d8b1585d09f1210965a086f9d07d\": container with ID starting with 011538630d7d434057f24f7d74c303a4fbc5d8b1585d09f1210965a086f9d07d not found: ID does not exist" containerID="011538630d7d434057f24f7d74c303a4fbc5d8b1585d09f1210965a086f9d07d"
Jul 20 22:53:34.160663 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:34.160582    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"011538630d7d434057f24f7d74c303a4fbc5d8b1585d09f1210965a086f9d07d"} err="failed to get container status \"011538630d7d434057f24f7d74c303a4fbc5d8b1585d09f1210965a086f9d07d\": rpc error: code = NotFound desc = could not find container \"011538630d7d434057f24f7d74c303a4fbc5d8b1585d09f1210965a086f9d07d\": container with ID starting with 011538630d7d434057f24f7d74c303a4fbc5d8b1585d09f1210965a086f9d07d not found: ID does not exist"
Jul 20 22:53:34.172465 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:34.172427    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv"]
Jul 20 22:53:34.174249 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:34.174227    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0332ce3d-d877995b7-rchzv"]
Jul 20 22:53:35.206381 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:53:35.206349    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0a07a78-95eb-4cd7-a555-7f20cf697d16" path="/var/lib/kubelet/pods/c0a07a78-95eb-4cd7-a555-7f20cf697d16/volumes"
Jul 20 22:55:26.677217 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:26.677181    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5"]
Jul 20 22:55:26.677755 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:26.677568    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0a07a78-95eb-4cd7-a555-7f20cf697d16" containerName="maas-api"
Jul 20 22:55:26.677755 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:26.677580    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0a07a78-95eb-4cd7-a555-7f20cf697d16" containerName="maas-api"
Jul 20 22:55:26.677755 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:26.677674    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0a07a78-95eb-4cd7-a555-7f20cf697d16" containerName="maas-api"
Jul 20 22:55:26.680853 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:26.680831    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5"
Jul 20 22:55:26.682963 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:26.682937    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-36f27dea-serving-cert\""
Jul 20 22:55:26.690602 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:26.690577    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5"]
Jul 20 22:55:26.753239 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:26.753200    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b1d4956-da7c-48bf-8bcf-5e20d3800688-openshift-service-ca\") pod \"maas-api-e2e-mt-36f27dea-5cdf445646-tftz5\" (UID: \"8b1d4956-da7c-48bf-8bcf-5e20d3800688\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5"
Jul 20 22:55:26.753431 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:26.753251    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b1d4956-da7c-48bf-8bcf-5e20d3800688-maas-api-tls\") pod \"maas-api-e2e-mt-36f27dea-5cdf445646-tftz5\" (UID: \"8b1d4956-da7c-48bf-8bcf-5e20d3800688\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5"
Jul 20 22:55:26.753431 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:26.753332    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct7gt\" (UniqueName: \"kubernetes.io/projected/8b1d4956-da7c-48bf-8bcf-5e20d3800688-kube-api-access-ct7gt\") pod \"maas-api-e2e-mt-36f27dea-5cdf445646-tftz5\" (UID: \"8b1d4956-da7c-48bf-8bcf-5e20d3800688\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5"
Jul 20 22:55:26.854154 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:26.854116    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b1d4956-da7c-48bf-8bcf-5e20d3800688-openshift-service-ca\") pod \"maas-api-e2e-mt-36f27dea-5cdf445646-tftz5\" (UID: \"8b1d4956-da7c-48bf-8bcf-5e20d3800688\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5"
Jul 20 22:55:26.854365 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:26.854169    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b1d4956-da7c-48bf-8bcf-5e20d3800688-maas-api-tls\") pod \"maas-api-e2e-mt-36f27dea-5cdf445646-tftz5\" (UID: \"8b1d4956-da7c-48bf-8bcf-5e20d3800688\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5"
Jul 20 22:55:26.854365 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:26.854193    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct7gt\" (UniqueName: \"kubernetes.io/projected/8b1d4956-da7c-48bf-8bcf-5e20d3800688-kube-api-access-ct7gt\") pod \"maas-api-e2e-mt-36f27dea-5cdf445646-tftz5\" (UID: \"8b1d4956-da7c-48bf-8bcf-5e20d3800688\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5"
Jul 20 22:55:26.854365 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:55:26.854355    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-serving-cert: secret "maas-api-e2e-mt-36f27dea-serving-cert" not found
Jul 20 22:55:26.854545 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:55:26.854416    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b1d4956-da7c-48bf-8bcf-5e20d3800688-maas-api-tls podName:8b1d4956-da7c-48bf-8bcf-5e20d3800688 nodeName:}" failed. No retries permitted until 2026-07-20 22:55:27.354399114 +0000 UTC m=+1940.652615668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8b1d4956-da7c-48bf-8bcf-5e20d3800688-maas-api-tls") pod "maas-api-e2e-mt-36f27dea-5cdf445646-tftz5" (UID: "8b1d4956-da7c-48bf-8bcf-5e20d3800688") : secret "maas-api-e2e-mt-36f27dea-serving-cert" not found
Jul 20 22:55:26.854898 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:26.854876    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b1d4956-da7c-48bf-8bcf-5e20d3800688-openshift-service-ca\") pod \"maas-api-e2e-mt-36f27dea-5cdf445646-tftz5\" (UID: \"8b1d4956-da7c-48bf-8bcf-5e20d3800688\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5"
Jul 20 22:55:26.865845 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:26.865821    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct7gt\" (UniqueName: \"kubernetes.io/projected/8b1d4956-da7c-48bf-8bcf-5e20d3800688-kube-api-access-ct7gt\") pod \"maas-api-e2e-mt-36f27dea-5cdf445646-tftz5\" (UID: \"8b1d4956-da7c-48bf-8bcf-5e20d3800688\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5"
Jul 20 22:55:27.359229 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:27.359193    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b1d4956-da7c-48bf-8bcf-5e20d3800688-maas-api-tls\") pod \"maas-api-e2e-mt-36f27dea-5cdf445646-tftz5\" (UID: \"8b1d4956-da7c-48bf-8bcf-5e20d3800688\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5"
Jul 20 22:55:27.361785 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:27.361758    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b1d4956-da7c-48bf-8bcf-5e20d3800688-maas-api-tls\") pod \"maas-api-e2e-mt-36f27dea-5cdf445646-tftz5\" (UID: \"8b1d4956-da7c-48bf-8bcf-5e20d3800688\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5"
Jul 20 22:55:27.593172 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:27.593128    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5"
Jul 20 22:55:27.735305 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:27.735279    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5"]
Jul 20 22:55:27.738116 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:55:27.738087    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b1d4956_da7c_48bf_8bcf_5e20d3800688.slice/crio-86f3a79a83cc0da257996cbaad30b4440ff09e3e3c532e7e4a70c60236412ff2 WatchSource:0}: Error finding container 86f3a79a83cc0da257996cbaad30b4440ff09e3e3c532e7e4a70c60236412ff2: Status 404 returned error can't find the container with id 86f3a79a83cc0da257996cbaad30b4440ff09e3e3c532e7e4a70c60236412ff2
Jul 20 22:55:28.717032 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:28.716986    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5" event={"ID":"8b1d4956-da7c-48bf-8bcf-5e20d3800688","Type":"ContainerStarted","Data":"47e21b872b78c9743e48a6c9ef3cc823d3917d4b8fd71861bc4da56dd3e03468"}
Jul 20 22:55:28.717244 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:28.717107    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5"
Jul 20 22:55:28.717244 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:28.717170    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5" event={"ID":"8b1d4956-da7c-48bf-8bcf-5e20d3800688","Type":"ContainerStarted","Data":"86f3a79a83cc0da257996cbaad30b4440ff09e3e3c532e7e4a70c60236412ff2"}
Jul 20 22:55:28.736361 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:28.736300    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5" podStartSLOduration=2.345004438 podStartE2EDuration="2.736284105s" totalImagesPullingTime="391.279667ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:55:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:55:28.73496831 +0000 UTC m=+1942.033184881" watchObservedRunningTime="2026-07-20 22:55:28.736284105 +0000 UTC m=+1942.034500676"
Jul 20 22:55:34.728482 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:34.728452    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5"
Jul 20 22:55:48.814145 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:48.814103    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5"]
Jul 20 22:55:48.815585 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:48.814332    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5" podUID="8b1d4956-da7c-48bf-8bcf-5e20d3800688" containerName="maas-api" containerID="cri-o://47e21b872b78c9743e48a6c9ef3cc823d3917d4b8fd71861bc4da56dd3e03468" gracePeriod=30
Jul 20 22:55:49.070972 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:49.070910    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5"
Jul 20 22:55:49.164924 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:49.164890    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b1d4956-da7c-48bf-8bcf-5e20d3800688-maas-api-tls\") pod \"8b1d4956-da7c-48bf-8bcf-5e20d3800688\" (UID: \"8b1d4956-da7c-48bf-8bcf-5e20d3800688\") "
Jul 20 22:55:49.165109 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:49.164967    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b1d4956-da7c-48bf-8bcf-5e20d3800688-openshift-service-ca\") pod \"8b1d4956-da7c-48bf-8bcf-5e20d3800688\" (UID: \"8b1d4956-da7c-48bf-8bcf-5e20d3800688\") "
Jul 20 22:55:49.165109 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:49.164985    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct7gt\" (UniqueName: \"kubernetes.io/projected/8b1d4956-da7c-48bf-8bcf-5e20d3800688-kube-api-access-ct7gt\") pod \"8b1d4956-da7c-48bf-8bcf-5e20d3800688\" (UID: \"8b1d4956-da7c-48bf-8bcf-5e20d3800688\") "
Jul 20 22:55:49.165381 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:49.165354    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b1d4956-da7c-48bf-8bcf-5e20d3800688-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8b1d4956-da7c-48bf-8bcf-5e20d3800688" (UID: "8b1d4956-da7c-48bf-8bcf-5e20d3800688"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:55:49.167148 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:49.167122    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b1d4956-da7c-48bf-8bcf-5e20d3800688-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8b1d4956-da7c-48bf-8bcf-5e20d3800688" (UID: "8b1d4956-da7c-48bf-8bcf-5e20d3800688"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:55:49.167253 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:49.167181    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b1d4956-da7c-48bf-8bcf-5e20d3800688-kube-api-access-ct7gt" (OuterVolumeSpecName: "kube-api-access-ct7gt") pod "8b1d4956-da7c-48bf-8bcf-5e20d3800688" (UID: "8b1d4956-da7c-48bf-8bcf-5e20d3800688"). InnerVolumeSpecName "kube-api-access-ct7gt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:55:49.265941 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:49.265901    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b1d4956-da7c-48bf-8bcf-5e20d3800688-openshift-service-ca\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:55:49.265941 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:49.265932    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct7gt\" (UniqueName: \"kubernetes.io/projected/8b1d4956-da7c-48bf-8bcf-5e20d3800688-kube-api-access-ct7gt\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:55:49.265941 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:49.265945    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b1d4956-da7c-48bf-8bcf-5e20d3800688-maas-api-tls\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:55:49.819016 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:49.818980    2556 generic.go:356] "Generic (PLEG): container finished" podID="8b1d4956-da7c-48bf-8bcf-5e20d3800688" containerID="47e21b872b78c9743e48a6c9ef3cc823d3917d4b8fd71861bc4da56dd3e03468" exitCode=0
Jul 20 22:55:49.819528 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:49.819028    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5"
Jul 20 22:55:49.819528 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:49.819072    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5" event={"ID":"8b1d4956-da7c-48bf-8bcf-5e20d3800688","Type":"ContainerDied","Data":"47e21b872b78c9743e48a6c9ef3cc823d3917d4b8fd71861bc4da56dd3e03468"}
Jul 20 22:55:49.819528 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:49.819142    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5" event={"ID":"8b1d4956-da7c-48bf-8bcf-5e20d3800688","Type":"ContainerDied","Data":"86f3a79a83cc0da257996cbaad30b4440ff09e3e3c532e7e4a70c60236412ff2"}
Jul 20 22:55:49.819528 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:49.819181    2556 scope.go:117] "RemoveContainer" containerID="47e21b872b78c9743e48a6c9ef3cc823d3917d4b8fd71861bc4da56dd3e03468"
Jul 20 22:55:49.828834 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:49.828805    2556 scope.go:117] "RemoveContainer" containerID="47e21b872b78c9743e48a6c9ef3cc823d3917d4b8fd71861bc4da56dd3e03468"
Jul 20 22:55:49.829099 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:55:49.829079    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47e21b872b78c9743e48a6c9ef3cc823d3917d4b8fd71861bc4da56dd3e03468\": container with ID starting with 47e21b872b78c9743e48a6c9ef3cc823d3917d4b8fd71861bc4da56dd3e03468 not found: ID does not exist" containerID="47e21b872b78c9743e48a6c9ef3cc823d3917d4b8fd71861bc4da56dd3e03468"
Jul 20 22:55:49.829151 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:49.829107    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47e21b872b78c9743e48a6c9ef3cc823d3917d4b8fd71861bc4da56dd3e03468"} err="failed to get container status \"47e21b872b78c9743e48a6c9ef3cc823d3917d4b8fd71861bc4da56dd3e03468\": rpc error: code = NotFound desc = could not find container \"47e21b872b78c9743e48a6c9ef3cc823d3917d4b8fd71861bc4da56dd3e03468\": container with ID starting with 47e21b872b78c9743e48a6c9ef3cc823d3917d4b8fd71861bc4da56dd3e03468 not found: ID does not exist"
Jul 20 22:55:49.836541 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:49.836516    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5"]
Jul 20 22:55:49.843335 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:49.843314    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-36f27dea-5cdf445646-tftz5"]
Jul 20 22:55:51.207028 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:55:51.206994    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b1d4956-da7c-48bf-8bcf-5e20d3800688" path="/var/lib/kubelet/pods/8b1d4956-da7c-48bf-8bcf-5e20d3800688/volumes"
Jul 20 22:56:22.799830 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:22.799797    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s"]
Jul 20 22:56:22.800276 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:22.800184    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b1d4956-da7c-48bf-8bcf-5e20d3800688" containerName="maas-api"
Jul 20 22:56:22.800276 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:22.800194    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b1d4956-da7c-48bf-8bcf-5e20d3800688" containerName="maas-api"
Jul 20 22:56:22.800276 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:22.800249    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b1d4956-da7c-48bf-8bcf-5e20d3800688" containerName="maas-api"
Jul 20 22:56:22.802964 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:22.802947    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s"
Jul 20 22:56:22.805326 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:22.805308    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5418bc43-serving-cert\""
Jul 20 22:56:22.812807 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:22.812775    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s"]
Jul 20 22:56:22.883236 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:22.883205    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5feca1b9-0de3-4925-a244-2e50941eee2d-openshift-service-ca\") pod \"maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s\" (UID: \"5feca1b9-0de3-4925-a244-2e50941eee2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s"
Jul 20 22:56:22.883236 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:22.883246    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5feca1b9-0de3-4925-a244-2e50941eee2d-maas-api-tls\") pod \"maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s\" (UID: \"5feca1b9-0de3-4925-a244-2e50941eee2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s"
Jul 20 22:56:22.883484 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:22.883397    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r966w\" (UniqueName: \"kubernetes.io/projected/5feca1b9-0de3-4925-a244-2e50941eee2d-kube-api-access-r966w\") pod \"maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s\" (UID: \"5feca1b9-0de3-4925-a244-2e50941eee2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s"
Jul 20 22:56:22.984695 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:22.984667    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r966w\" (UniqueName: \"kubernetes.io/projected/5feca1b9-0de3-4925-a244-2e50941eee2d-kube-api-access-r966w\") pod \"maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s\" (UID: \"5feca1b9-0de3-4925-a244-2e50941eee2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s"
Jul 20 22:56:22.984884 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:22.984725    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5feca1b9-0de3-4925-a244-2e50941eee2d-openshift-service-ca\") pod \"maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s\" (UID: \"5feca1b9-0de3-4925-a244-2e50941eee2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s"
Jul 20 22:56:22.984884 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:22.984755    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5feca1b9-0de3-4925-a244-2e50941eee2d-maas-api-tls\") pod \"maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s\" (UID: \"5feca1b9-0de3-4925-a244-2e50941eee2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s"
Jul 20 22:56:22.985407 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:22.985381    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5feca1b9-0de3-4925-a244-2e50941eee2d-openshift-service-ca\") pod \"maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s\" (UID: \"5feca1b9-0de3-4925-a244-2e50941eee2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s"
Jul 20 22:56:22.987298 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:22.987273    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5feca1b9-0de3-4925-a244-2e50941eee2d-maas-api-tls\") pod \"maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s\" (UID: \"5feca1b9-0de3-4925-a244-2e50941eee2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s"
Jul 20 22:56:22.992971 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:22.992950    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r966w\" (UniqueName: \"kubernetes.io/projected/5feca1b9-0de3-4925-a244-2e50941eee2d-kube-api-access-r966w\") pod \"maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s\" (UID: \"5feca1b9-0de3-4925-a244-2e50941eee2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s"
Jul 20 22:56:23.115345 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:23.115262    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s"
Jul 20 22:56:23.252128 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:23.252101    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s"]
Jul 20 22:56:23.254093 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:56:23.254068    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5feca1b9_0de3_4925_a244_2e50941eee2d.slice/crio-54db5d5594f900f461f3b82c1d101b20bdbccaef330358bd0c6466dd24ced811 WatchSource:0}: Error finding container 54db5d5594f900f461f3b82c1d101b20bdbccaef330358bd0c6466dd24ced811: Status 404 returned error can't find the container with id 54db5d5594f900f461f3b82c1d101b20bdbccaef330358bd0c6466dd24ced811
Jul 20 22:56:23.255435 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:23.255422    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 22:56:23.991774 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:23.991740    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s" event={"ID":"5feca1b9-0de3-4925-a244-2e50941eee2d","Type":"ContainerStarted","Data":"09ddd42b437690d6e572cd93b14242fbd5ab407c808a2e87816afb27066f7618"}
Jul 20 22:56:23.992205 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:23.991803    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s" event={"ID":"5feca1b9-0de3-4925-a244-2e50941eee2d","Type":"ContainerStarted","Data":"54db5d5594f900f461f3b82c1d101b20bdbccaef330358bd0c6466dd24ced811"}
Jul 20 22:56:23.992205 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:23.991854    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s"
Jul 20 22:56:24.012482 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:24.012410    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s" podStartSLOduration=1.687194541 podStartE2EDuration="2.012386687s" totalImagesPullingTime="325.192146ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:56:24.012331954 +0000 UTC m=+1997.310548550" watchObservedRunningTime="2026-07-20 22:56:24.012386687 +0000 UTC m=+1997.310603258"
Jul 20 22:56:30.001914 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:56:30.001889    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s"
Jul 20 22:57:15.879397 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:57:15.879363    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s"]
Jul 20 22:57:15.879982 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:57:15.879654    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s" podUID="5feca1b9-0de3-4925-a244-2e50941eee2d" containerName="maas-api" containerID="cri-o://09ddd42b437690d6e572cd93b14242fbd5ab407c808a2e87816afb27066f7618" gracePeriod=30
Jul 20 22:57:16.128016 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:57:16.127988    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s"
Jul 20 22:57:16.204254 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:57:16.204221    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r966w\" (UniqueName: \"kubernetes.io/projected/5feca1b9-0de3-4925-a244-2e50941eee2d-kube-api-access-r966w\") pod \"5feca1b9-0de3-4925-a244-2e50941eee2d\" (UID: \"5feca1b9-0de3-4925-a244-2e50941eee2d\") "
Jul 20 22:57:16.204429 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:57:16.204313    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5feca1b9-0de3-4925-a244-2e50941eee2d-openshift-service-ca\") pod \"5feca1b9-0de3-4925-a244-2e50941eee2d\" (UID: \"5feca1b9-0de3-4925-a244-2e50941eee2d\") "
Jul 20 22:57:16.204429 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:57:16.204338    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5feca1b9-0de3-4925-a244-2e50941eee2d-maas-api-tls\") pod \"5feca1b9-0de3-4925-a244-2e50941eee2d\" (UID: \"5feca1b9-0de3-4925-a244-2e50941eee2d\") "
Jul 20 22:57:16.204746 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:57:16.204714    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5feca1b9-0de3-4925-a244-2e50941eee2d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5feca1b9-0de3-4925-a244-2e50941eee2d" (UID: "5feca1b9-0de3-4925-a244-2e50941eee2d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:57:16.206321 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:57:16.206300    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5feca1b9-0de3-4925-a244-2e50941eee2d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5feca1b9-0de3-4925-a244-2e50941eee2d" (UID: "5feca1b9-0de3-4925-a244-2e50941eee2d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:57:16.206397 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:57:16.206311    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5feca1b9-0de3-4925-a244-2e50941eee2d-kube-api-access-r966w" (OuterVolumeSpecName: "kube-api-access-r966w") pod "5feca1b9-0de3-4925-a244-2e50941eee2d" (UID: "5feca1b9-0de3-4925-a244-2e50941eee2d"). InnerVolumeSpecName "kube-api-access-r966w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:57:16.245461 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:57:16.245426    2556 generic.go:356] "Generic (PLEG): container finished" podID="5feca1b9-0de3-4925-a244-2e50941eee2d" containerID="09ddd42b437690d6e572cd93b14242fbd5ab407c808a2e87816afb27066f7618" exitCode=0
Jul 20 22:57:16.245681 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:57:16.245470    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s"
Jul 20 22:57:16.245681 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:57:16.245520    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s" event={"ID":"5feca1b9-0de3-4925-a244-2e50941eee2d","Type":"ContainerDied","Data":"09ddd42b437690d6e572cd93b14242fbd5ab407c808a2e87816afb27066f7618"}
Jul 20 22:57:16.245681 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:57:16.245575    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s" event={"ID":"5feca1b9-0de3-4925-a244-2e50941eee2d","Type":"ContainerDied","Data":"54db5d5594f900f461f3b82c1d101b20bdbccaef330358bd0c6466dd24ced811"}
Jul 20 22:57:16.245681 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:57:16.245601    2556 scope.go:117] "RemoveContainer" containerID="09ddd42b437690d6e572cd93b14242fbd5ab407c808a2e87816afb27066f7618"
Jul 20 22:57:16.254925 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:57:16.254907    2556 scope.go:117] "RemoveContainer" containerID="09ddd42b437690d6e572cd93b14242fbd5ab407c808a2e87816afb27066f7618"
Jul 20 22:57:16.255220 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:57:16.255199    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09ddd42b437690d6e572cd93b14242fbd5ab407c808a2e87816afb27066f7618\": container with ID starting with 09ddd42b437690d6e572cd93b14242fbd5ab407c808a2e87816afb27066f7618 not found: ID does not exist" containerID="09ddd42b437690d6e572cd93b14242fbd5ab407c808a2e87816afb27066f7618"
Jul 20 22:57:16.255280 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:57:16.255229    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09ddd42b437690d6e572cd93b14242fbd5ab407c808a2e87816afb27066f7618"} err="failed to get container status \"09ddd42b437690d6e572cd93b14242fbd5ab407c808a2e87816afb27066f7618\": rpc error: code = NotFound desc = could not find container \"09ddd42b437690d6e572cd93b14242fbd5ab407c808a2e87816afb27066f7618\": container with ID starting with 09ddd42b437690d6e572cd93b14242fbd5ab407c808a2e87816afb27066f7618 not found: ID does not exist"
Jul 20 22:57:16.267101 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:57:16.267074    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s"]
Jul 20 22:57:16.271088 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:57:16.271062    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5418bc43-75d7b676bd-jbr5s"]
Jul 20 22:57:16.305711 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:57:16.305678    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r966w\" (UniqueName: \"kubernetes.io/projected/5feca1b9-0de3-4925-a244-2e50941eee2d-kube-api-access-r966w\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:57:16.305711 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:57:16.305704    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5feca1b9-0de3-4925-a244-2e50941eee2d-openshift-service-ca\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:57:16.305897 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:57:16.305719    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5feca1b9-0de3-4925-a244-2e50941eee2d-maas-api-tls\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 22:57:17.206347 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:57:17.206314    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5feca1b9-0de3-4925-a244-2e50941eee2d" path="/var/lib/kubelet/pods/5feca1b9-0de3-4925-a244-2e50941eee2d/volumes"
Jul 20 22:59:10.777003 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:10.776921    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn"]
Jul 20 22:59:10.777475 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:10.777334    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5feca1b9-0de3-4925-a244-2e50941eee2d" containerName="maas-api"
Jul 20 22:59:10.777475 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:10.777346    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5feca1b9-0de3-4925-a244-2e50941eee2d" containerName="maas-api"
Jul 20 22:59:10.777475 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:10.777403    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5feca1b9-0de3-4925-a244-2e50941eee2d" containerName="maas-api"
Jul 20 22:59:10.780446 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:10.780430    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn"
Jul 20 22:59:10.782758 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:10.782734    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-222578-serving-cert\""
Jul 20 22:59:10.793635 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:10.793588    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn"]
Jul 20 22:59:10.899559 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:10.899521    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6446f3-b0fb-44e9-8fd7-2f5145056092-maas-api-tls\") pod \"maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn\" (UID: \"4b6446f3-b0fb-44e9-8fd7-2f5145056092\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn"
Jul 20 22:59:10.899766 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:10.899569    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b6446f3-b0fb-44e9-8fd7-2f5145056092-openshift-service-ca\") pod \"maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn\" (UID: \"4b6446f3-b0fb-44e9-8fd7-2f5145056092\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn"
Jul 20 22:59:10.899766 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:10.899676    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bws9m\" (UniqueName: \"kubernetes.io/projected/4b6446f3-b0fb-44e9-8fd7-2f5145056092-kube-api-access-bws9m\") pod \"maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn\" (UID: \"4b6446f3-b0fb-44e9-8fd7-2f5145056092\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn"
Jul 20 22:59:11.000695 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:11.000661    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bws9m\" (UniqueName: \"kubernetes.io/projected/4b6446f3-b0fb-44e9-8fd7-2f5145056092-kube-api-access-bws9m\") pod \"maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn\" (UID: \"4b6446f3-b0fb-44e9-8fd7-2f5145056092\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn"
Jul 20 22:59:11.000914 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:11.000744    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6446f3-b0fb-44e9-8fd7-2f5145056092-maas-api-tls\") pod \"maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn\" (UID: \"4b6446f3-b0fb-44e9-8fd7-2f5145056092\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn"
Jul 20 22:59:11.000914 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:11.000769    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b6446f3-b0fb-44e9-8fd7-2f5145056092-openshift-service-ca\") pod \"maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn\" (UID: \"4b6446f3-b0fb-44e9-8fd7-2f5145056092\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn"
Jul 20 22:59:11.000914 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:59:11.000893    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-serving-cert: secret "maas-api-e2e-inf-a-222578-serving-cert" not found
Jul 20 22:59:11.001093 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:59:11.000973    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b6446f3-b0fb-44e9-8fd7-2f5145056092-maas-api-tls podName:4b6446f3-b0fb-44e9-8fd7-2f5145056092 nodeName:}" failed. No retries permitted until 2026-07-20 22:59:11.500954753 +0000 UTC m=+2164.799171303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4b6446f3-b0fb-44e9-8fd7-2f5145056092-maas-api-tls") pod "maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn" (UID: "4b6446f3-b0fb-44e9-8fd7-2f5145056092") : secret "maas-api-e2e-inf-a-222578-serving-cert" not found
Jul 20 22:59:11.001348 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:11.001330    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b6446f3-b0fb-44e9-8fd7-2f5145056092-openshift-service-ca\") pod \"maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn\" (UID: \"4b6446f3-b0fb-44e9-8fd7-2f5145056092\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn"
Jul 20 22:59:11.012227 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:11.012201    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bws9m\" (UniqueName: \"kubernetes.io/projected/4b6446f3-b0fb-44e9-8fd7-2f5145056092-kube-api-access-bws9m\") pod \"maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn\" (UID: \"4b6446f3-b0fb-44e9-8fd7-2f5145056092\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn"
Jul 20 22:59:11.505284 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:11.505249    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6446f3-b0fb-44e9-8fd7-2f5145056092-maas-api-tls\") pod \"maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn\" (UID: \"4b6446f3-b0fb-44e9-8fd7-2f5145056092\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn"
Jul 20 22:59:11.505473 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:59:11.505414    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-serving-cert: secret "maas-api-e2e-inf-a-222578-serving-cert" not found
Jul 20 22:59:11.505527 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:59:11.505492    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b6446f3-b0fb-44e9-8fd7-2f5145056092-maas-api-tls podName:4b6446f3-b0fb-44e9-8fd7-2f5145056092 nodeName:}" failed. No retries permitted until 2026-07-20 22:59:12.50547192 +0000 UTC m=+2165.803688467 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4b6446f3-b0fb-44e9-8fd7-2f5145056092-maas-api-tls") pod "maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn" (UID: "4b6446f3-b0fb-44e9-8fd7-2f5145056092") : secret "maas-api-e2e-inf-a-222578-serving-cert" not found
Jul 20 22:59:12.513374 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:12.513317    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6446f3-b0fb-44e9-8fd7-2f5145056092-maas-api-tls\") pod \"maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn\" (UID: \"4b6446f3-b0fb-44e9-8fd7-2f5145056092\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn"
Jul 20 22:59:12.515866 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:12.515839    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6446f3-b0fb-44e9-8fd7-2f5145056092-maas-api-tls\") pod \"maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn\" (UID: \"4b6446f3-b0fb-44e9-8fd7-2f5145056092\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn"
Jul 20 22:59:12.590467 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:12.590425    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn"
Jul 20 22:59:12.731156 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:12.731122    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn"]
Jul 20 22:59:12.734802 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:59:12.734776    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6446f3_b0fb_44e9_8fd7_2f5145056092.slice/crio-8faac79d6f7bf5516a9cff3536f036b434626334248426ccd12dcc572da96bee WatchSource:0}: Error finding container 8faac79d6f7bf5516a9cff3536f036b434626334248426ccd12dcc572da96bee: Status 404 returned error can't find the container with id 8faac79d6f7bf5516a9cff3536f036b434626334248426ccd12dcc572da96bee
Jul 20 22:59:12.805689 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:12.805567    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn" event={"ID":"4b6446f3-b0fb-44e9-8fd7-2f5145056092","Type":"ContainerStarted","Data":"8faac79d6f7bf5516a9cff3536f036b434626334248426ccd12dcc572da96bee"}
Jul 20 22:59:13.812204 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:13.812169    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn" event={"ID":"4b6446f3-b0fb-44e9-8fd7-2f5145056092","Type":"ContainerStarted","Data":"9c703d7cb68858d0250d320d06db818ef368b0cdaf7dc0d0c48d30393af8f329"}
Jul 20 22:59:13.812637 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:13.812249    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn"
Jul 20 22:59:13.830392 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:13.830335    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn" podStartSLOduration=3.28658446 podStartE2EDuration="3.830318693s" totalImagesPullingTime="543.734233ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:59:13.828073209 +0000 UTC m=+2167.126289780" watchObservedRunningTime="2026-07-20 22:59:13.830318693 +0000 UTC m=+2167.128535308"
Jul 20 22:59:18.989409 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:18.989376    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7"]
Jul 20 22:59:18.993136 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:18.993119    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7"
Jul 20 22:59:18.995485 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:18.995465    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-35607f-serving-cert\""
Jul 20 22:59:19.005094 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:19.005071    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7"]
Jul 20 22:59:19.075691 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:19.075649    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e06674f-ed9c-4775-add7-551dc0f026bd-maas-api-tls\") pod \"maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7\" (UID: \"9e06674f-ed9c-4775-add7-551dc0f026bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7"
Jul 20 22:59:19.075909 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:19.075714    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vtpj\" (UniqueName: \"kubernetes.io/projected/9e06674f-ed9c-4775-add7-551dc0f026bd-kube-api-access-9vtpj\") pod \"maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7\" (UID: \"9e06674f-ed9c-4775-add7-551dc0f026bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7"
Jul 20 22:59:19.075909 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:19.075819    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e06674f-ed9c-4775-add7-551dc0f026bd-openshift-service-ca\") pod \"maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7\" (UID: \"9e06674f-ed9c-4775-add7-551dc0f026bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7"
Jul 20 22:59:19.176648 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:19.176563    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vtpj\" (UniqueName: \"kubernetes.io/projected/9e06674f-ed9c-4775-add7-551dc0f026bd-kube-api-access-9vtpj\") pod \"maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7\" (UID: \"9e06674f-ed9c-4775-add7-551dc0f026bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7"
Jul 20 22:59:19.176877 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:19.176684    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e06674f-ed9c-4775-add7-551dc0f026bd-openshift-service-ca\") pod \"maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7\" (UID: \"9e06674f-ed9c-4775-add7-551dc0f026bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7"
Jul 20 22:59:19.176877 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:19.176759    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e06674f-ed9c-4775-add7-551dc0f026bd-maas-api-tls\") pod \"maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7\" (UID: \"9e06674f-ed9c-4775-add7-551dc0f026bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7"
Jul 20 22:59:19.177001 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:59:19.176886    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-serving-cert: secret "maas-api-e2e-inf-b-35607f-serving-cert" not found
Jul 20 22:59:19.177001 ip-10-0-133-74 kubenswrapper[2556]: E0720 22:59:19.176945    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e06674f-ed9c-4775-add7-551dc0f026bd-maas-api-tls podName:9e06674f-ed9c-4775-add7-551dc0f026bd nodeName:}" failed. No retries permitted until 2026-07-20 22:59:19.676929719 +0000 UTC m=+2172.975146267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9e06674f-ed9c-4775-add7-551dc0f026bd-maas-api-tls") pod "maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7" (UID: "9e06674f-ed9c-4775-add7-551dc0f026bd") : secret "maas-api-e2e-inf-b-35607f-serving-cert" not found
Jul 20 22:59:19.177319 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:19.177301    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e06674f-ed9c-4775-add7-551dc0f026bd-openshift-service-ca\") pod \"maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7\" (UID: \"9e06674f-ed9c-4775-add7-551dc0f026bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7"
Jul 20 22:59:19.185263 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:19.185233    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vtpj\" (UniqueName: \"kubernetes.io/projected/9e06674f-ed9c-4775-add7-551dc0f026bd-kube-api-access-9vtpj\") pod \"maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7\" (UID: \"9e06674f-ed9c-4775-add7-551dc0f026bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7"
Jul 20 22:59:19.681757 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:19.681720    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e06674f-ed9c-4775-add7-551dc0f026bd-maas-api-tls\") pod \"maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7\" (UID: \"9e06674f-ed9c-4775-add7-551dc0f026bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7"
Jul 20 22:59:19.684302 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:19.684275    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e06674f-ed9c-4775-add7-551dc0f026bd-maas-api-tls\") pod \"maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7\" (UID: \"9e06674f-ed9c-4775-add7-551dc0f026bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7"
Jul 20 22:59:19.822433 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:19.822402    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn"
Jul 20 22:59:19.905800 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:19.905769    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7"
Jul 20 22:59:20.049793 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:20.049767    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7"]
Jul 20 22:59:20.052569 ip-10-0-133-74 kubenswrapper[2556]: W0720 22:59:20.052539    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e06674f_ed9c_4775_add7_551dc0f026bd.slice/crio-e3f1b47501ecc59ad414a507a77ce9a83d42dcec7daf8e5c7eee5967dfbb0e75 WatchSource:0}: Error finding container e3f1b47501ecc59ad414a507a77ce9a83d42dcec7daf8e5c7eee5967dfbb0e75: Status 404 returned error can't find the container with id e3f1b47501ecc59ad414a507a77ce9a83d42dcec7daf8e5c7eee5967dfbb0e75
Jul 20 22:59:20.850130 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:20.850093    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7" event={"ID":"9e06674f-ed9c-4775-add7-551dc0f026bd","Type":"ContainerStarted","Data":"c2cb5a8001312842bf187dbdeeded636f2304b3f45c1d8241b3aa3b469f9aca3"}
Jul 20 22:59:20.850314 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:20.850154    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7" event={"ID":"9e06674f-ed9c-4775-add7-551dc0f026bd","Type":"ContainerStarted","Data":"e3f1b47501ecc59ad414a507a77ce9a83d42dcec7daf8e5c7eee5967dfbb0e75"}
Jul 20 22:59:20.850314 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:20.850181    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7"
Jul 20 22:59:20.867624 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:20.867571    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7" podStartSLOduration=2.5058541610000002 podStartE2EDuration="2.867554682s" totalImagesPullingTime="361.700521ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:59:20.866070588 +0000 UTC m=+2174.164287160" watchObservedRunningTime="2026-07-20 22:59:20.867554682 +0000 UTC m=+2174.165771252"
Jul 20 22:59:26.863310 ip-10-0-133-74 kubenswrapper[2556]: I0720 22:59:26.863281    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7"
Jul 20 23:00:06.595782 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.595741    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"]
Jul 20 23:00:06.600257 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.600233    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:06.602697 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.602665    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-35607f\"/\"kube-root-ca.crt\""
Jul 20 23:00:06.604686 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.603963    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-35607f\"/\"openshift-service-ca.crt\""
Jul 20 23:00:06.604686 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.604067    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-35607f\"/\"default-dockercfg-xvfx8\""
Jul 20 23:00:06.604686 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.603994    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-35607f\"/\"test-model-35607f-kserve-self-signed-certs\""
Jul 20 23:00:06.606518 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.606489    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"]
Jul 20 23:00:06.634366 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.634326    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-home\") pod \"test-model-35607f-kserve-6ffcbf74c-m7q6w\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") " pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:06.634366 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.634368    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-model-cache\") pod \"test-model-35607f-kserve-6ffcbf74c-m7q6w\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") " pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:06.634596 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.634387    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-tls-certs\") pod \"test-model-35607f-kserve-6ffcbf74c-m7q6w\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") " pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:06.634596 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.634454    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-tmp-dir\") pod \"test-model-35607f-kserve-6ffcbf74c-m7q6w\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") " pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:06.634596 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.634489    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-dshm\") pod \"test-model-35607f-kserve-6ffcbf74c-m7q6w\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") " pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:06.634596 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.634527    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfhtr\" (UniqueName: \"kubernetes.io/projected/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-kube-api-access-hfhtr\") pod \"test-model-35607f-kserve-6ffcbf74c-m7q6w\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") " pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:06.735407 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.735368    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-dshm\") pod \"test-model-35607f-kserve-6ffcbf74c-m7q6w\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") " pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:06.735596 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.735459    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfhtr\" (UniqueName: \"kubernetes.io/projected/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-kube-api-access-hfhtr\") pod \"test-model-35607f-kserve-6ffcbf74c-m7q6w\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") " pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:06.735684 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.735589    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-home\") pod \"test-model-35607f-kserve-6ffcbf74c-m7q6w\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") " pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:06.735684 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.735647    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-model-cache\") pod \"test-model-35607f-kserve-6ffcbf74c-m7q6w\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") " pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:06.735684 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.735663    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-tls-certs\") pod \"test-model-35607f-kserve-6ffcbf74c-m7q6w\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") " pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:06.735824 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.735740    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-tmp-dir\") pod \"test-model-35607f-kserve-6ffcbf74c-m7q6w\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") " pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:06.736019 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.735993    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-model-cache\") pod \"test-model-35607f-kserve-6ffcbf74c-m7q6w\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") " pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:06.736182 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.735992    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-home\") pod \"test-model-35607f-kserve-6ffcbf74c-m7q6w\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") " pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:06.736182 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.736035    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-tmp-dir\") pod \"test-model-35607f-kserve-6ffcbf74c-m7q6w\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") " pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:06.737811 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.737792    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-dshm\") pod \"test-model-35607f-kserve-6ffcbf74c-m7q6w\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") " pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:06.738064 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.738048    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-tls-certs\") pod \"test-model-35607f-kserve-6ffcbf74c-m7q6w\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") " pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:06.743656 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.743597    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfhtr\" (UniqueName: \"kubernetes.io/projected/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-kube-api-access-hfhtr\") pod \"test-model-35607f-kserve-6ffcbf74c-m7q6w\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") " pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:06.913507 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:06.913414    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:07.051112 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:07.051089    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"]
Jul 20 23:00:07.053168 ip-10-0-133-74 kubenswrapper[2556]: W0720 23:00:07.053119    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ef5f21f_bd6b_44d1_904a_3b8a0a81bccb.slice/crio-075d43dde91105dbf517cf52c0517d89d7c8e339433e48954033cf51f7305b28 WatchSource:0}: Error finding container 075d43dde91105dbf517cf52c0517d89d7c8e339433e48954033cf51f7305b28: Status 404 returned error can't find the container with id 075d43dde91105dbf517cf52c0517d89d7c8e339433e48954033cf51f7305b28
Jul 20 23:00:07.085983 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:07.085954    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w" event={"ID":"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb","Type":"ContainerStarted","Data":"075d43dde91105dbf517cf52c0517d89d7c8e339433e48954033cf51f7305b28"}
Jul 20 23:00:08.092538 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:08.092505    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w" event={"ID":"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb","Type":"ContainerStarted","Data":"ee9a5ed929ce0bf63a63619c38ef537ff4ac3c30f429285cebf9c41b032f6bca"}
Jul 20 23:00:08.110437 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:08.110383    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w" podStartSLOduration=2.110364792 podStartE2EDuration="2.110364792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:00:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:00:08.107946892 +0000 UTC m=+2221.406163475" watchObservedRunningTime="2026-07-20 23:00:08.110364792 +0000 UTC m=+2221.408581363"
Jul 20 23:00:16.914079 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:16.914018    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:16.914705 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:16.914101    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:16.928418 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:16.928393    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:17.151285 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:17.151256    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:00:48.582289 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:48.582250    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"]
Jul 20 23:00:59.251453 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:59.251414    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn"]
Jul 20 23:00:59.253825 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:59.251697    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn" podUID="4b6446f3-b0fb-44e9-8fd7-2f5145056092" containerName="maas-api" containerID="cri-o://9c703d7cb68858d0250d320d06db818ef368b0cdaf7dc0d0c48d30393af8f329" gracePeriod=30
Jul 20 23:00:59.497232 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:59.497209    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn"
Jul 20 23:00:59.652654 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:59.652546    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bws9m\" (UniqueName: \"kubernetes.io/projected/4b6446f3-b0fb-44e9-8fd7-2f5145056092-kube-api-access-bws9m\") pod \"4b6446f3-b0fb-44e9-8fd7-2f5145056092\" (UID: \"4b6446f3-b0fb-44e9-8fd7-2f5145056092\") "
Jul 20 23:00:59.652654 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:59.652652    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6446f3-b0fb-44e9-8fd7-2f5145056092-maas-api-tls\") pod \"4b6446f3-b0fb-44e9-8fd7-2f5145056092\" (UID: \"4b6446f3-b0fb-44e9-8fd7-2f5145056092\") "
Jul 20 23:00:59.652861 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:59.652695    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b6446f3-b0fb-44e9-8fd7-2f5145056092-openshift-service-ca\") pod \"4b6446f3-b0fb-44e9-8fd7-2f5145056092\" (UID: \"4b6446f3-b0fb-44e9-8fd7-2f5145056092\") "
Jul 20 23:00:59.653120 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:59.653082    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b6446f3-b0fb-44e9-8fd7-2f5145056092-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4b6446f3-b0fb-44e9-8fd7-2f5145056092" (UID: "4b6446f3-b0fb-44e9-8fd7-2f5145056092"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 23:00:59.654743 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:59.654717    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b6446f3-b0fb-44e9-8fd7-2f5145056092-kube-api-access-bws9m" (OuterVolumeSpecName: "kube-api-access-bws9m") pod "4b6446f3-b0fb-44e9-8fd7-2f5145056092" (UID: "4b6446f3-b0fb-44e9-8fd7-2f5145056092"). InnerVolumeSpecName "kube-api-access-bws9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:00:59.654872 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:59.654852    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b6446f3-b0fb-44e9-8fd7-2f5145056092-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4b6446f3-b0fb-44e9-8fd7-2f5145056092" (UID: "4b6446f3-b0fb-44e9-8fd7-2f5145056092"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 23:00:59.753414 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:59.753379    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6446f3-b0fb-44e9-8fd7-2f5145056092-maas-api-tls\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:00:59.753414 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:59.753408    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b6446f3-b0fb-44e9-8fd7-2f5145056092-openshift-service-ca\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:00:59.753414 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:00:59.753419    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bws9m\" (UniqueName: \"kubernetes.io/projected/4b6446f3-b0fb-44e9-8fd7-2f5145056092-kube-api-access-bws9m\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:01:00.351235 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:00.351199    2556 generic.go:356] "Generic (PLEG): container finished" podID="4b6446f3-b0fb-44e9-8fd7-2f5145056092" containerID="9c703d7cb68858d0250d320d06db818ef368b0cdaf7dc0d0c48d30393af8f329" exitCode=0
Jul 20 23:01:00.351663 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:00.351247    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn"
Jul 20 23:01:00.351663 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:00.351303    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn" event={"ID":"4b6446f3-b0fb-44e9-8fd7-2f5145056092","Type":"ContainerDied","Data":"9c703d7cb68858d0250d320d06db818ef368b0cdaf7dc0d0c48d30393af8f329"}
Jul 20 23:01:00.351663 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:00.351357    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn" event={"ID":"4b6446f3-b0fb-44e9-8fd7-2f5145056092","Type":"ContainerDied","Data":"8faac79d6f7bf5516a9cff3536f036b434626334248426ccd12dcc572da96bee"}
Jul 20 23:01:00.351663 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:00.351385    2556 scope.go:117] "RemoveContainer" containerID="9c703d7cb68858d0250d320d06db818ef368b0cdaf7dc0d0c48d30393af8f329"
Jul 20 23:01:00.360943 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:00.360924    2556 scope.go:117] "RemoveContainer" containerID="9c703d7cb68858d0250d320d06db818ef368b0cdaf7dc0d0c48d30393af8f329"
Jul 20 23:01:00.361228 ip-10-0-133-74 kubenswrapper[2556]: E0720 23:01:00.361211    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c703d7cb68858d0250d320d06db818ef368b0cdaf7dc0d0c48d30393af8f329\": container with ID starting with 9c703d7cb68858d0250d320d06db818ef368b0cdaf7dc0d0c48d30393af8f329 not found: ID does not exist" containerID="9c703d7cb68858d0250d320d06db818ef368b0cdaf7dc0d0c48d30393af8f329"
Jul 20 23:01:00.361292 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:00.361240    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c703d7cb68858d0250d320d06db818ef368b0cdaf7dc0d0c48d30393af8f329"} err="failed to get container status \"9c703d7cb68858d0250d320d06db818ef368b0cdaf7dc0d0c48d30393af8f329\": rpc error: code = NotFound desc = could not find container \"9c703d7cb68858d0250d320d06db818ef368b0cdaf7dc0d0c48d30393af8f329\": container with ID starting with 9c703d7cb68858d0250d320d06db818ef368b0cdaf7dc0d0c48d30393af8f329 not found: ID does not exist"
Jul 20 23:01:00.372522 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:00.372490    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn"]
Jul 20 23:01:00.376677 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:00.376594    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-222578-b6b67f57b-4z9dn"]
Jul 20 23:01:01.206590 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:01.206556    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b6446f3-b0fb-44e9-8fd7-2f5145056092" path="/var/lib/kubelet/pods/4b6446f3-b0fb-44e9-8fd7-2f5145056092/volumes"
Jul 20 23:01:03.603255 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:03.603214    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w" podUID="6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb" containerName="main" containerID="cri-o://ee9a5ed929ce0bf63a63619c38ef537ff4ac3c30f429285cebf9c41b032f6bca" gracePeriod=45
Jul 20 23:01:03.854793 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:03.854724    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:01:03.996279 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:03.996244    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-dshm\") pod \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") "
Jul 20 23:01:03.996279 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:03.996284    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-model-cache\") pod \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") "
Jul 20 23:01:03.996549 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:03.996319    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-tls-certs\") pod \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") "
Jul 20 23:01:03.996549 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:03.996382    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfhtr\" (UniqueName: \"kubernetes.io/projected/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-kube-api-access-hfhtr\") pod \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") "
Jul 20 23:01:03.996549 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:03.996423    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-home\") pod \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") "
Jul 20 23:01:03.996549 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:03.996487    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-tmp-dir\") pod \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\" (UID: \"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb\") "
Jul 20 23:01:03.996820 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:03.996585    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-model-cache" (OuterVolumeSpecName: "model-cache") pod "6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb" (UID: "6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:01:03.996820 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:03.996805    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb" (UID: "6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:01:03.996920 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:03.996825    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-home" (OuterVolumeSpecName: "home") pod "6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb" (UID: "6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:01:03.996973 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:03.996946    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-tmp-dir\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:01:03.996973 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:03.996967    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-model-cache\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:01:03.997052 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:03.996983    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-home\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:01:03.998656 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:03.998628    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb" (UID: "6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 23:01:03.998656 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:03.998632    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-dshm" (OuterVolumeSpecName: "dshm") pod "6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb" (UID: "6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:01:03.998792 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:03.998689    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-kube-api-access-hfhtr" (OuterVolumeSpecName: "kube-api-access-hfhtr") pod "6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb" (UID: "6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb"). InnerVolumeSpecName "kube-api-access-hfhtr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:01:04.097826 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:04.097782    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfhtr\" (UniqueName: \"kubernetes.io/projected/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-kube-api-access-hfhtr\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:01:04.097826 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:04.097820    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-dshm\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:01:04.097826 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:04.097829    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb-tls-certs\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:01:04.374737 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:04.374701    2556 generic.go:356] "Generic (PLEG): container finished" podID="6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb" containerID="ee9a5ed929ce0bf63a63619c38ef537ff4ac3c30f429285cebf9c41b032f6bca" exitCode=0
Jul 20 23:01:04.374945 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:04.374745    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"
Jul 20 23:01:04.374945 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:04.374788    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w" event={"ID":"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb","Type":"ContainerDied","Data":"ee9a5ed929ce0bf63a63619c38ef537ff4ac3c30f429285cebf9c41b032f6bca"}
Jul 20 23:01:04.374945 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:04.374829    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w" event={"ID":"6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb","Type":"ContainerDied","Data":"075d43dde91105dbf517cf52c0517d89d7c8e339433e48954033cf51f7305b28"}
Jul 20 23:01:04.374945 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:04.374847    2556 scope.go:117] "RemoveContainer" containerID="ee9a5ed929ce0bf63a63619c38ef537ff4ac3c30f429285cebf9c41b032f6bca"
Jul 20 23:01:04.384245 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:04.384217    2556 scope.go:117] "RemoveContainer" containerID="ee9a5ed929ce0bf63a63619c38ef537ff4ac3c30f429285cebf9c41b032f6bca"
Jul 20 23:01:04.384603 ip-10-0-133-74 kubenswrapper[2556]: E0720 23:01:04.384582    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee9a5ed929ce0bf63a63619c38ef537ff4ac3c30f429285cebf9c41b032f6bca\": container with ID starting with ee9a5ed929ce0bf63a63619c38ef537ff4ac3c30f429285cebf9c41b032f6bca not found: ID does not exist" containerID="ee9a5ed929ce0bf63a63619c38ef537ff4ac3c30f429285cebf9c41b032f6bca"
Jul 20 23:01:04.384696 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:04.384640    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee9a5ed929ce0bf63a63619c38ef537ff4ac3c30f429285cebf9c41b032f6bca"} err="failed to get container status \"ee9a5ed929ce0bf63a63619c38ef537ff4ac3c30f429285cebf9c41b032f6bca\": rpc error: code = NotFound desc = could not find container \"ee9a5ed929ce0bf63a63619c38ef537ff4ac3c30f429285cebf9c41b032f6bca\": container with ID starting with ee9a5ed929ce0bf63a63619c38ef537ff4ac3c30f429285cebf9c41b032f6bca not found: ID does not exist"
Jul 20 23:01:04.395919 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:04.395892    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"]
Jul 20 23:01:04.399603 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:04.399574    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-35607f/test-model-35607f-kserve-6ffcbf74c-m7q6w"]
Jul 20 23:01:05.207322 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:05.207287    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb" path="/var/lib/kubelet/pods/6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb/volumes"
Jul 20 23:01:21.690677 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:21.690641    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7"]
Jul 20 23:01:21.691277 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:21.690916    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7" podUID="9e06674f-ed9c-4775-add7-551dc0f026bd" containerName="maas-api" containerID="cri-o://c2cb5a8001312842bf187dbdeeded636f2304b3f45c1d8241b3aa3b469f9aca3" gracePeriod=30
Jul 20 23:01:21.933265 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:21.933238    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7"
Jul 20 23:01:21.966360 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:21.966278    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e06674f-ed9c-4775-add7-551dc0f026bd-openshift-service-ca\") pod \"9e06674f-ed9c-4775-add7-551dc0f026bd\" (UID: \"9e06674f-ed9c-4775-add7-551dc0f026bd\") "
Jul 20 23:01:21.966360 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:21.966340    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e06674f-ed9c-4775-add7-551dc0f026bd-maas-api-tls\") pod \"9e06674f-ed9c-4775-add7-551dc0f026bd\" (UID: \"9e06674f-ed9c-4775-add7-551dc0f026bd\") "
Jul 20 23:01:21.966579 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:21.966393    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vtpj\" (UniqueName: \"kubernetes.io/projected/9e06674f-ed9c-4775-add7-551dc0f026bd-kube-api-access-9vtpj\") pod \"9e06674f-ed9c-4775-add7-551dc0f026bd\" (UID: \"9e06674f-ed9c-4775-add7-551dc0f026bd\") "
Jul 20 23:01:21.966662 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:21.966640    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e06674f-ed9c-4775-add7-551dc0f026bd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9e06674f-ed9c-4775-add7-551dc0f026bd" (UID: "9e06674f-ed9c-4775-add7-551dc0f026bd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 23:01:21.966756 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:21.966739    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e06674f-ed9c-4775-add7-551dc0f026bd-openshift-service-ca\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:01:21.968493 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:21.968464    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e06674f-ed9c-4775-add7-551dc0f026bd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9e06674f-ed9c-4775-add7-551dc0f026bd" (UID: "9e06674f-ed9c-4775-add7-551dc0f026bd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 23:01:21.968640 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:21.968537    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e06674f-ed9c-4775-add7-551dc0f026bd-kube-api-access-9vtpj" (OuterVolumeSpecName: "kube-api-access-9vtpj") pod "9e06674f-ed9c-4775-add7-551dc0f026bd" (UID: "9e06674f-ed9c-4775-add7-551dc0f026bd"). InnerVolumeSpecName "kube-api-access-9vtpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:01:22.067710 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:22.067668    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e06674f-ed9c-4775-add7-551dc0f026bd-maas-api-tls\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:01:22.067710 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:22.067700    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vtpj\" (UniqueName: \"kubernetes.io/projected/9e06674f-ed9c-4775-add7-551dc0f026bd-kube-api-access-9vtpj\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:01:22.466401 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:22.466363    2556 generic.go:356] "Generic (PLEG): container finished" podID="9e06674f-ed9c-4775-add7-551dc0f026bd" containerID="c2cb5a8001312842bf187dbdeeded636f2304b3f45c1d8241b3aa3b469f9aca3" exitCode=0
Jul 20 23:01:22.466639 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:22.466419    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7"
Jul 20 23:01:22.466639 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:22.466450    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7" event={"ID":"9e06674f-ed9c-4775-add7-551dc0f026bd","Type":"ContainerDied","Data":"c2cb5a8001312842bf187dbdeeded636f2304b3f45c1d8241b3aa3b469f9aca3"}
Jul 20 23:01:22.466639 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:22.466510    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7" event={"ID":"9e06674f-ed9c-4775-add7-551dc0f026bd","Type":"ContainerDied","Data":"e3f1b47501ecc59ad414a507a77ce9a83d42dcec7daf8e5c7eee5967dfbb0e75"}
Jul 20 23:01:22.466639 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:22.466534    2556 scope.go:117] "RemoveContainer" containerID="c2cb5a8001312842bf187dbdeeded636f2304b3f45c1d8241b3aa3b469f9aca3"
Jul 20 23:01:22.476184 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:22.476167    2556 scope.go:117] "RemoveContainer" containerID="c2cb5a8001312842bf187dbdeeded636f2304b3f45c1d8241b3aa3b469f9aca3"
Jul 20 23:01:22.476471 ip-10-0-133-74 kubenswrapper[2556]: E0720 23:01:22.476442    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2cb5a8001312842bf187dbdeeded636f2304b3f45c1d8241b3aa3b469f9aca3\": container with ID starting with c2cb5a8001312842bf187dbdeeded636f2304b3f45c1d8241b3aa3b469f9aca3 not found: ID does not exist" containerID="c2cb5a8001312842bf187dbdeeded636f2304b3f45c1d8241b3aa3b469f9aca3"
Jul 20 23:01:22.476561 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:22.476479    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2cb5a8001312842bf187dbdeeded636f2304b3f45c1d8241b3aa3b469f9aca3"} err="failed to get container status \"c2cb5a8001312842bf187dbdeeded636f2304b3f45c1d8241b3aa3b469f9aca3\": rpc error: code = NotFound desc = could not find container \"c2cb5a8001312842bf187dbdeeded636f2304b3f45c1d8241b3aa3b469f9aca3\": container with ID starting with c2cb5a8001312842bf187dbdeeded636f2304b3f45c1d8241b3aa3b469f9aca3 not found: ID does not exist"
Jul 20 23:01:22.487490 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:22.487456    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7"]
Jul 20 23:01:22.489570 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:22.489549    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7"]
Jul 20 23:01:23.207003 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:23.206972    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e06674f-ed9c-4775-add7-551dc0f026bd" path="/var/lib/kubelet/pods/9e06674f-ed9c-4775-add7-551dc0f026bd/volumes"
Jul 20 23:01:24.858583 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:24.858526    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-35607f-7d546947b6-nf9q7" podUID="9e06674f-ed9c-4775-add7-551dc0f026bd" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.47:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 20 23:01:36.615036 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:36.615004    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb"]
Jul 20 23:01:36.623405 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:36.623373    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b6446f3-b0fb-44e9-8fd7-2f5145056092" containerName="maas-api"
Jul 20 23:01:36.623405 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:36.623402    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b6446f3-b0fb-44e9-8fd7-2f5145056092" containerName="maas-api"
Jul 20 23:01:36.624069 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:36.623444    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e06674f-ed9c-4775-add7-551dc0f026bd" containerName="maas-api"
Jul 20 23:01:36.624069 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:36.623453    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e06674f-ed9c-4775-add7-551dc0f026bd" containerName="maas-api"
Jul 20 23:01:36.624069 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:36.623502    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb" containerName="main"
Jul 20 23:01:36.624069 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:36.623511    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb" containerName="main"
Jul 20 23:01:36.624069 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:36.623829    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ef5f21f-bd6b-44d1-904a-3b8a0a81bccb" containerName="main"
Jul 20 23:01:36.624069 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:36.623856    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e06674f-ed9c-4775-add7-551dc0f026bd" containerName="maas-api"
Jul 20 23:01:36.624069 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:36.623868    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b6446f3-b0fb-44e9-8fd7-2f5145056092" containerName="maas-api"
Jul 20 23:01:36.628346 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:36.628324    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb"
Jul 20 23:01:36.631144 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:36.631118    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-238953-serving-cert\""
Jul 20 23:01:36.631876 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:36.631854    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb"]
Jul 20 23:01:36.724356 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:36.724319    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a233c530-d198-4d24-886e-dcb340a4a51a-maas-api-tls\") pod \"maas-api-e2e-api-a-238953-56f755767f-spzvb\" (UID: \"a233c530-d198-4d24-886e-dcb340a4a51a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb"
Jul 20 23:01:36.724562 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:36.724401    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a233c530-d198-4d24-886e-dcb340a4a51a-openshift-service-ca\") pod \"maas-api-e2e-api-a-238953-56f755767f-spzvb\" (UID: \"a233c530-d198-4d24-886e-dcb340a4a51a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb"
Jul 20 23:01:36.724562 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:36.724428    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6ctg\" (UniqueName: \"kubernetes.io/projected/a233c530-d198-4d24-886e-dcb340a4a51a-kube-api-access-g6ctg\") pod \"maas-api-e2e-api-a-238953-56f755767f-spzvb\" (UID: \"a233c530-d198-4d24-886e-dcb340a4a51a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb"
Jul 20 23:01:36.825416 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:36.825374    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a233c530-d198-4d24-886e-dcb340a4a51a-maas-api-tls\") pod \"maas-api-e2e-api-a-238953-56f755767f-spzvb\" (UID: \"a233c530-d198-4d24-886e-dcb340a4a51a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb"
Jul 20 23:01:36.825628 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:36.825472    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a233c530-d198-4d24-886e-dcb340a4a51a-openshift-service-ca\") pod \"maas-api-e2e-api-a-238953-56f755767f-spzvb\" (UID: \"a233c530-d198-4d24-886e-dcb340a4a51a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb"
Jul 20 23:01:36.825628 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:36.825505    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6ctg\" (UniqueName: \"kubernetes.io/projected/a233c530-d198-4d24-886e-dcb340a4a51a-kube-api-access-g6ctg\") pod \"maas-api-e2e-api-a-238953-56f755767f-spzvb\" (UID: \"a233c530-d198-4d24-886e-dcb340a4a51a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb"
Jul 20 23:01:36.825628 ip-10-0-133-74 kubenswrapper[2556]: E0720 23:01:36.825509    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-238953-serving-cert: secret "maas-api-e2e-api-a-238953-serving-cert" not found
Jul 20 23:01:36.825628 ip-10-0-133-74 kubenswrapper[2556]: E0720 23:01:36.825587    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a233c530-d198-4d24-886e-dcb340a4a51a-maas-api-tls podName:a233c530-d198-4d24-886e-dcb340a4a51a nodeName:}" failed. No retries permitted until 2026-07-20 23:01:37.325569551 +0000 UTC m=+2310.623786099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a233c530-d198-4d24-886e-dcb340a4a51a-maas-api-tls") pod "maas-api-e2e-api-a-238953-56f755767f-spzvb" (UID: "a233c530-d198-4d24-886e-dcb340a4a51a") : secret "maas-api-e2e-api-a-238953-serving-cert" not found
Jul 20 23:01:36.826174 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:36.826153    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a233c530-d198-4d24-886e-dcb340a4a51a-openshift-service-ca\") pod \"maas-api-e2e-api-a-238953-56f755767f-spzvb\" (UID: \"a233c530-d198-4d24-886e-dcb340a4a51a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb"
Jul 20 23:01:36.834447 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:36.834423    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6ctg\" (UniqueName: \"kubernetes.io/projected/a233c530-d198-4d24-886e-dcb340a4a51a-kube-api-access-g6ctg\") pod \"maas-api-e2e-api-a-238953-56f755767f-spzvb\" (UID: \"a233c530-d198-4d24-886e-dcb340a4a51a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb"
Jul 20 23:01:37.330244 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:37.330207    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a233c530-d198-4d24-886e-dcb340a4a51a-maas-api-tls\") pod \"maas-api-e2e-api-a-238953-56f755767f-spzvb\" (UID: \"a233c530-d198-4d24-886e-dcb340a4a51a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb"
Jul 20 23:01:37.332772 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:37.332744    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a233c530-d198-4d24-886e-dcb340a4a51a-maas-api-tls\") pod \"maas-api-e2e-api-a-238953-56f755767f-spzvb\" (UID: \"a233c530-d198-4d24-886e-dcb340a4a51a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb"
Jul 20 23:01:37.541159 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:37.541128    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb"
Jul 20 23:01:37.678195 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:37.678170    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb"]
Jul 20 23:01:37.681040 ip-10-0-133-74 kubenswrapper[2556]: W0720 23:01:37.681010    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda233c530_d198_4d24_886e_dcb340a4a51a.slice/crio-2175c84339e2be2bde06a6fe705c9eab8f48c4beb9b330c2c3b6b4d546839d73 WatchSource:0}: Error finding container 2175c84339e2be2bde06a6fe705c9eab8f48c4beb9b330c2c3b6b4d546839d73: Status 404 returned error can't find the container with id 2175c84339e2be2bde06a6fe705c9eab8f48c4beb9b330c2c3b6b4d546839d73
Jul 20 23:01:37.682356 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:37.682334    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 23:01:38.546917 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:38.546883    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb" event={"ID":"a233c530-d198-4d24-886e-dcb340a4a51a","Type":"ContainerStarted","Data":"a63abcd3fed8de2611781f4532465414f2daa9371302b5fe53cc68c26fe1f7cf"}
Jul 20 23:01:38.547103 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:38.546939    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb" event={"ID":"a233c530-d198-4d24-886e-dcb340a4a51a","Type":"ContainerStarted","Data":"2175c84339e2be2bde06a6fe705c9eab8f48c4beb9b330c2c3b6b4d546839d73"}
Jul 20 23:01:38.547103 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:38.547009    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb"
Jul 20 23:01:38.567059 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:38.566997    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb" podStartSLOduration=2.151287835 podStartE2EDuration="2.566977298s" totalImagesPullingTime="415.689463ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:01:38.566169366 +0000 UTC m=+2311.864385971" watchObservedRunningTime="2026-07-20 23:01:38.566977298 +0000 UTC m=+2311.865193870"
Jul 20 23:01:44.557773 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:44.557741    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb"
Jul 20 23:01:44.713457 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:44.713406    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t"]
Jul 20 23:01:44.717202 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:44.717178    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t"
Jul 20 23:01:44.721339 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:44.721314    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-aae0e4-serving-cert\""
Jul 20 23:01:44.729835 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:44.729759    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t"]
Jul 20 23:01:44.802344 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:44.802309    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-openshift-service-ca\") pod \"maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t\" (UID: \"960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t"
Jul 20 23:01:44.802344 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:44.802350    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-maas-api-tls\") pod \"maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t\" (UID: \"960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t"
Jul 20 23:01:44.802562 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:44.802374    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksk69\" (UniqueName: \"kubernetes.io/projected/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-kube-api-access-ksk69\") pod \"maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t\" (UID: \"960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t"
Jul 20 23:01:44.903661 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:44.903541    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-maas-api-tls\") pod \"maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t\" (UID: \"960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t"
Jul 20 23:01:44.903661 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:44.903593    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksk69\" (UniqueName: \"kubernetes.io/projected/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-kube-api-access-ksk69\") pod \"maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t\" (UID: \"960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t"
Jul 20 23:01:44.903912 ip-10-0-133-74 kubenswrapper[2556]: E0720 23:01:44.903717    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-serving-cert: secret "maas-api-e2e-api-b-aae0e4-serving-cert" not found
Jul 20 23:01:44.903912 ip-10-0-133-74 kubenswrapper[2556]: E0720 23:01:44.903783    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-maas-api-tls podName:960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba nodeName:}" failed. No retries permitted until 2026-07-20 23:01:45.403765426 +0000 UTC m=+2318.701981974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-maas-api-tls") pod "maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t" (UID: "960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba") : secret "maas-api-e2e-api-b-aae0e4-serving-cert" not found
Jul 20 23:01:44.903912 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:44.903802    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-openshift-service-ca\") pod \"maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t\" (UID: \"960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t"
Jul 20 23:01:44.904465 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:44.904447    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-openshift-service-ca\") pod \"maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t\" (UID: \"960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t"
Jul 20 23:01:44.913501 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:44.913478    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksk69\" (UniqueName: \"kubernetes.io/projected/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-kube-api-access-ksk69\") pod \"maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t\" (UID: \"960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t"
Jul 20 23:01:45.410518 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:45.410472    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-maas-api-tls\") pod \"maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t\" (UID: \"960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t"
Jul 20 23:01:45.410771 ip-10-0-133-74 kubenswrapper[2556]: E0720 23:01:45.410661    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-serving-cert: secret "maas-api-e2e-api-b-aae0e4-serving-cert" not found
Jul 20 23:01:45.410771 ip-10-0-133-74 kubenswrapper[2556]: E0720 23:01:45.410745    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-maas-api-tls podName:960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba nodeName:}" failed. No retries permitted until 2026-07-20 23:01:46.410723935 +0000 UTC m=+2319.708940483 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-maas-api-tls") pod "maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t" (UID: "960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba") : secret "maas-api-e2e-api-b-aae0e4-serving-cert" not found
Jul 20 23:01:46.420978 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:46.420948    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-maas-api-tls\") pod \"maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t\" (UID: \"960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t"
Jul 20 23:01:46.423361 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:46.423340    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-maas-api-tls\") pod \"maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t\" (UID: \"960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t"
Jul 20 23:01:46.533002 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:46.532962    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t"
Jul 20 23:01:46.677024 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:46.676996    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t"]
Jul 20 23:01:46.679775 ip-10-0-133-74 kubenswrapper[2556]: W0720 23:01:46.679749    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod960cc1ec_3d93_4f2f_a5bb_9bc2882e04ba.slice/crio-c3c13b563bf4b138a447dcd7b6032e769de48fcfead583ac1a8c1a3ee67dd5d8 WatchSource:0}: Error finding container c3c13b563bf4b138a447dcd7b6032e769de48fcfead583ac1a8c1a3ee67dd5d8: Status 404 returned error can't find the container with id c3c13b563bf4b138a447dcd7b6032e769de48fcfead583ac1a8c1a3ee67dd5d8
Jul 20 23:01:47.589241 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:47.589194    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t" event={"ID":"960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba","Type":"ContainerStarted","Data":"d3d0a9d32e5997acc9edd47e0c7e28b701438ff228a58e0a95d81d1d180b1b9b"}
Jul 20 23:01:47.589672 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:47.589256    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t" event={"ID":"960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba","Type":"ContainerStarted","Data":"c3c13b563bf4b138a447dcd7b6032e769de48fcfead583ac1a8c1a3ee67dd5d8"}
Jul 20 23:01:47.589672 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:47.589385    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t"
Jul 20 23:01:47.611111 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:47.611047    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t" podStartSLOduration=3.192147799 podStartE2EDuration="3.611030982s" totalImagesPullingTime="418.883183ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:01:47.609114247 +0000 UTC m=+2320.907330816" watchObservedRunningTime="2026-07-20 23:01:47.611030982 +0000 UTC m=+2320.909247552"
Jul 20 23:01:53.599673 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:01:53.599643    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t"
Jul 20 23:02:12.960202 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:12.960162    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb"]
Jul 20 23:02:12.960627 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:12.960437    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb" podUID="a233c530-d198-4d24-886e-dcb340a4a51a" containerName="maas-api" containerID="cri-o://a63abcd3fed8de2611781f4532465414f2daa9371302b5fe53cc68c26fe1f7cf" gracePeriod=30
Jul 20 23:02:13.205134 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:13.205105    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb"
Jul 20 23:02:13.285860 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:13.285762    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6ctg\" (UniqueName: \"kubernetes.io/projected/a233c530-d198-4d24-886e-dcb340a4a51a-kube-api-access-g6ctg\") pod \"a233c530-d198-4d24-886e-dcb340a4a51a\" (UID: \"a233c530-d198-4d24-886e-dcb340a4a51a\") "
Jul 20 23:02:13.285860 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:13.285841    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a233c530-d198-4d24-886e-dcb340a4a51a-openshift-service-ca\") pod \"a233c530-d198-4d24-886e-dcb340a4a51a\" (UID: \"a233c530-d198-4d24-886e-dcb340a4a51a\") "
Jul 20 23:02:13.286107 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:13.285864    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a233c530-d198-4d24-886e-dcb340a4a51a-maas-api-tls\") pod \"a233c530-d198-4d24-886e-dcb340a4a51a\" (UID: \"a233c530-d198-4d24-886e-dcb340a4a51a\") "
Jul 20 23:02:13.286262 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:13.286237    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a233c530-d198-4d24-886e-dcb340a4a51a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a233c530-d198-4d24-886e-dcb340a4a51a" (UID: "a233c530-d198-4d24-886e-dcb340a4a51a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 23:02:13.288007 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:13.287972    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a233c530-d198-4d24-886e-dcb340a4a51a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a233c530-d198-4d24-886e-dcb340a4a51a" (UID: "a233c530-d198-4d24-886e-dcb340a4a51a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 23:02:13.288105 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:13.288045    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a233c530-d198-4d24-886e-dcb340a4a51a-kube-api-access-g6ctg" (OuterVolumeSpecName: "kube-api-access-g6ctg") pod "a233c530-d198-4d24-886e-dcb340a4a51a" (UID: "a233c530-d198-4d24-886e-dcb340a4a51a"). InnerVolumeSpecName "kube-api-access-g6ctg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:02:13.386759 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:13.386718    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6ctg\" (UniqueName: \"kubernetes.io/projected/a233c530-d198-4d24-886e-dcb340a4a51a-kube-api-access-g6ctg\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:02:13.386759 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:13.386754    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a233c530-d198-4d24-886e-dcb340a4a51a-openshift-service-ca\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:02:13.386759 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:13.386764    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a233c530-d198-4d24-886e-dcb340a4a51a-maas-api-tls\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:02:13.716458 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:13.716423    2556 generic.go:356] "Generic (PLEG): container finished" podID="a233c530-d198-4d24-886e-dcb340a4a51a" containerID="a63abcd3fed8de2611781f4532465414f2daa9371302b5fe53cc68c26fe1f7cf" exitCode=0
Jul 20 23:02:13.716648 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:13.716492    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb"
Jul 20 23:02:13.716648 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:13.716509    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb" event={"ID":"a233c530-d198-4d24-886e-dcb340a4a51a","Type":"ContainerDied","Data":"a63abcd3fed8de2611781f4532465414f2daa9371302b5fe53cc68c26fe1f7cf"}
Jul 20 23:02:13.716648 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:13.716560    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb" event={"ID":"a233c530-d198-4d24-886e-dcb340a4a51a","Type":"ContainerDied","Data":"2175c84339e2be2bde06a6fe705c9eab8f48c4beb9b330c2c3b6b4d546839d73"}
Jul 20 23:02:13.716648 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:13.716580    2556 scope.go:117] "RemoveContainer" containerID="a63abcd3fed8de2611781f4532465414f2daa9371302b5fe53cc68c26fe1f7cf"
Jul 20 23:02:13.729368 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:13.729346    2556 scope.go:117] "RemoveContainer" containerID="a63abcd3fed8de2611781f4532465414f2daa9371302b5fe53cc68c26fe1f7cf"
Jul 20 23:02:13.729740 ip-10-0-133-74 kubenswrapper[2556]: E0720 23:02:13.729719    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a63abcd3fed8de2611781f4532465414f2daa9371302b5fe53cc68c26fe1f7cf\": container with ID starting with a63abcd3fed8de2611781f4532465414f2daa9371302b5fe53cc68c26fe1f7cf not found: ID does not exist" containerID="a63abcd3fed8de2611781f4532465414f2daa9371302b5fe53cc68c26fe1f7cf"
Jul 20 23:02:13.729825 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:13.729746    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a63abcd3fed8de2611781f4532465414f2daa9371302b5fe53cc68c26fe1f7cf"} err="failed to get container status \"a63abcd3fed8de2611781f4532465414f2daa9371302b5fe53cc68c26fe1f7cf\": rpc error: code = NotFound desc = could not find container \"a63abcd3fed8de2611781f4532465414f2daa9371302b5fe53cc68c26fe1f7cf\": container with ID starting with a63abcd3fed8de2611781f4532465414f2daa9371302b5fe53cc68c26fe1f7cf not found: ID does not exist"
Jul 20 23:02:13.740455 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:13.740427    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb"]
Jul 20 23:02:13.744581 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:13.744554    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-238953-56f755767f-spzvb"]
Jul 20 23:02:15.206835 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:15.206803    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a233c530-d198-4d24-886e-dcb340a4a51a" path="/var/lib/kubelet/pods/a233c530-d198-4d24-886e-dcb340a4a51a/volumes"
Jul 20 23:02:39.490661 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:39.490597    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t"]
Jul 20 23:02:39.491178 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:39.490839    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t" podUID="960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba" containerName="maas-api" containerID="cri-o://d3d0a9d32e5997acc9edd47e0c7e28b701438ff228a58e0a95d81d1d180b1b9b" gracePeriod=30
Jul 20 23:02:39.739721 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:39.739694    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t"
Jul 20 23:02:39.839471 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:39.839377    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-maas-api-tls\") pod \"960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba\" (UID: \"960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba\") "
Jul 20 23:02:39.839471 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:39.839431    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksk69\" (UniqueName: \"kubernetes.io/projected/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-kube-api-access-ksk69\") pod \"960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba\" (UID: \"960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba\") "
Jul 20 23:02:39.839729 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:39.839513    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-openshift-service-ca\") pod \"960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba\" (UID: \"960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba\") "
Jul 20 23:02:39.839931 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:39.839904    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba" (UID: "960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 23:02:39.841653 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:39.841623    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba" (UID: "960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 23:02:39.841766 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:39.841646    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-kube-api-access-ksk69" (OuterVolumeSpecName: "kube-api-access-ksk69") pod "960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba" (UID: "960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba"). InnerVolumeSpecName "kube-api-access-ksk69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:02:39.843069 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:39.843041    2556 generic.go:356] "Generic (PLEG): container finished" podID="960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba" containerID="d3d0a9d32e5997acc9edd47e0c7e28b701438ff228a58e0a95d81d1d180b1b9b" exitCode=0
Jul 20 23:02:39.843161 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:39.843077    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t"
Jul 20 23:02:39.843161 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:39.843114    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t" event={"ID":"960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba","Type":"ContainerDied","Data":"d3d0a9d32e5997acc9edd47e0c7e28b701438ff228a58e0a95d81d1d180b1b9b"}
Jul 20 23:02:39.843235 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:39.843189    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t" event={"ID":"960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba","Type":"ContainerDied","Data":"c3c13b563bf4b138a447dcd7b6032e769de48fcfead583ac1a8c1a3ee67dd5d8"}
Jul 20 23:02:39.843235 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:39.843212    2556 scope.go:117] "RemoveContainer" containerID="d3d0a9d32e5997acc9edd47e0c7e28b701438ff228a58e0a95d81d1d180b1b9b"
Jul 20 23:02:39.854278 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:39.854261    2556 scope.go:117] "RemoveContainer" containerID="d3d0a9d32e5997acc9edd47e0c7e28b701438ff228a58e0a95d81d1d180b1b9b"
Jul 20 23:02:39.854543 ip-10-0-133-74 kubenswrapper[2556]: E0720 23:02:39.854524    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3d0a9d32e5997acc9edd47e0c7e28b701438ff228a58e0a95d81d1d180b1b9b\": container with ID starting with d3d0a9d32e5997acc9edd47e0c7e28b701438ff228a58e0a95d81d1d180b1b9b not found: ID does not exist" containerID="d3d0a9d32e5997acc9edd47e0c7e28b701438ff228a58e0a95d81d1d180b1b9b"
Jul 20 23:02:39.854593 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:39.854552    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3d0a9d32e5997acc9edd47e0c7e28b701438ff228a58e0a95d81d1d180b1b9b"} err="failed to get container status \"d3d0a9d32e5997acc9edd47e0c7e28b701438ff228a58e0a95d81d1d180b1b9b\": rpc error: code = NotFound desc = could not find container \"d3d0a9d32e5997acc9edd47e0c7e28b701438ff228a58e0a95d81d1d180b1b9b\": container with ID starting with d3d0a9d32e5997acc9edd47e0c7e28b701438ff228a58e0a95d81d1d180b1b9b not found: ID does not exist"
Jul 20 23:02:39.865309 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:39.865284    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t"]
Jul 20 23:02:39.867051 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:39.867031    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-aae0e4-5cccb44486-jjg9t"]
Jul 20 23:02:39.940689 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:39.940655    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-openshift-service-ca\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:02:39.940689 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:39.940683    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-maas-api-tls\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:02:39.940689 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:39.940694    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksk69\" (UniqueName: \"kubernetes.io/projected/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba-kube-api-access-ksk69\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:02:41.206742 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:41.206711    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba" path="/var/lib/kubelet/pods/960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba/volumes"
Jul 20 23:02:54.101102 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:54.101073    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g"]
Jul 20 23:02:54.101530 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:54.101453    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba" containerName="maas-api"
Jul 20 23:02:54.101530 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:54.101468    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba" containerName="maas-api"
Jul 20 23:02:54.101530 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:54.101487    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a233c530-d198-4d24-886e-dcb340a4a51a" containerName="maas-api"
Jul 20 23:02:54.101530 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:54.101492    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a233c530-d198-4d24-886e-dcb340a4a51a" containerName="maas-api"
Jul 20 23:02:54.101696 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:54.101566    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a233c530-d198-4d24-886e-dcb340a4a51a" containerName="maas-api"
Jul 20 23:02:54.101696 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:54.101575    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="960cc1ec-3d93-4f2f-a5bb-9bc2882e04ba" containerName="maas-api"
Jul 20 23:02:54.104734 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:54.104719    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g"
Jul 20 23:02:54.107165 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:54.107144    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-717ec3-serving-cert\""
Jul 20 23:02:54.115453 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:54.115417    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g"]
Jul 20 23:02:54.276407 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:54.276365    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5b82eb5-a219-41a3-b458-db009cce30c7-maas-api-tls\") pod \"maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g\" (UID: \"a5b82eb5-a219-41a3-b458-db009cce30c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g"
Jul 20 23:02:54.276583 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:54.276420    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5b82eb5-a219-41a3-b458-db009cce30c7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g\" (UID: \"a5b82eb5-a219-41a3-b458-db009cce30c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g"
Jul 20 23:02:54.276583 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:54.276502    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xktxh\" (UniqueName: \"kubernetes.io/projected/a5b82eb5-a219-41a3-b458-db009cce30c7-kube-api-access-xktxh\") pod \"maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g\" (UID: \"a5b82eb5-a219-41a3-b458-db009cce30c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g"
Jul 20 23:02:54.377137 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:54.377059    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5b82eb5-a219-41a3-b458-db009cce30c7-maas-api-tls\") pod \"maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g\" (UID: \"a5b82eb5-a219-41a3-b458-db009cce30c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g"
Jul 20 23:02:54.377137 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:54.377107    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5b82eb5-a219-41a3-b458-db009cce30c7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g\" (UID: \"a5b82eb5-a219-41a3-b458-db009cce30c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g"
Jul 20 23:02:54.377137 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:54.377131    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xktxh\" (UniqueName: \"kubernetes.io/projected/a5b82eb5-a219-41a3-b458-db009cce30c7-kube-api-access-xktxh\") pod \"maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g\" (UID: \"a5b82eb5-a219-41a3-b458-db009cce30c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g"
Jul 20 23:02:54.377422 ip-10-0-133-74 kubenswrapper[2556]: E0720 23:02:54.377268    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-serving-cert: secret "maas-api-e2e-shared-a-717ec3-serving-cert" not found
Jul 20 23:02:54.377422 ip-10-0-133-74 kubenswrapper[2556]: E0720 23:02:54.377364    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5b82eb5-a219-41a3-b458-db009cce30c7-maas-api-tls podName:a5b82eb5-a219-41a3-b458-db009cce30c7 nodeName:}" failed. No retries permitted until 2026-07-20 23:02:54.877341827 +0000 UTC m=+2388.175558389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a5b82eb5-a219-41a3-b458-db009cce30c7-maas-api-tls") pod "maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g" (UID: "a5b82eb5-a219-41a3-b458-db009cce30c7") : secret "maas-api-e2e-shared-a-717ec3-serving-cert" not found
Jul 20 23:02:54.377804 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:54.377785    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5b82eb5-a219-41a3-b458-db009cce30c7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g\" (UID: \"a5b82eb5-a219-41a3-b458-db009cce30c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g"
Jul 20 23:02:54.386487 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:54.386463    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xktxh\" (UniqueName: \"kubernetes.io/projected/a5b82eb5-a219-41a3-b458-db009cce30c7-kube-api-access-xktxh\") pod \"maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g\" (UID: \"a5b82eb5-a219-41a3-b458-db009cce30c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g"
Jul 20 23:02:54.884445 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:54.884412    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5b82eb5-a219-41a3-b458-db009cce30c7-maas-api-tls\") pod \"maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g\" (UID: \"a5b82eb5-a219-41a3-b458-db009cce30c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g"
Jul 20 23:02:54.886808 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:54.886781    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5b82eb5-a219-41a3-b458-db009cce30c7-maas-api-tls\") pod \"maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g\" (UID: \"a5b82eb5-a219-41a3-b458-db009cce30c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g"
Jul 20 23:02:55.017183 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:55.017142    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g"
Jul 20 23:02:55.150114 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:55.150092    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g"]
Jul 20 23:02:55.153094 ip-10-0-133-74 kubenswrapper[2556]: W0720 23:02:55.153058    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5b82eb5_a219_41a3_b458_db009cce30c7.slice/crio-01e1c446e1e7943bf1152208a2f8a83ffa8dc960d9c62e36bd1e18512b8dd14e WatchSource:0}: Error finding container 01e1c446e1e7943bf1152208a2f8a83ffa8dc960d9c62e36bd1e18512b8dd14e: Status 404 returned error can't find the container with id 01e1c446e1e7943bf1152208a2f8a83ffa8dc960d9c62e36bd1e18512b8dd14e
Jul 20 23:02:55.926388 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:55.926353    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g" event={"ID":"a5b82eb5-a219-41a3-b458-db009cce30c7","Type":"ContainerStarted","Data":"01e1c446e1e7943bf1152208a2f8a83ffa8dc960d9c62e36bd1e18512b8dd14e"}
Jul 20 23:02:56.933465 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:56.933427    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g" event={"ID":"a5b82eb5-a219-41a3-b458-db009cce30c7","Type":"ContainerStarted","Data":"583de7d125fa8129d4eb927445dfc1af2537c75b219e972ee5685f94071f2f4f"}
Jul 20 23:02:56.933937 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:56.933501    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g"
Jul 20 23:02:56.949643 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:02:56.949572    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g" podStartSLOduration=2.051687133 podStartE2EDuration="2.94955062s" totalImagesPullingTime="897.863487ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:02:56.948622152 +0000 UTC m=+2390.246838715" watchObservedRunningTime="2026-07-20 23:02:56.94955062 +0000 UTC m=+2390.247767192"
Jul 20 23:03:02.166262 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:03:02.166229    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj"]
Jul 20 23:03:02.170075 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:03:02.170053    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj"
Jul 20 23:03:02.172563 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:03:02.172534    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-1dd4fb-serving-cert\""
Jul 20 23:03:02.184103 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:03:02.184078    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj"]
Jul 20 23:03:02.255196 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:03:02.255165    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4074e1bb-7f6c-412b-b49c-3ff7708575cd-maas-api-tls\") pod \"maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj\" (UID: \"4074e1bb-7f6c-412b-b49c-3ff7708575cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj"
Jul 20 23:03:02.255196 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:03:02.255206    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4074e1bb-7f6c-412b-b49c-3ff7708575cd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj\" (UID: \"4074e1bb-7f6c-412b-b49c-3ff7708575cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj"
Jul 20 23:03:02.255437 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:03:02.255323    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw5hl\" (UniqueName: \"kubernetes.io/projected/4074e1bb-7f6c-412b-b49c-3ff7708575cd-kube-api-access-rw5hl\") pod \"maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj\" (UID: \"4074e1bb-7f6c-412b-b49c-3ff7708575cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj"
Jul 20 23:03:02.355886 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:03:02.355853    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw5hl\" (UniqueName: \"kubernetes.io/projected/4074e1bb-7f6c-412b-b49c-3ff7708575cd-kube-api-access-rw5hl\") pod \"maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj\" (UID: \"4074e1bb-7f6c-412b-b49c-3ff7708575cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj"
Jul 20 23:03:02.356085 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:03:02.355915    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4074e1bb-7f6c-412b-b49c-3ff7708575cd-maas-api-tls\") pod \"maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj\" (UID: \"4074e1bb-7f6c-412b-b49c-3ff7708575cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj"
Jul 20 23:03:02.356085 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:03:02.355953    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4074e1bb-7f6c-412b-b49c-3ff7708575cd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj\" (UID: \"4074e1bb-7f6c-412b-b49c-3ff7708575cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj"
Jul 20 23:03:02.356085 ip-10-0-133-74 kubenswrapper[2556]: E0720 23:03:02.356018    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-serving-cert: secret "maas-api-e2e-shared-b-1dd4fb-serving-cert" not found
Jul 20 23:03:02.356256 ip-10-0-133-74 kubenswrapper[2556]: E0720 23:03:02.356104    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4074e1bb-7f6c-412b-b49c-3ff7708575cd-maas-api-tls podName:4074e1bb-7f6c-412b-b49c-3ff7708575cd nodeName:}" failed. No retries permitted until 2026-07-20 23:03:02.856081245 +0000 UTC m=+2396.154297810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4074e1bb-7f6c-412b-b49c-3ff7708575cd-maas-api-tls") pod "maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj" (UID: "4074e1bb-7f6c-412b-b49c-3ff7708575cd") : secret "maas-api-e2e-shared-b-1dd4fb-serving-cert" not found
Jul 20 23:03:02.356580 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:03:02.356560    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4074e1bb-7f6c-412b-b49c-3ff7708575cd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj\" (UID: \"4074e1bb-7f6c-412b-b49c-3ff7708575cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj"
Jul 20 23:03:02.366809 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:03:02.366789    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw5hl\" (UniqueName: \"kubernetes.io/projected/4074e1bb-7f6c-412b-b49c-3ff7708575cd-kube-api-access-rw5hl\") pod \"maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj\" (UID: \"4074e1bb-7f6c-412b-b49c-3ff7708575cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj"
Jul 20 23:03:02.859662 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:03:02.859590    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4074e1bb-7f6c-412b-b49c-3ff7708575cd-maas-api-tls\") pod \"maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj\" (UID: \"4074e1bb-7f6c-412b-b49c-3ff7708575cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj"
Jul 20 23:03:02.861986 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:03:02.861964    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4074e1bb-7f6c-412b-b49c-3ff7708575cd-maas-api-tls\") pod \"maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj\" (UID: \"4074e1bb-7f6c-412b-b49c-3ff7708575cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj"
Jul 20 23:03:02.943202 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:03:02.943175    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g"
Jul 20 23:03:03.081839 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:03:03.081805    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj"
Jul 20 23:03:03.216136 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:03:03.216076    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj"]
Jul 20 23:03:03.219056 ip-10-0-133-74 kubenswrapper[2556]: W0720 23:03:03.219031    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4074e1bb_7f6c_412b_b49c_3ff7708575cd.slice/crio-d447daccdcff162b511d1c1637d5f5f359756b14fb34bf0cf6a1849d3eff80bd WatchSource:0}: Error finding container d447daccdcff162b511d1c1637d5f5f359756b14fb34bf0cf6a1849d3eff80bd: Status 404 returned error can't find the container with id d447daccdcff162b511d1c1637d5f5f359756b14fb34bf0cf6a1849d3eff80bd
Jul 20 23:03:03.968878 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:03:03.968842    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj" event={"ID":"4074e1bb-7f6c-412b-b49c-3ff7708575cd","Type":"ContainerStarted","Data":"5c8a3d5c19bce5292565d88fa91224fdd8537d2cba4a0d45fb90a43c2877eb54"}
Jul 20 23:03:03.969088 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:03:03.968893    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj" event={"ID":"4074e1bb-7f6c-412b-b49c-3ff7708575cd","Type":"ContainerStarted","Data":"d447daccdcff162b511d1c1637d5f5f359756b14fb34bf0cf6a1849d3eff80bd"}
Jul 20 23:03:03.969088 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:03:03.968923    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj"
Jul 20 23:03:03.986791 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:03:03.986734    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj" podStartSLOduration=1.589090148 podStartE2EDuration="1.986716778s" totalImagesPullingTime="397.62663ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:03:03.985015882 +0000 UTC m=+2397.283232455" watchObservedRunningTime="2026-07-20 23:03:03.986716778 +0000 UTC m=+2397.284933347"
Jul 20 23:03:09.980019 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:03:09.979987    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj"
Jul 20 23:06:20.496429 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.496390    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"]
Jul 20 23:06:20.499819 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.499803    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:06:20.502384 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.502354    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-717ec3\"/\"kube-root-ca.crt\""
Jul 20 23:06:20.502530 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.502355    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-717ec3\"/\"openshift-service-ca.crt\""
Jul 20 23:06:20.503214 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.503195    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-717ec3\"/\"sub-test-model-717ec3-kserve-self-signed-certs\""
Jul 20 23:06:20.503312 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.503235    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-717ec3\"/\"default-dockercfg-cplw4\""
Jul 20 23:06:20.510683 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.510657    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"]
Jul 20 23:06:20.568893 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.568853    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sst25\" (UniqueName: \"kubernetes.io/projected/eeb380db-f12c-421f-95b8-b7a11f03c6ee-kube-api-access-sst25\") pod \"sub-test-model-717ec3-kserve-79ff7994dc-mng6g\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") " pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:06:20.569131 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.568918    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeb380db-f12c-421f-95b8-b7a11f03c6ee-tls-certs\") pod \"sub-test-model-717ec3-kserve-79ff7994dc-mng6g\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") " pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:06:20.569131 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.568950    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-home\") pod \"sub-test-model-717ec3-kserve-79ff7994dc-mng6g\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") " pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:06:20.569131 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.569037    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-model-cache\") pod \"sub-test-model-717ec3-kserve-79ff7994dc-mng6g\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") " pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:06:20.569131 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.569091    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-dshm\") pod \"sub-test-model-717ec3-kserve-79ff7994dc-mng6g\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") " pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:06:20.569131 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.569112    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-tmp-dir\") pod \"sub-test-model-717ec3-kserve-79ff7994dc-mng6g\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") " pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:06:20.670578 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.670538    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-dshm\") pod \"sub-test-model-717ec3-kserve-79ff7994dc-mng6g\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") " pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:06:20.670578 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.670586    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-tmp-dir\") pod \"sub-test-model-717ec3-kserve-79ff7994dc-mng6g\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") " pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:06:20.670875 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.670684    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sst25\" (UniqueName: \"kubernetes.io/projected/eeb380db-f12c-421f-95b8-b7a11f03c6ee-kube-api-access-sst25\") pod \"sub-test-model-717ec3-kserve-79ff7994dc-mng6g\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") " pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:06:20.670875 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.670734    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeb380db-f12c-421f-95b8-b7a11f03c6ee-tls-certs\") pod \"sub-test-model-717ec3-kserve-79ff7994dc-mng6g\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") " pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:06:20.670875 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.670763    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-home\") pod \"sub-test-model-717ec3-kserve-79ff7994dc-mng6g\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") " pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:06:20.670875 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.670840    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-model-cache\") pod \"sub-test-model-717ec3-kserve-79ff7994dc-mng6g\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") " pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:06:20.671087 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.671056    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-tmp-dir\") pod \"sub-test-model-717ec3-kserve-79ff7994dc-mng6g\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") " pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:06:20.671152 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.671116    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-home\") pod \"sub-test-model-717ec3-kserve-79ff7994dc-mng6g\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") " pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:06:20.671264 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.671245    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-model-cache\") pod \"sub-test-model-717ec3-kserve-79ff7994dc-mng6g\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") " pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:06:20.672804 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.672781    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-dshm\") pod \"sub-test-model-717ec3-kserve-79ff7994dc-mng6g\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") " pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:06:20.673123 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.673105    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeb380db-f12c-421f-95b8-b7a11f03c6ee-tls-certs\") pod \"sub-test-model-717ec3-kserve-79ff7994dc-mng6g\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") " pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:06:20.678516 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.678494    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sst25\" (UniqueName: \"kubernetes.io/projected/eeb380db-f12c-421f-95b8-b7a11f03c6ee-kube-api-access-sst25\") pod \"sub-test-model-717ec3-kserve-79ff7994dc-mng6g\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") " pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:06:20.810241 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.810149    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:06:20.954160 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:20.954106    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"]
Jul 20 23:06:20.956675 ip-10-0-133-74 kubenswrapper[2556]: W0720 23:06:20.956648    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeeb380db_f12c_421f_95b8_b7a11f03c6ee.slice/crio-703aeb9dca3159fb7b5fd0ee263bbeb4fb0b02dfb34f46ac0ec6f4ed3a42c224 WatchSource:0}: Error finding container 703aeb9dca3159fb7b5fd0ee263bbeb4fb0b02dfb34f46ac0ec6f4ed3a42c224: Status 404 returned error can't find the container with id 703aeb9dca3159fb7b5fd0ee263bbeb4fb0b02dfb34f46ac0ec6f4ed3a42c224
Jul 20 23:06:21.944619 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:21.944571    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g" event={"ID":"eeb380db-f12c-421f-95b8-b7a11f03c6ee","Type":"ContainerStarted","Data":"73df0d568aa25a157c232adcfab554b71831c366470ad4c642f77b0e530a47ec"}
Jul 20 23:06:21.945017 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:21.944628    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g" event={"ID":"eeb380db-f12c-421f-95b8-b7a11f03c6ee","Type":"ContainerStarted","Data":"703aeb9dca3159fb7b5fd0ee263bbeb4fb0b02dfb34f46ac0ec6f4ed3a42c224"}
Jul 20 23:06:21.962294 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:21.962240    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g" podStartSLOduration=1.9622218249999999 podStartE2EDuration="1.962221825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:06:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:06:21.960826979 +0000 UTC m=+2595.259043572" watchObservedRunningTime="2026-07-20 23:06:21.962221825 +0000 UTC m=+2595.260438397"
Jul 20 23:06:30.810553 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:30.810440    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:06:30.810553 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:30.810515    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:06:30.823496 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:30.823470    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:06:30.999640 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:06:30.999599    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:07:30.946499 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:30.946457    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"]
Jul 20 23:07:45.967619 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:45.967534    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g" podUID="eeb380db-f12c-421f-95b8-b7a11f03c6ee" containerName="main" containerID="cri-o://73df0d568aa25a157c232adcfab554b71831c366470ad4c642f77b0e530a47ec" gracePeriod=45
Jul 20 23:07:46.219164 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.219100    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:07:46.311947 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.311912    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-dshm\") pod \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") "
Jul 20 23:07:46.311947 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.311955    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-tmp-dir\") pod \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") "
Jul 20 23:07:46.312207 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.312016    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-home\") pod \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") "
Jul 20 23:07:46.312207 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.312063    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sst25\" (UniqueName: \"kubernetes.io/projected/eeb380db-f12c-421f-95b8-b7a11f03c6ee-kube-api-access-sst25\") pod \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") "
Jul 20 23:07:46.312207 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.312125    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-model-cache\") pod \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") "
Jul 20 23:07:46.312207 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.312162    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeb380db-f12c-421f-95b8-b7a11f03c6ee-tls-certs\") pod \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\" (UID: \"eeb380db-f12c-421f-95b8-b7a11f03c6ee\") "
Jul 20 23:07:46.312411 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.312256    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-home" (OuterVolumeSpecName: "home") pod "eeb380db-f12c-421f-95b8-b7a11f03c6ee" (UID: "eeb380db-f12c-421f-95b8-b7a11f03c6ee"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:07:46.312411 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.312290    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "eeb380db-f12c-421f-95b8-b7a11f03c6ee" (UID: "eeb380db-f12c-421f-95b8-b7a11f03c6ee"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:07:46.312517 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.312460    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-model-cache" (OuterVolumeSpecName: "model-cache") pod "eeb380db-f12c-421f-95b8-b7a11f03c6ee" (UID: "eeb380db-f12c-421f-95b8-b7a11f03c6ee"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:07:46.312621 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.312585    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-tmp-dir\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:07:46.312683 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.312630    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-home\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:07:46.312683 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.312645    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-model-cache\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:07:46.314423 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.314390    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeb380db-f12c-421f-95b8-b7a11f03c6ee-kube-api-access-sst25" (OuterVolumeSpecName: "kube-api-access-sst25") pod "eeb380db-f12c-421f-95b8-b7a11f03c6ee" (UID: "eeb380db-f12c-421f-95b8-b7a11f03c6ee"). InnerVolumeSpecName "kube-api-access-sst25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:07:46.314566 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.314438    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-dshm" (OuterVolumeSpecName: "dshm") pod "eeb380db-f12c-421f-95b8-b7a11f03c6ee" (UID: "eeb380db-f12c-421f-95b8-b7a11f03c6ee"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:07:46.314566 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.314504    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeb380db-f12c-421f-95b8-b7a11f03c6ee-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eeb380db-f12c-421f-95b8-b7a11f03c6ee" (UID: "eeb380db-f12c-421f-95b8-b7a11f03c6ee"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 23:07:46.363043 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.363010    2556 generic.go:356] "Generic (PLEG): container finished" podID="eeb380db-f12c-421f-95b8-b7a11f03c6ee" containerID="73df0d568aa25a157c232adcfab554b71831c366470ad4c642f77b0e530a47ec" exitCode=0
Jul 20 23:07:46.363203 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.363049    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"
Jul 20 23:07:46.363203 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.363093    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g" event={"ID":"eeb380db-f12c-421f-95b8-b7a11f03c6ee","Type":"ContainerDied","Data":"73df0d568aa25a157c232adcfab554b71831c366470ad4c642f77b0e530a47ec"}
Jul 20 23:07:46.363203 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.363133    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g" event={"ID":"eeb380db-f12c-421f-95b8-b7a11f03c6ee","Type":"ContainerDied","Data":"703aeb9dca3159fb7b5fd0ee263bbeb4fb0b02dfb34f46ac0ec6f4ed3a42c224"}
Jul 20 23:07:46.363203 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.363151    2556 scope.go:117] "RemoveContainer" containerID="73df0d568aa25a157c232adcfab554b71831c366470ad4c642f77b0e530a47ec"
Jul 20 23:07:46.372626 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.372590    2556 scope.go:117] "RemoveContainer" containerID="73df0d568aa25a157c232adcfab554b71831c366470ad4c642f77b0e530a47ec"
Jul 20 23:07:46.372888 ip-10-0-133-74 kubenswrapper[2556]: E0720 23:07:46.372869    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73df0d568aa25a157c232adcfab554b71831c366470ad4c642f77b0e530a47ec\": container with ID starting with 73df0d568aa25a157c232adcfab554b71831c366470ad4c642f77b0e530a47ec not found: ID does not exist" containerID="73df0d568aa25a157c232adcfab554b71831c366470ad4c642f77b0e530a47ec"
Jul 20 23:07:46.372954 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.372901    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73df0d568aa25a157c232adcfab554b71831c366470ad4c642f77b0e530a47ec"} err="failed to get container status \"73df0d568aa25a157c232adcfab554b71831c366470ad4c642f77b0e530a47ec\": rpc error: code = NotFound desc = could not find container \"73df0d568aa25a157c232adcfab554b71831c366470ad4c642f77b0e530a47ec\": container with ID starting with 73df0d568aa25a157c232adcfab554b71831c366470ad4c642f77b0e530a47ec not found: ID does not exist"
Jul 20 23:07:46.384861 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.384837    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"]
Jul 20 23:07:46.388496 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.388474    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-717ec3/sub-test-model-717ec3-kserve-79ff7994dc-mng6g"]
Jul 20 23:07:46.414145 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.414117    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sst25\" (UniqueName: \"kubernetes.io/projected/eeb380db-f12c-421f-95b8-b7a11f03c6ee-kube-api-access-sst25\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:07:46.414145 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.414144    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeb380db-f12c-421f-95b8-b7a11f03c6ee-tls-certs\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:07:46.414361 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:46.414160    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeb380db-f12c-421f-95b8-b7a11f03c6ee-dshm\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:07:47.208626 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:07:47.208578    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeb380db-f12c-421f-95b8-b7a11f03c6ee" path="/var/lib/kubelet/pods/eeb380db-f12c-421f-95b8-b7a11f03c6ee/volumes"
Jul 20 23:08:53.067821 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:53.067782    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7702-140185560411056"]
Jul 20 23:08:53.068348 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:53.068238    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeb380db-f12c-421f-95b8-b7a11f03c6ee" containerName="main"
Jul 20 23:08:53.068348 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:53.068251    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeb380db-f12c-421f-95b8-b7a11f03c6ee" containerName="main"
Jul 20 23:08:53.068348 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:53.068327    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeb380db-f12c-421f-95b8-b7a11f03c6ee" containerName="main"
Jul 20 23:08:53.077463 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:53.077433    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7702-140185560411056"]
Jul 20 23:08:53.077693 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:53.077522    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7702-140185560411056"
Jul 20 23:08:53.079883 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:53.079865    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wsblt\""
Jul 20 23:08:53.244069 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:53.244028    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vkxb\" (UniqueName: \"kubernetes.io/projected/9c2365aa-2fa9-4575-814c-1d7c91b031cb-kube-api-access-8vkxb\") pod \"test-curl-7702-140185560411056\" (UID: \"9c2365aa-2fa9-4575-814c-1d7c91b031cb\") " pod="opendatahub/test-curl-7702-140185560411056"
Jul 20 23:08:53.344723 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:53.344634    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vkxb\" (UniqueName: \"kubernetes.io/projected/9c2365aa-2fa9-4575-814c-1d7c91b031cb-kube-api-access-8vkxb\") pod \"test-curl-7702-140185560411056\" (UID: \"9c2365aa-2fa9-4575-814c-1d7c91b031cb\") " pod="opendatahub/test-curl-7702-140185560411056"
Jul 20 23:08:53.353629 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:53.353586    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vkxb\" (UniqueName: \"kubernetes.io/projected/9c2365aa-2fa9-4575-814c-1d7c91b031cb-kube-api-access-8vkxb\") pod \"test-curl-7702-140185560411056\" (UID: \"9c2365aa-2fa9-4575-814c-1d7c91b031cb\") " pod="opendatahub/test-curl-7702-140185560411056"
Jul 20 23:08:53.389496 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:53.389449    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7702-140185560411056"
Jul 20 23:08:53.530699 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:53.530674    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7702-140185560411056"]
Jul 20 23:08:53.532747 ip-10-0-133-74 kubenswrapper[2556]: W0720 23:08:53.532714    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c2365aa_2fa9_4575_814c_1d7c91b031cb.slice/crio-5c1b8b4947ededcefd39da366b9d930688fefe9ef386dcf20479d7a97a713d8e WatchSource:0}: Error finding container 5c1b8b4947ededcefd39da366b9d930688fefe9ef386dcf20479d7a97a713d8e: Status 404 returned error can't find the container with id 5c1b8b4947ededcefd39da366b9d930688fefe9ef386dcf20479d7a97a713d8e
Jul 20 23:08:53.534203 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:53.534187    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 23:08:53.698509 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:53.698481    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7702-140185560411056" event={"ID":"9c2365aa-2fa9-4575-814c-1d7c91b031cb","Type":"ContainerStarted","Data":"5c1b8b4947ededcefd39da366b9d930688fefe9ef386dcf20479d7a97a713d8e"}
Jul 20 23:08:54.705266 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:54.705232    2556 generic.go:356] "Generic (PLEG): container finished" podID="9c2365aa-2fa9-4575-814c-1d7c91b031cb" containerID="53f4e1aaeda597a079e5029baea3489322dfe452844d9f1e63b13dcbf398c2a3" exitCode=0
Jul 20 23:08:54.705693 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:54.705290    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7702-140185560411056" event={"ID":"9c2365aa-2fa9-4575-814c-1d7c91b031cb","Type":"ContainerDied","Data":"53f4e1aaeda597a079e5029baea3489322dfe452844d9f1e63b13dcbf398c2a3"}
Jul 20 23:08:55.847944 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:55.847917    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7702-140185560411056"
Jul 20 23:08:55.869372 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:55.869343    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vkxb\" (UniqueName: \"kubernetes.io/projected/9c2365aa-2fa9-4575-814c-1d7c91b031cb-kube-api-access-8vkxb\") pod \"9c2365aa-2fa9-4575-814c-1d7c91b031cb\" (UID: \"9c2365aa-2fa9-4575-814c-1d7c91b031cb\") "
Jul 20 23:08:55.871660 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:55.871630    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c2365aa-2fa9-4575-814c-1d7c91b031cb-kube-api-access-8vkxb" (OuterVolumeSpecName: "kube-api-access-8vkxb") pod "9c2365aa-2fa9-4575-814c-1d7c91b031cb" (UID: "9c2365aa-2fa9-4575-814c-1d7c91b031cb"). InnerVolumeSpecName "kube-api-access-8vkxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:08:55.882052 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:55.881967    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7702-140185560411056_9c2365aa-2fa9-4575-814c-1d7c91b031cb/test-curl-7702-140185560411056/0.log"
Jul 20 23:08:55.906114 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:55.906080    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7702-140185560411056"]
Jul 20 23:08:55.909994 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:55.909960    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7702-140185560411056"]
Jul 20 23:08:55.971102 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:55.971018    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vkxb\" (UniqueName: \"kubernetes.io/projected/9c2365aa-2fa9-4575-814c-1d7c91b031cb-kube-api-access-8vkxb\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:08:56.030651 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:56.030600    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7702-140185560410672"]
Jul 20 23:08:56.031082 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:56.031067    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c2365aa-2fa9-4575-814c-1d7c91b031cb" containerName="test-curl-7702-140185560411056"
Jul 20 23:08:56.031134 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:56.031083    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c2365aa-2fa9-4575-814c-1d7c91b031cb" containerName="test-curl-7702-140185560411056"
Jul 20 23:08:56.031169 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:56.031148    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c2365aa-2fa9-4575-814c-1d7c91b031cb" containerName="test-curl-7702-140185560411056"
Jul 20 23:08:56.034330 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:56.034314    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7702-140185560410672"
Jul 20 23:08:56.040154 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:56.040130    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7702-140185560410672"]
Jul 20 23:08:56.071807 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:56.071780    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxj4d\" (UniqueName: \"kubernetes.io/projected/71222034-6383-4d8b-978f-5becf90d7d95-kube-api-access-cxj4d\") pod \"test-curl-7702-140185560410672\" (UID: \"71222034-6383-4d8b-978f-5becf90d7d95\") " pod="opendatahub/test-curl-7702-140185560410672"
Jul 20 23:08:56.172844 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:56.172801    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxj4d\" (UniqueName: \"kubernetes.io/projected/71222034-6383-4d8b-978f-5becf90d7d95-kube-api-access-cxj4d\") pod \"test-curl-7702-140185560410672\" (UID: \"71222034-6383-4d8b-978f-5becf90d7d95\") " pod="opendatahub/test-curl-7702-140185560410672"
Jul 20 23:08:56.180737 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:56.180710    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxj4d\" (UniqueName: \"kubernetes.io/projected/71222034-6383-4d8b-978f-5becf90d7d95-kube-api-access-cxj4d\") pod \"test-curl-7702-140185560410672\" (UID: \"71222034-6383-4d8b-978f-5becf90d7d95\") " pod="opendatahub/test-curl-7702-140185560410672"
Jul 20 23:08:56.345157 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:56.345071    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7702-140185560410672"
Jul 20 23:08:56.478488 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:56.478459    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7702-140185560410672"]
Jul 20 23:08:56.479990 ip-10-0-133-74 kubenswrapper[2556]: W0720 23:08:56.479959    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71222034_6383_4d8b_978f_5becf90d7d95.slice/crio-0841148f5706147dd880bf744eef7996a525e1fdbe49d50f8bf539da2291a067 WatchSource:0}: Error finding container 0841148f5706147dd880bf744eef7996a525e1fdbe49d50f8bf539da2291a067: Status 404 returned error can't find the container with id 0841148f5706147dd880bf744eef7996a525e1fdbe49d50f8bf539da2291a067
Jul 20 23:08:56.717511 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:56.717477    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7702-140185560411056"
Jul 20 23:08:56.717511 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:56.717489    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c1b8b4947ededcefd39da366b9d930688fefe9ef386dcf20479d7a97a713d8e"
Jul 20 23:08:56.718880 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:56.718851    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7702-140185560410672" event={"ID":"71222034-6383-4d8b-978f-5becf90d7d95","Type":"ContainerStarted","Data":"0841148f5706147dd880bf744eef7996a525e1fdbe49d50f8bf539da2291a067"}
Jul 20 23:08:56.728458 ip-10-0-133-74 kubenswrapper[2556]: E0720 23:08:56.728433    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7702-140185560411056\" is forbidden: User \"system:node:ip-10-0-133-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-74.ec2.internal' and this object" podUID="9c2365aa-2fa9-4575-814c-1d7c91b031cb" pod="opendatahub/test-curl-7702-140185560411056"
Jul 20 23:08:57.208971 ip-10-0-133-74 kubenswrapper[2556]: E0720 23:08:57.208923    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7702-140185560411056\" is forbidden: User \"system:node:ip-10-0-133-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-74.ec2.internal' and this object" podUID="9c2365aa-2fa9-4575-814c-1d7c91b031cb" pod="opendatahub/test-curl-7702-140185560411056"
Jul 20 23:08:57.213854 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:57.213826    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c2365aa-2fa9-4575-814c-1d7c91b031cb" path="/var/lib/kubelet/pods/9c2365aa-2fa9-4575-814c-1d7c91b031cb/volumes"
Jul 20 23:08:57.725211 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:57.725179    2556 generic.go:356] "Generic (PLEG): container finished" podID="71222034-6383-4d8b-978f-5becf90d7d95" containerID="425fbe940f647d7b83a6155802614736c1254380c209eb120f21ad9f16b2ce4d" exitCode=0
Jul 20 23:08:57.725393 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:57.725238    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7702-140185560410672" event={"ID":"71222034-6383-4d8b-978f-5becf90d7d95","Type":"ContainerDied","Data":"425fbe940f647d7b83a6155802614736c1254380c209eb120f21ad9f16b2ce4d"}
Jul 20 23:08:58.864201 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:58.864176    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7702-140185560410672"
Jul 20 23:08:58.885816 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:58.885793    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7702-140185560410672_71222034-6383-4d8b-978f-5becf90d7d95/test-curl-7702-140185560410672/0.log"
Jul 20 23:08:58.899445 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:58.899417    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxj4d\" (UniqueName: \"kubernetes.io/projected/71222034-6383-4d8b-978f-5becf90d7d95-kube-api-access-cxj4d\") pod \"71222034-6383-4d8b-978f-5becf90d7d95\" (UID: \"71222034-6383-4d8b-978f-5becf90d7d95\") "
Jul 20 23:08:58.901484 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:58.901461    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71222034-6383-4d8b-978f-5becf90d7d95-kube-api-access-cxj4d" (OuterVolumeSpecName: "kube-api-access-cxj4d") pod "71222034-6383-4d8b-978f-5becf90d7d95" (UID: "71222034-6383-4d8b-978f-5becf90d7d95"). InnerVolumeSpecName "kube-api-access-cxj4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:08:58.908171 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:58.908145    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7702-140185560410672"]
Jul 20 23:08:58.911886 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:58.911866    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7702-140185560410672"]
Jul 20 23:08:59.000277 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:59.000186    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxj4d\" (UniqueName: \"kubernetes.io/projected/71222034-6383-4d8b-978f-5becf90d7d95-kube-api-access-cxj4d\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:08:59.074763 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:59.074728    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7702-140185560323248"]
Jul 20 23:08:59.075129 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:59.075116    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71222034-6383-4d8b-978f-5becf90d7d95" containerName="test-curl-7702-140185560410672"
Jul 20 23:08:59.075174 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:59.075130    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="71222034-6383-4d8b-978f-5becf90d7d95" containerName="test-curl-7702-140185560410672"
Jul 20 23:08:59.075219 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:59.075195    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="71222034-6383-4d8b-978f-5becf90d7d95" containerName="test-curl-7702-140185560410672"
Jul 20 23:08:59.078276 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:59.078262    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7702-140185560323248"
Jul 20 23:08:59.084959 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:59.084932    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7702-140185560323248"]
Jul 20 23:08:59.101119 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:59.101096    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5f9d\" (UniqueName: \"kubernetes.io/projected/bc937d5e-c3a9-4bc9-93f1-02e50a13b008-kube-api-access-l5f9d\") pod \"test-curl-7702-140185560323248\" (UID: \"bc937d5e-c3a9-4bc9-93f1-02e50a13b008\") " pod="opendatahub/test-curl-7702-140185560323248"
Jul 20 23:08:59.201740 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:59.201699    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5f9d\" (UniqueName: \"kubernetes.io/projected/bc937d5e-c3a9-4bc9-93f1-02e50a13b008-kube-api-access-l5f9d\") pod \"test-curl-7702-140185560323248\" (UID: \"bc937d5e-c3a9-4bc9-93f1-02e50a13b008\") " pod="opendatahub/test-curl-7702-140185560323248"
Jul 20 23:08:59.206769 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:59.206743    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71222034-6383-4d8b-978f-5becf90d7d95" path="/var/lib/kubelet/pods/71222034-6383-4d8b-978f-5becf90d7d95/volumes"
Jul 20 23:08:59.210419 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:59.210395    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5f9d\" (UniqueName: \"kubernetes.io/projected/bc937d5e-c3a9-4bc9-93f1-02e50a13b008-kube-api-access-l5f9d\") pod \"test-curl-7702-140185560323248\" (UID: \"bc937d5e-c3a9-4bc9-93f1-02e50a13b008\") " pod="opendatahub/test-curl-7702-140185560323248"
Jul 20 23:08:59.389760 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:59.389680    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7702-140185560323248"
Jul 20 23:08:59.728470 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:59.728397    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7702-140185560323248"]
Jul 20 23:08:59.730574 ip-10-0-133-74 kubenswrapper[2556]: W0720 23:08:59.730547    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc937d5e_c3a9_4bc9_93f1_02e50a13b008.slice/crio-b90ebc8eb9960f936b22e36b51ca52ccae35bb3ad24e0694b91ee7416dde93c4 WatchSource:0}: Error finding container b90ebc8eb9960f936b22e36b51ca52ccae35bb3ad24e0694b91ee7416dde93c4: Status 404 returned error can't find the container with id b90ebc8eb9960f936b22e36b51ca52ccae35bb3ad24e0694b91ee7416dde93c4
Jul 20 23:08:59.735647 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:59.735625    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7702-140185560410672"
Jul 20 23:08:59.735750 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:08:59.735653    2556 scope.go:117] "RemoveContainer" containerID="425fbe940f647d7b83a6155802614736c1254380c209eb120f21ad9f16b2ce4d"
Jul 20 23:09:00.743804 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:00.743767    2556 generic.go:356] "Generic (PLEG): container finished" podID="bc937d5e-c3a9-4bc9-93f1-02e50a13b008" containerID="5300aebf214595c5a13410552621ed3c25fb9905d2f975a177f5981cfd6174cc" exitCode=0
Jul 20 23:09:00.744214 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:00.743850    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7702-140185560323248" event={"ID":"bc937d5e-c3a9-4bc9-93f1-02e50a13b008","Type":"ContainerDied","Data":"5300aebf214595c5a13410552621ed3c25fb9905d2f975a177f5981cfd6174cc"}
Jul 20 23:09:00.744214 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:00.743889    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7702-140185560323248" event={"ID":"bc937d5e-c3a9-4bc9-93f1-02e50a13b008","Type":"ContainerStarted","Data":"b90ebc8eb9960f936b22e36b51ca52ccae35bb3ad24e0694b91ee7416dde93c4"}
Jul 20 23:09:01.883777 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:01.883750    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7702-140185560323248"
Jul 20 23:09:01.905378 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:01.905353    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7702-140185560323248_bc937d5e-c3a9-4bc9-93f1-02e50a13b008/test-curl-7702-140185560323248/0.log"
Jul 20 23:09:01.927367 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:01.927332    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7702-140185560323248"]
Jul 20 23:09:01.929430 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:01.929400    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5f9d\" (UniqueName: \"kubernetes.io/projected/bc937d5e-c3a9-4bc9-93f1-02e50a13b008-kube-api-access-l5f9d\") pod \"bc937d5e-c3a9-4bc9-93f1-02e50a13b008\" (UID: \"bc937d5e-c3a9-4bc9-93f1-02e50a13b008\") "
Jul 20 23:09:01.931734 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:01.931699    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc937d5e-c3a9-4bc9-93f1-02e50a13b008-kube-api-access-l5f9d" (OuterVolumeSpecName: "kube-api-access-l5f9d") pod "bc937d5e-c3a9-4bc9-93f1-02e50a13b008" (UID: "bc937d5e-c3a9-4bc9-93f1-02e50a13b008"). InnerVolumeSpecName "kube-api-access-l5f9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:09:01.932039 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:01.932018    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7702-140185560323248"]
Jul 20 23:09:02.030270 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:02.030177    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5f9d\" (UniqueName: \"kubernetes.io/projected/bc937d5e-c3a9-4bc9-93f1-02e50a13b008-kube-api-access-l5f9d\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:09:02.048085 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:02.048042    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7702-140185560323248"]
Jul 20 23:09:02.048534 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:02.048515    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc937d5e-c3a9-4bc9-93f1-02e50a13b008" containerName="test-curl-7702-140185560323248"
Jul 20 23:09:02.048679 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:02.048536    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc937d5e-c3a9-4bc9-93f1-02e50a13b008" containerName="test-curl-7702-140185560323248"
Jul 20 23:09:02.048679 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:02.048670    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc937d5e-c3a9-4bc9-93f1-02e50a13b008" containerName="test-curl-7702-140185560323248"
Jul 20 23:09:02.051759 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:02.051737    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7702-140185560323248"
Jul 20 23:09:02.057989 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:02.057961    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7702-140185560323248"]
Jul 20 23:09:02.131239 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:02.131198    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brmpc\" (UniqueName: \"kubernetes.io/projected/5b220ab6-74ac-4404-9b26-73a66e4f7602-kube-api-access-brmpc\") pod \"test-curl-7702-140185560323248\" (UID: \"5b220ab6-74ac-4404-9b26-73a66e4f7602\") " pod="opendatahub/test-curl-7702-140185560323248"
Jul 20 23:09:02.232822 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:02.232781    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brmpc\" (UniqueName: \"kubernetes.io/projected/5b220ab6-74ac-4404-9b26-73a66e4f7602-kube-api-access-brmpc\") pod \"test-curl-7702-140185560323248\" (UID: \"5b220ab6-74ac-4404-9b26-73a66e4f7602\") " pod="opendatahub/test-curl-7702-140185560323248"
Jul 20 23:09:02.241361 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:02.241325    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brmpc\" (UniqueName: \"kubernetes.io/projected/5b220ab6-74ac-4404-9b26-73a66e4f7602-kube-api-access-brmpc\") pod \"test-curl-7702-140185560323248\" (UID: \"5b220ab6-74ac-4404-9b26-73a66e4f7602\") " pod="opendatahub/test-curl-7702-140185560323248"
Jul 20 23:09:02.362540 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:02.362441    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7702-140185560323248"
Jul 20 23:09:02.499695 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:02.499669    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7702-140185560323248"]
Jul 20 23:09:02.501430 ip-10-0-133-74 kubenswrapper[2556]: W0720 23:09:02.501400    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b220ab6_74ac_4404_9b26_73a66e4f7602.slice/crio-cf66d7a8746c6199906067dd63b58b547f22a1bc20b605fe45ecfb9aee9043cf WatchSource:0}: Error finding container cf66d7a8746c6199906067dd63b58b547f22a1bc20b605fe45ecfb9aee9043cf: Status 404 returned error can't find the container with id cf66d7a8746c6199906067dd63b58b547f22a1bc20b605fe45ecfb9aee9043cf
Jul 20 23:09:02.754139 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:02.754105    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7702-140185560323248" event={"ID":"5b220ab6-74ac-4404-9b26-73a66e4f7602","Type":"ContainerStarted","Data":"cf66d7a8746c6199906067dd63b58b547f22a1bc20b605fe45ecfb9aee9043cf"}
Jul 20 23:09:02.755283 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:02.755262    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7702-140185560323248"
Jul 20 23:09:02.755283 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:02.755277    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b90ebc8eb9960f936b22e36b51ca52ccae35bb3ad24e0694b91ee7416dde93c4"
Jul 20 23:09:02.766728 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:02.766696    2556 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7702-140185560323248" oldPodUID="bc937d5e-c3a9-4bc9-93f1-02e50a13b008" podUID="5b220ab6-74ac-4404-9b26-73a66e4f7602"
Jul 20 23:09:03.207194 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:03.207160    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc937d5e-c3a9-4bc9-93f1-02e50a13b008" path="/var/lib/kubelet/pods/bc937d5e-c3a9-4bc9-93f1-02e50a13b008/volumes"
Jul 20 23:09:03.762488 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:03.762461    2556 generic.go:356] "Generic (PLEG): container finished" podID="5b220ab6-74ac-4404-9b26-73a66e4f7602" containerID="5870f526ff90742b62bbacbe58cc65e4ba9fa0a35bfa8028d20c62e7192156de" exitCode=0
Jul 20 23:09:03.762718 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:03.762555    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7702-140185560323248" event={"ID":"5b220ab6-74ac-4404-9b26-73a66e4f7602","Type":"ContainerDied","Data":"5870f526ff90742b62bbacbe58cc65e4ba9fa0a35bfa8028d20c62e7192156de"}
Jul 20 23:09:04.912015 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:04.911981    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7702-140185560323248"
Jul 20 23:09:04.930424 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:04.930391    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7702-140185560323248_5b220ab6-74ac-4404-9b26-73a66e4f7602/test-curl-7702-140185560323248/0.log"
Jul 20 23:09:04.952884 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:04.952844    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7702-140185560323248"]
Jul 20 23:09:04.955985 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:04.955958    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brmpc\" (UniqueName: \"kubernetes.io/projected/5b220ab6-74ac-4404-9b26-73a66e4f7602-kube-api-access-brmpc\") pod \"5b220ab6-74ac-4404-9b26-73a66e4f7602\" (UID: \"5b220ab6-74ac-4404-9b26-73a66e4f7602\") "
Jul 20 23:09:04.956405 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:04.956385    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7702-140185560323248"]
Jul 20 23:09:04.957976 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:04.957951    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b220ab6-74ac-4404-9b26-73a66e4f7602-kube-api-access-brmpc" (OuterVolumeSpecName: "kube-api-access-brmpc") pod "5b220ab6-74ac-4404-9b26-73a66e4f7602" (UID: "5b220ab6-74ac-4404-9b26-73a66e4f7602"). InnerVolumeSpecName "kube-api-access-brmpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:09:05.056961 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:05.056884    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brmpc\" (UniqueName: \"kubernetes.io/projected/5b220ab6-74ac-4404-9b26-73a66e4f7602-kube-api-access-brmpc\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:09:05.085096 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:05.085060    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7702-140185560324256"]
Jul 20 23:09:05.085465 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:05.085448    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b220ab6-74ac-4404-9b26-73a66e4f7602" containerName="test-curl-7702-140185560323248"
Jul 20 23:09:05.085465 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:05.085463    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b220ab6-74ac-4404-9b26-73a66e4f7602" containerName="test-curl-7702-140185560323248"
Jul 20 23:09:05.085656 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:05.085530    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b220ab6-74ac-4404-9b26-73a66e4f7602" containerName="test-curl-7702-140185560323248"
Jul 20 23:09:05.088534 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:05.088516    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7702-140185560324256"
Jul 20 23:09:05.093218 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:05.093198    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7702-140185560324256"]
Jul 20 23:09:05.157867 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:05.157836    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjwnx\" (UniqueName: \"kubernetes.io/projected/3bfb9061-cda4-4391-b473-5a79f2bfb7ba-kube-api-access-sjwnx\") pod \"test-curl-7702-140185560324256\" (UID: \"3bfb9061-cda4-4391-b473-5a79f2bfb7ba\") " pod="opendatahub/test-curl-7702-140185560324256"
Jul 20 23:09:05.207474 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:05.207442    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b220ab6-74ac-4404-9b26-73a66e4f7602" path="/var/lib/kubelet/pods/5b220ab6-74ac-4404-9b26-73a66e4f7602/volumes"
Jul 20 23:09:05.258869 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:05.258837    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjwnx\" (UniqueName: \"kubernetes.io/projected/3bfb9061-cda4-4391-b473-5a79f2bfb7ba-kube-api-access-sjwnx\") pod \"test-curl-7702-140185560324256\" (UID: \"3bfb9061-cda4-4391-b473-5a79f2bfb7ba\") " pod="opendatahub/test-curl-7702-140185560324256"
Jul 20 23:09:05.266285 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:05.266263    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjwnx\" (UniqueName: \"kubernetes.io/projected/3bfb9061-cda4-4391-b473-5a79f2bfb7ba-kube-api-access-sjwnx\") pod \"test-curl-7702-140185560324256\" (UID: \"3bfb9061-cda4-4391-b473-5a79f2bfb7ba\") " pod="opendatahub/test-curl-7702-140185560324256"
Jul 20 23:09:05.398590 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:05.398513    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7702-140185560324256"
Jul 20 23:09:05.531898 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:05.531678    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7702-140185560324256"]
Jul 20 23:09:05.533996 ip-10-0-133-74 kubenswrapper[2556]: W0720 23:09:05.533971    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3bfb9061_cda4_4391_b473_5a79f2bfb7ba.slice/crio-19f37108ee861f0209e4e13b201916687b90b958bf03c5aaf6004ac0bbb04b08 WatchSource:0}: Error finding container 19f37108ee861f0209e4e13b201916687b90b958bf03c5aaf6004ac0bbb04b08: Status 404 returned error can't find the container with id 19f37108ee861f0209e4e13b201916687b90b958bf03c5aaf6004ac0bbb04b08
Jul 20 23:09:05.774622 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:05.774576    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7702-140185560323248"
Jul 20 23:09:05.774837 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:05.774586    2556 scope.go:117] "RemoveContainer" containerID="5870f526ff90742b62bbacbe58cc65e4ba9fa0a35bfa8028d20c62e7192156de"
Jul 20 23:09:05.776059 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:05.775943    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7702-140185560324256" event={"ID":"3bfb9061-cda4-4391-b473-5a79f2bfb7ba","Type":"ContainerStarted","Data":"19f37108ee861f0209e4e13b201916687b90b958bf03c5aaf6004ac0bbb04b08"}
Jul 20 23:09:06.783485 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:06.783442    2556 generic.go:356] "Generic (PLEG): container finished" podID="3bfb9061-cda4-4391-b473-5a79f2bfb7ba" containerID="0cb2ca8b29a67e7039275cd44b42945d242a626c77c2c0afde3675ca8c2c925e" exitCode=0
Jul 20 23:09:06.784008 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:06.783500    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7702-140185560324256" event={"ID":"3bfb9061-cda4-4391-b473-5a79f2bfb7ba","Type":"ContainerDied","Data":"0cb2ca8b29a67e7039275cd44b42945d242a626c77c2c0afde3675ca8c2c925e"}
Jul 20 23:09:07.931085 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:07.931057    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7702-140185560324256"
Jul 20 23:09:07.952759 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:07.952734    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7702-140185560324256_3bfb9061-cda4-4391-b473-5a79f2bfb7ba/test-curl-7702-140185560324256/0.log"
Jul 20 23:09:07.977564 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:07.977534    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7702-140185560324256"]
Jul 20 23:09:07.981586 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:07.981565    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7702-140185560324256"]
Jul 20 23:09:07.984899 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:07.984882    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjwnx\" (UniqueName: \"kubernetes.io/projected/3bfb9061-cda4-4391-b473-5a79f2bfb7ba-kube-api-access-sjwnx\") pod \"3bfb9061-cda4-4391-b473-5a79f2bfb7ba\" (UID: \"3bfb9061-cda4-4391-b473-5a79f2bfb7ba\") "
Jul 20 23:09:07.986996 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:07.986969    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bfb9061-cda4-4391-b473-5a79f2bfb7ba-kube-api-access-sjwnx" (OuterVolumeSpecName: "kube-api-access-sjwnx") pod "3bfb9061-cda4-4391-b473-5a79f2bfb7ba" (UID: "3bfb9061-cda4-4391-b473-5a79f2bfb7ba"). InnerVolumeSpecName "kube-api-access-sjwnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:09:08.086559 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:08.086471    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjwnx\" (UniqueName: \"kubernetes.io/projected/3bfb9061-cda4-4391-b473-5a79f2bfb7ba-kube-api-access-sjwnx\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:09:08.793532 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:08.793507    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7702-140185560324256"
Jul 20 23:09:08.793715 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:08.793538    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19f37108ee861f0209e4e13b201916687b90b958bf03c5aaf6004ac0bbb04b08"
Jul 20 23:09:08.803085 ip-10-0-133-74 kubenswrapper[2556]: E0720 23:09:08.803059    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7702-140185560324256\" is forbidden: User \"system:node:ip-10-0-133-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-74.ec2.internal' and this object" podUID="3bfb9061-cda4-4391-b473-5a79f2bfb7ba" pod="opendatahub/test-curl-7702-140185560324256"
Jul 20 23:09:09.207778 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:09.207750    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bfb9061-cda4-4391-b473-5a79f2bfb7ba" path="/var/lib/kubelet/pods/3bfb9061-cda4-4391-b473-5a79f2bfb7ba/volumes"
Jul 20 23:09:21.941915 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:21.941882    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g"]
Jul 20 23:09:21.942426 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:21.942150    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g" podUID="a5b82eb5-a219-41a3-b458-db009cce30c7" containerName="maas-api" containerID="cri-o://583de7d125fa8129d4eb927445dfc1af2537c75b219e972ee5685f94071f2f4f" gracePeriod=30
Jul 20 23:09:22.199215 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:22.199140    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g"
Jul 20 23:09:22.333764 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:22.333728    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5b82eb5-a219-41a3-b458-db009cce30c7-maas-api-tls\") pod \"a5b82eb5-a219-41a3-b458-db009cce30c7\" (UID: \"a5b82eb5-a219-41a3-b458-db009cce30c7\") "
Jul 20 23:09:22.333968 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:22.333783    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5b82eb5-a219-41a3-b458-db009cce30c7-openshift-service-ca\") pod \"a5b82eb5-a219-41a3-b458-db009cce30c7\" (UID: \"a5b82eb5-a219-41a3-b458-db009cce30c7\") "
Jul 20 23:09:22.333968 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:22.333840    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xktxh\" (UniqueName: \"kubernetes.io/projected/a5b82eb5-a219-41a3-b458-db009cce30c7-kube-api-access-xktxh\") pod \"a5b82eb5-a219-41a3-b458-db009cce30c7\" (UID: \"a5b82eb5-a219-41a3-b458-db009cce30c7\") "
Jul 20 23:09:22.334178 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:22.334152    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5b82eb5-a219-41a3-b458-db009cce30c7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a5b82eb5-a219-41a3-b458-db009cce30c7" (UID: "a5b82eb5-a219-41a3-b458-db009cce30c7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 23:09:22.336099 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:22.336070    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5b82eb5-a219-41a3-b458-db009cce30c7-kube-api-access-xktxh" (OuterVolumeSpecName: "kube-api-access-xktxh") pod "a5b82eb5-a219-41a3-b458-db009cce30c7" (UID: "a5b82eb5-a219-41a3-b458-db009cce30c7"). InnerVolumeSpecName "kube-api-access-xktxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:09:22.336216 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:22.336096    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5b82eb5-a219-41a3-b458-db009cce30c7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a5b82eb5-a219-41a3-b458-db009cce30c7" (UID: "a5b82eb5-a219-41a3-b458-db009cce30c7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 23:09:22.434735 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:22.434706    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5b82eb5-a219-41a3-b458-db009cce30c7-maas-api-tls\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:09:22.434735 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:22.434732    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5b82eb5-a219-41a3-b458-db009cce30c7-openshift-service-ca\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:09:22.434735 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:22.434742    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xktxh\" (UniqueName: \"kubernetes.io/projected/a5b82eb5-a219-41a3-b458-db009cce30c7-kube-api-access-xktxh\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:09:22.864907 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:22.864878    2556 generic.go:356] "Generic (PLEG): container finished" podID="a5b82eb5-a219-41a3-b458-db009cce30c7" containerID="583de7d125fa8129d4eb927445dfc1af2537c75b219e972ee5685f94071f2f4f" exitCode=0
Jul 20 23:09:22.865068 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:22.864924    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g"
Jul 20 23:09:22.865068 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:22.864964    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g" event={"ID":"a5b82eb5-a219-41a3-b458-db009cce30c7","Type":"ContainerDied","Data":"583de7d125fa8129d4eb927445dfc1af2537c75b219e972ee5685f94071f2f4f"}
Jul 20 23:09:22.865068 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:22.865014    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g" event={"ID":"a5b82eb5-a219-41a3-b458-db009cce30c7","Type":"ContainerDied","Data":"01e1c446e1e7943bf1152208a2f8a83ffa8dc960d9c62e36bd1e18512b8dd14e"}
Jul 20 23:09:22.865068 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:22.865036    2556 scope.go:117] "RemoveContainer" containerID="583de7d125fa8129d4eb927445dfc1af2537c75b219e972ee5685f94071f2f4f"
Jul 20 23:09:22.875712 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:22.875688    2556 scope.go:117] "RemoveContainer" containerID="583de7d125fa8129d4eb927445dfc1af2537c75b219e972ee5685f94071f2f4f"
Jul 20 23:09:22.876202 ip-10-0-133-74 kubenswrapper[2556]: E0720 23:09:22.876182    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"583de7d125fa8129d4eb927445dfc1af2537c75b219e972ee5685f94071f2f4f\": container with ID starting with 583de7d125fa8129d4eb927445dfc1af2537c75b219e972ee5685f94071f2f4f not found: ID does not exist" containerID="583de7d125fa8129d4eb927445dfc1af2537c75b219e972ee5685f94071f2f4f"
Jul 20 23:09:22.876281 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:22.876214    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"583de7d125fa8129d4eb927445dfc1af2537c75b219e972ee5685f94071f2f4f"} err="failed to get container status \"583de7d125fa8129d4eb927445dfc1af2537c75b219e972ee5685f94071f2f4f\": rpc error: code = NotFound desc = could not find container \"583de7d125fa8129d4eb927445dfc1af2537c75b219e972ee5685f94071f2f4f\": container with ID starting with 583de7d125fa8129d4eb927445dfc1af2537c75b219e972ee5685f94071f2f4f not found: ID does not exist"
Jul 20 23:09:22.888444 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:22.888416    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g"]
Jul 20 23:09:22.892030 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:22.892005    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-717ec3-6899fbfcb6-wwg4g"]
Jul 20 23:09:23.207081 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:23.207053    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5b82eb5-a219-41a3-b458-db009cce30c7" path="/var/lib/kubelet/pods/a5b82eb5-a219-41a3-b458-db009cce30c7/volumes"
Jul 20 23:09:44.118439 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:44.118353    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj"]
Jul 20 23:09:44.119002 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:44.118798    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj" podUID="4074e1bb-7f6c-412b-b49c-3ff7708575cd" containerName="maas-api" containerID="cri-o://5c8a3d5c19bce5292565d88fa91224fdd8537d2cba4a0d45fb90a43c2877eb54" gracePeriod=30
Jul 20 23:09:44.368409 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:44.368383    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj"
Jul 20 23:09:44.444643 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:44.444588    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4074e1bb-7f6c-412b-b49c-3ff7708575cd-maas-api-tls\") pod \"4074e1bb-7f6c-412b-b49c-3ff7708575cd\" (UID: \"4074e1bb-7f6c-412b-b49c-3ff7708575cd\") "
Jul 20 23:09:44.444848 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:44.444666    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rw5hl\" (UniqueName: \"kubernetes.io/projected/4074e1bb-7f6c-412b-b49c-3ff7708575cd-kube-api-access-rw5hl\") pod \"4074e1bb-7f6c-412b-b49c-3ff7708575cd\" (UID: \"4074e1bb-7f6c-412b-b49c-3ff7708575cd\") "
Jul 20 23:09:44.444848 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:44.444727    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4074e1bb-7f6c-412b-b49c-3ff7708575cd-openshift-service-ca\") pod \"4074e1bb-7f6c-412b-b49c-3ff7708575cd\" (UID: \"4074e1bb-7f6c-412b-b49c-3ff7708575cd\") "
Jul 20 23:09:44.445097 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:44.445067    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4074e1bb-7f6c-412b-b49c-3ff7708575cd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4074e1bb-7f6c-412b-b49c-3ff7708575cd" (UID: "4074e1bb-7f6c-412b-b49c-3ff7708575cd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 23:09:44.446704 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:44.446682    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4074e1bb-7f6c-412b-b49c-3ff7708575cd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4074e1bb-7f6c-412b-b49c-3ff7708575cd" (UID: "4074e1bb-7f6c-412b-b49c-3ff7708575cd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 23:09:44.446938 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:44.446920    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4074e1bb-7f6c-412b-b49c-3ff7708575cd-kube-api-access-rw5hl" (OuterVolumeSpecName: "kube-api-access-rw5hl") pod "4074e1bb-7f6c-412b-b49c-3ff7708575cd" (UID: "4074e1bb-7f6c-412b-b49c-3ff7708575cd"). InnerVolumeSpecName "kube-api-access-rw5hl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:09:44.546067 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:44.546028    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4074e1bb-7f6c-412b-b49c-3ff7708575cd-maas-api-tls\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:09:44.546067 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:44.546061    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rw5hl\" (UniqueName: \"kubernetes.io/projected/4074e1bb-7f6c-412b-b49c-3ff7708575cd-kube-api-access-rw5hl\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:09:44.546067 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:44.546071    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4074e1bb-7f6c-412b-b49c-3ff7708575cd-openshift-service-ca\") on node \"ip-10-0-133-74.ec2.internal\" DevicePath \"\""
Jul 20 23:09:44.981270 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:44.981233    2556 generic.go:356] "Generic (PLEG): container finished" podID="4074e1bb-7f6c-412b-b49c-3ff7708575cd" containerID="5c8a3d5c19bce5292565d88fa91224fdd8537d2cba4a0d45fb90a43c2877eb54" exitCode=0
Jul 20 23:09:44.981477 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:44.981294    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj"
Jul 20 23:09:44.981477 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:44.981310    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj" event={"ID":"4074e1bb-7f6c-412b-b49c-3ff7708575cd","Type":"ContainerDied","Data":"5c8a3d5c19bce5292565d88fa91224fdd8537d2cba4a0d45fb90a43c2877eb54"}
Jul 20 23:09:44.981477 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:44.981361    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj" event={"ID":"4074e1bb-7f6c-412b-b49c-3ff7708575cd","Type":"ContainerDied","Data":"d447daccdcff162b511d1c1637d5f5f359756b14fb34bf0cf6a1849d3eff80bd"}
Jul 20 23:09:44.981477 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:44.981383    2556 scope.go:117] "RemoveContainer" containerID="5c8a3d5c19bce5292565d88fa91224fdd8537d2cba4a0d45fb90a43c2877eb54"
Jul 20 23:09:44.990487 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:44.990470    2556 scope.go:117] "RemoveContainer" containerID="5c8a3d5c19bce5292565d88fa91224fdd8537d2cba4a0d45fb90a43c2877eb54"
Jul 20 23:09:44.990783 ip-10-0-133-74 kubenswrapper[2556]: E0720 23:09:44.990765    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c8a3d5c19bce5292565d88fa91224fdd8537d2cba4a0d45fb90a43c2877eb54\": container with ID starting with 5c8a3d5c19bce5292565d88fa91224fdd8537d2cba4a0d45fb90a43c2877eb54 not found: ID does not exist" containerID="5c8a3d5c19bce5292565d88fa91224fdd8537d2cba4a0d45fb90a43c2877eb54"
Jul 20 23:09:44.990853 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:44.990791    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c8a3d5c19bce5292565d88fa91224fdd8537d2cba4a0d45fb90a43c2877eb54"} err="failed to get container status \"5c8a3d5c19bce5292565d88fa91224fdd8537d2cba4a0d45fb90a43c2877eb54\": rpc error: code = NotFound desc = could not find container \"5c8a3d5c19bce5292565d88fa91224fdd8537d2cba4a0d45fb90a43c2877eb54\": container with ID starting with 5c8a3d5c19bce5292565d88fa91224fdd8537d2cba4a0d45fb90a43c2877eb54 not found: ID does not exist"
Jul 20 23:09:45.002458 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:45.002430    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj"]
Jul 20 23:09:45.006653 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:45.006628    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1dd4fb-7475cb986-bdvfj"]
Jul 20 23:09:45.206847 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:45.206810    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4074e1bb-7f6c-412b-b49c-3ff7708575cd" path="/var/lib/kubelet/pods/4074e1bb-7f6c-412b-b49c-3ff7708575cd/volumes"
Jul 20 23:09:55.935072 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:09:55.935032    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d5978c6dd-7snxp_b4e4792e-a668-49a6-ace9-941219d7f881/authorino/0.log"
Jul 20 23:10:02.009859 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:02.009825    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b4989886d-fkx5x_3e7e111c-8336-48f9-8790-f7c24fa8b21d/copy-manifests/0.log"
Jul 20 23:10:02.020146 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:02.020119    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b4989886d-fkx5x_3e7e111c-8336-48f9-8790-f7c24fa8b21d/manager/0.log"
Jul 20 23:10:02.480132 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:02.480099    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6b8fbcb956-ng7pl_b5bf95ac-7fbd-4724-a752-1dcdd5a9280f/maas-api/0.log"
Jul 20 23:10:04.060423 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:04.060395    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d5978c6dd-7snxp_b4e4792e-a668-49a6-ace9-941219d7f881/authorino/0.log"
Jul 20 23:10:04.626651 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:04.626619    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-pqmdl_20fb47f4-a5b3-4fa0-bb9c-e7595c1dca64/manager/0.log"
Jul 20 23:10:05.418406 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:05.418380    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76f85576d5-5mjpz_1c8a573e-d601-4406-a0ca-270f5622b82f/kube-auth-proxy/0.log"
Jul 20 23:10:06.435900 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:06.435878    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-v7vfv_66f7bff1-0f18-44b4-8b58-a5423d78a926/main/0.log"
Jul 20 23:10:06.657919 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:06.657884    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgkrjk_fc458428-5e77-4a8f-b356-4a2626d24013/main/0.log"
Jul 20 23:10:06.881811 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:06.881739    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-6sb8f_88ce2853-b431-4e52-a42e-d2ebc87a1c2a/main/0.log"
Jul 20 23:10:15.105413 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:15.105381    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-465x2_db2f1fd2-ec2a-4826-95de-24577a40fdf0/global-pull-secret-syncer/0.log"
Jul 20 23:10:15.254188 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:15.254155    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-drz7d_e744ff96-be0e-4270-8947-0410e17b97fd/konnectivity-agent/0.log"
Jul 20 23:10:15.330197 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:15.330169    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-74.ec2.internal_a82db344e86a6ac15add14bc18023b45/haproxy/0.log"
Jul 20 23:10:20.914702 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:20.914669    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d5978c6dd-7snxp_b4e4792e-a668-49a6-ace9-941219d7f881/authorino/0.log"
Jul 20 23:10:21.194326 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:21.194284    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-pqmdl_20fb47f4-a5b3-4fa0-bb9c-e7595c1dca64/manager/0.log"
Jul 20 23:10:22.942895 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:22.942860    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_972dd196-5dee-490e-b296-198118c5a1c5/alertmanager/0.log"
Jul 20 23:10:22.964287 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:22.964263    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_972dd196-5dee-490e-b296-198118c5a1c5/config-reloader/0.log"
Jul 20 23:10:22.984285 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:22.984197    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_972dd196-5dee-490e-b296-198118c5a1c5/kube-rbac-proxy-web/0.log"
Jul 20 23:10:23.003821 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.003798    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_972dd196-5dee-490e-b296-198118c5a1c5/kube-rbac-proxy/0.log"
Jul 20 23:10:23.024729 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.024702    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_972dd196-5dee-490e-b296-198118c5a1c5/kube-rbac-proxy-metric/0.log"
Jul 20 23:10:23.047522 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.047481    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_972dd196-5dee-490e-b296-198118c5a1c5/prom-label-proxy/0.log"
Jul 20 23:10:23.069050 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.069012    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_972dd196-5dee-490e-b296-198118c5a1c5/init-config-reloader/0.log"
Jul 20 23:10:23.145600 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.145570    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-p6ctq_3b7dae53-5d1f-4302-b38d-16d070ddd44f/kube-state-metrics/0.log"
Jul 20 23:10:23.168004 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.167983    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-p6ctq_3b7dae53-5d1f-4302-b38d-16d070ddd44f/kube-rbac-proxy-main/0.log"
Jul 20 23:10:23.187994 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.187972    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-p6ctq_3b7dae53-5d1f-4302-b38d-16d070ddd44f/kube-rbac-proxy-self/0.log"
Jul 20 23:10:23.210999 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.210974    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-556596fb4d-c6bwb_4775f561-03d0-44a2-95f6-ccc83cfb63d4/metrics-server/0.log"
Jul 20 23:10:23.234670 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.234580    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-lvx6p_8dc87887-02cf-4877-bd83-29e7d7e77421/monitoring-plugin/0.log"
Jul 20 23:10:23.262572 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.262545    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-djtt5_e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5/node-exporter/0.log"
Jul 20 23:10:23.281431 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.281409    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-djtt5_e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5/kube-rbac-proxy/0.log"
Jul 20 23:10:23.310291 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.310274    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-djtt5_e4dbf8b7-2eab-4f09-a246-3c4e0f910ca5/init-textfile/0.log"
Jul 20 23:10:23.492107 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.492030    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-5d2sp_97f7efca-b402-48e2-b63c-4aa4b417624d/kube-rbac-proxy-main/0.log"
Jul 20 23:10:23.511367 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.511338    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-5d2sp_97f7efca-b402-48e2-b63c-4aa4b417624d/kube-rbac-proxy-self/0.log"
Jul 20 23:10:23.530228 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.530204    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-5d2sp_97f7efca-b402-48e2-b63c-4aa4b417624d/openshift-state-metrics/0.log"
Jul 20 23:10:23.558415 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.558392    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_aff3a606-3a71-43c6-b433-8ccc61cc5b26/prometheus/0.log"
Jul 20 23:10:23.578398 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.578377    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_aff3a606-3a71-43c6-b433-8ccc61cc5b26/config-reloader/0.log"
Jul 20 23:10:23.597315 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.597294    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_aff3a606-3a71-43c6-b433-8ccc61cc5b26/thanos-sidecar/0.log"
Jul 20 23:10:23.618225 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.618206    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_aff3a606-3a71-43c6-b433-8ccc61cc5b26/kube-rbac-proxy-web/0.log"
Jul 20 23:10:23.639024 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.639005    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_aff3a606-3a71-43c6-b433-8ccc61cc5b26/kube-rbac-proxy/0.log"
Jul 20 23:10:23.675659 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.675630    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_aff3a606-3a71-43c6-b433-8ccc61cc5b26/kube-rbac-proxy-thanos/0.log"
Jul 20 23:10:23.695336 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.695316    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_aff3a606-3a71-43c6-b433-8ccc61cc5b26/init-config-reloader/0.log"
Jul 20 23:10:23.719820 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.719795    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-pz6lf_8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9/prometheus-operator/0.log"
Jul 20 23:10:23.736934 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.736907    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-pz6lf_8a55c805-15e8-4dc5-a6ea-fdb67bb3fbe9/kube-rbac-proxy/0.log"
Jul 20 23:10:23.757728 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.757667    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-blxnc_f83f2bd1-56a1-4d21-a9bd-ca074c49478c/prometheus-operator-admission-webhook/0.log"
Jul 20 23:10:23.864798 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.864769    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b5c47444-6gv2m_73d2bb5d-12c8-4d4a-b379-793cda2a1a5b/thanos-query/0.log"
Jul 20 23:10:23.882345 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.882323    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b5c47444-6gv2m_73d2bb5d-12c8-4d4a-b379-793cda2a1a5b/kube-rbac-proxy-web/0.log"
Jul 20 23:10:23.900700 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.900677    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b5c47444-6gv2m_73d2bb5d-12c8-4d4a-b379-793cda2a1a5b/kube-rbac-proxy/0.log"
Jul 20 23:10:23.920254 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.920229    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b5c47444-6gv2m_73d2bb5d-12c8-4d4a-b379-793cda2a1a5b/prom-label-proxy/0.log"
Jul 20 23:10:23.939130 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.939106    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b5c47444-6gv2m_73d2bb5d-12c8-4d4a-b379-793cda2a1a5b/kube-rbac-proxy-rules/0.log"
Jul 20 23:10:23.976369 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:23.976347    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86b5c47444-6gv2m_73d2bb5d-12c8-4d4a-b379-793cda2a1a5b/kube-rbac-proxy-metrics/0.log"
Jul 20 23:10:25.185246 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.185215    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp"]
Jul 20 23:10:25.185665 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.185565    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bfb9061-cda4-4391-b473-5a79f2bfb7ba" containerName="test-curl-7702-140185560324256"
Jul 20 23:10:25.185665 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.185575    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bfb9061-cda4-4391-b473-5a79f2bfb7ba" containerName="test-curl-7702-140185560324256"
Jul 20 23:10:25.185665 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.185596    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5b82eb5-a219-41a3-b458-db009cce30c7" containerName="maas-api"
Jul 20 23:10:25.185665 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.185601    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5b82eb5-a219-41a3-b458-db009cce30c7" containerName="maas-api"
Jul 20 23:10:25.185665 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.185622    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4074e1bb-7f6c-412b-b49c-3ff7708575cd" containerName="maas-api"
Jul 20 23:10:25.185665 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.185627    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4074e1bb-7f6c-412b-b49c-3ff7708575cd" containerName="maas-api"
Jul 20 23:10:25.185883 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.185713    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5b82eb5-a219-41a3-b458-db009cce30c7" containerName="maas-api"
Jul 20 23:10:25.185883 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.185722    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bfb9061-cda4-4391-b473-5a79f2bfb7ba" containerName="test-curl-7702-140185560324256"
Jul 20 23:10:25.185883 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.185729    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4074e1bb-7f6c-412b-b49c-3ff7708575cd" containerName="maas-api"
Jul 20 23:10:25.188967 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.188947    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp"
Jul 20 23:10:25.191796 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.191766    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-drpjk\"/\"openshift-service-ca.crt\""
Jul 20 23:10:25.191796 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.191790    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-drpjk\"/\"kube-root-ca.crt\""
Jul 20 23:10:25.192531 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.192517    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-drpjk\"/\"default-dockercfg-bdb5w\""
Jul 20 23:10:25.208187 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.208161    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp"]
Jul 20 23:10:25.221829 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.221800    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9cqd\" (UniqueName: \"kubernetes.io/projected/9249817b-3b18-41b0-8e0e-992c72be1d34-kube-api-access-r9cqd\") pod \"perf-node-gather-daemonset-jmtkp\" (UID: \"9249817b-3b18-41b0-8e0e-992c72be1d34\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp"
Jul 20 23:10:25.221961 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.221854    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9249817b-3b18-41b0-8e0e-992c72be1d34-lib-modules\") pod \"perf-node-gather-daemonset-jmtkp\" (UID: \"9249817b-3b18-41b0-8e0e-992c72be1d34\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp"
Jul 20 23:10:25.221961 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.221883    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9249817b-3b18-41b0-8e0e-992c72be1d34-podres\") pod \"perf-node-gather-daemonset-jmtkp\" (UID: \"9249817b-3b18-41b0-8e0e-992c72be1d34\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp"
Jul 20 23:10:25.222075 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.221956    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9249817b-3b18-41b0-8e0e-992c72be1d34-sys\") pod \"perf-node-gather-daemonset-jmtkp\" (UID: \"9249817b-3b18-41b0-8e0e-992c72be1d34\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp"
Jul 20 23:10:25.222136 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.222090    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9249817b-3b18-41b0-8e0e-992c72be1d34-proc\") pod \"perf-node-gather-daemonset-jmtkp\" (UID: \"9249817b-3b18-41b0-8e0e-992c72be1d34\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp"
Jul 20 23:10:25.323262 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.323218    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9249817b-3b18-41b0-8e0e-992c72be1d34-sys\") pod \"perf-node-gather-daemonset-jmtkp\" (UID: \"9249817b-3b18-41b0-8e0e-992c72be1d34\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp"
Jul 20 23:10:25.323457 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.323342    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9249817b-3b18-41b0-8e0e-992c72be1d34-sys\") pod \"perf-node-gather-daemonset-jmtkp\" (UID: \"9249817b-3b18-41b0-8e0e-992c72be1d34\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp"
Jul 20 23:10:25.323457 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.323378    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9249817b-3b18-41b0-8e0e-992c72be1d34-proc\") pod \"perf-node-gather-daemonset-jmtkp\" (UID: \"9249817b-3b18-41b0-8e0e-992c72be1d34\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp"
Jul 20 23:10:25.323566 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.323467    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9cqd\" (UniqueName: \"kubernetes.io/projected/9249817b-3b18-41b0-8e0e-992c72be1d34-kube-api-access-r9cqd\") pod \"perf-node-gather-daemonset-jmtkp\" (UID: \"9249817b-3b18-41b0-8e0e-992c72be1d34\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp"
Jul 20 23:10:25.323566 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.323478    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9249817b-3b18-41b0-8e0e-992c72be1d34-proc\") pod \"perf-node-gather-daemonset-jmtkp\" (UID: \"9249817b-3b18-41b0-8e0e-992c72be1d34\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp"
Jul 20 23:10:25.323670 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.323571    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9249817b-3b18-41b0-8e0e-992c72be1d34-lib-modules\") pod \"perf-node-gather-daemonset-jmtkp\" (UID: \"9249817b-3b18-41b0-8e0e-992c72be1d34\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp"
Jul 20 23:10:25.323714 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.323665    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9249817b-3b18-41b0-8e0e-992c72be1d34-podres\") pod \"perf-node-gather-daemonset-jmtkp\" (UID: \"9249817b-3b18-41b0-8e0e-992c72be1d34\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp"
Jul 20 23:10:25.323792 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.323774    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9249817b-3b18-41b0-8e0e-992c72be1d34-podres\") pod \"perf-node-gather-daemonset-jmtkp\" (UID: \"9249817b-3b18-41b0-8e0e-992c72be1d34\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp"
Jul 20 23:10:25.323834 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.323774    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9249817b-3b18-41b0-8e0e-992c72be1d34-lib-modules\") pod \"perf-node-gather-daemonset-jmtkp\" (UID: \"9249817b-3b18-41b0-8e0e-992c72be1d34\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp"
Jul 20 23:10:25.331211 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.331183    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9cqd\" (UniqueName: \"kubernetes.io/projected/9249817b-3b18-41b0-8e0e-992c72be1d34-kube-api-access-r9cqd\") pod \"perf-node-gather-daemonset-jmtkp\" (UID: \"9249817b-3b18-41b0-8e0e-992c72be1d34\") " pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp"
Jul 20 23:10:25.499268 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.499185    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp"
Jul 20 23:10:25.634841 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:25.634812    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp"]
Jul 20 23:10:25.636547 ip-10-0-133-74 kubenswrapper[2556]: W0720 23:10:25.636520    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9249817b_3b18_41b0_8e0e_992c72be1d34.slice/crio-076ab51b8b3e4ce545e79435d92cc2fed5bd499c568fdb39f886a5ba94ccdd0e WatchSource:0}: Error finding container 076ab51b8b3e4ce545e79435d92cc2fed5bd499c568fdb39f886a5ba94ccdd0e: Status 404 returned error can't find the container with id 076ab51b8b3e4ce545e79435d92cc2fed5bd499c568fdb39f886a5ba94ccdd0e
Jul 20 23:10:26.185205 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:26.185172    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp" event={"ID":"9249817b-3b18-41b0-8e0e-992c72be1d34","Type":"ContainerStarted","Data":"9f60682ea0d54935be79a91ec1f1ab5b6aee27d00d2e97425eb29656e55d2198"}
Jul 20 23:10:26.185422 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:26.185224    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp" event={"ID":"9249817b-3b18-41b0-8e0e-992c72be1d34","Type":"ContainerStarted","Data":"076ab51b8b3e4ce545e79435d92cc2fed5bd499c568fdb39f886a5ba94ccdd0e"}
Jul 20 23:10:26.185422 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:26.185287    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp"
Jul 20 23:10:26.203047 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:26.202999    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp" podStartSLOduration=1.202983529 podStartE2EDuration="1.202983529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 23:10:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:10:26.200968688 +0000 UTC m=+2839.499185260" watchObservedRunningTime="2026-07-20 23:10:26.202983529 +0000 UTC m=+2839.501200135"
Jul 20 23:10:27.980761 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:27.980729    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ms5c6_06714327-8e4d-4ad8-b6cb-53290121c68c/dns/0.log"
Jul 20 23:10:28.003443 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:28.003414    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ms5c6_06714327-8e4d-4ad8-b6cb-53290121c68c/kube-rbac-proxy/0.log"
Jul 20 23:10:28.158117 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:28.158090    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-llqcs_cbfdd4e1-476f-4dbb-b7de-51d307901a3f/dns-node-resolver/0.log"
Jul 20 23:10:28.703659 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:28.703634    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-55kwx_7628eb97-7435-415a-bfa4-6cb8bbede73b/node-ca/0.log"
Jul 20 23:10:29.803897 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:29.803871    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76f85576d5-5mjpz_1c8a573e-d601-4406-a0ca-270f5622b82f/kube-auth-proxy/0.log"
Jul 20 23:10:30.668626 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:30.668586    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5jdrv_eef3eaa1-c989-4c61-85cb-83e05b1c51e6/serve-healthcheck-canary/0.log"
Jul 20 23:10:31.343094 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:31.343059    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nzvqr_c20f3abd-d34c-4a8b-9607-dd685e3baf6f/kube-rbac-proxy/0.log"
Jul 20 23:10:31.362377 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:31.362356    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nzvqr_c20f3abd-d34c-4a8b-9607-dd685e3baf6f/exporter/0.log"
Jul 20 23:10:31.381107 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:31.381077    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nzvqr_c20f3abd-d34c-4a8b-9607-dd685e3baf6f/extractor/0.log"
Jul 20 23:10:32.200121 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:32.200096    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-drpjk/perf-node-gather-daemonset-jmtkp"
Jul 20 23:10:34.075260 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:34.075230    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b4989886d-fkx5x_3e7e111c-8336-48f9-8790-f7c24fa8b21d/manager/0.log"
Jul 20 23:10:34.099786 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:34.099763    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b4989886d-fkx5x_3e7e111c-8336-48f9-8790-f7c24fa8b21d/copy-manifests/0.log"
Jul 20 23:10:35.529535 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:35.529513    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7f85f98759-fzrk2_7fdee320-440f-4b46-8559-3005a4b97be8/manager/0.log"
Jul 20 23:10:35.568199 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:35.568128    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76f85576d5-5mjpz_1c8a573e-d601-4406-a0ca-270f5622b82f/kube-auth-proxy/0.log"
Jul 20 23:10:37.117282 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:37.117252    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76f85576d5-5mjpz_1c8a573e-d601-4406-a0ca-270f5622b82f/kube-auth-proxy/0.log"
Jul 20 23:10:42.178135 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:42.178105    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8clnl_fafbbaf1-20bc-4827-9ff8-30d34f880dbd/kube-multus-additional-cni-plugins/0.log"
Jul 20 23:10:42.198584 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:42.198556    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8clnl_fafbbaf1-20bc-4827-9ff8-30d34f880dbd/egress-router-binary-copy/0.log"
Jul 20 23:10:42.219056 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:42.219027    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8clnl_fafbbaf1-20bc-4827-9ff8-30d34f880dbd/cni-plugins/0.log"
Jul 20 23:10:42.237383 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:42.237355    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8clnl_fafbbaf1-20bc-4827-9ff8-30d34f880dbd/bond-cni-plugin/0.log"
Jul 20 23:10:42.263546 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:42.263523    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8clnl_fafbbaf1-20bc-4827-9ff8-30d34f880dbd/routeoverride-cni/0.log"
Jul 20 23:10:42.288263 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:42.288237    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8clnl_fafbbaf1-20bc-4827-9ff8-30d34f880dbd/whereabouts-cni-bincopy/0.log"
Jul 20 23:10:42.306877 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:42.306854    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8clnl_fafbbaf1-20bc-4827-9ff8-30d34f880dbd/whereabouts-cni/0.log"
Jul 20 23:10:42.487419 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:42.487341    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fm4hh_5a37a744-9bdb-4257-99b9-dccada162ae2/kube-multus/0.log"
Jul 20 23:10:42.569104 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:42.569075    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f5458_5aa2732a-c080-4b95-af51-91052aeb9be2/network-metrics-daemon/0.log"
Jul 20 23:10:42.587795 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:42.587770    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f5458_5aa2732a-c080-4b95-af51-91052aeb9be2/kube-rbac-proxy/0.log"
Jul 20 23:10:43.482051 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:43.482020    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dl7kw_74e2adba-9c9c-4c73-b9a5-99caf4bb1dac/ovn-controller/0.log"
Jul 20 23:10:43.497444 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:43.497417    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dl7kw_74e2adba-9c9c-4c73-b9a5-99caf4bb1dac/ovn-acl-logging/0.log"
Jul 20 23:10:43.519129 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:43.519106    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dl7kw_74e2adba-9c9c-4c73-b9a5-99caf4bb1dac/kube-rbac-proxy-node/0.log"
Jul 20 23:10:43.539202 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:43.539179    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dl7kw_74e2adba-9c9c-4c73-b9a5-99caf4bb1dac/kube-rbac-proxy-ovn-metrics/0.log"
Jul 20 23:10:43.564558 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:43.564537    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dl7kw_74e2adba-9c9c-4c73-b9a5-99caf4bb1dac/northd/0.log"
Jul 20 23:10:43.583690 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:43.583667    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dl7kw_74e2adba-9c9c-4c73-b9a5-99caf4bb1dac/nbdb/0.log"
Jul 20 23:10:43.603335 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:43.603315    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dl7kw_74e2adba-9c9c-4c73-b9a5-99caf4bb1dac/sbdb/0.log"
Jul 20 23:10:43.656973 ip-10-0-133-74 kubenswrapper[2556]: I0720 23:10:43.656941    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dl7kw_74e2adba-9c9c-4c73-b9a5-99caf4bb1dac/ovnkube-controller/0.log"