Jul 18 00:38:25.349223 ip-10-0-130-166 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 18 00:38:25.349236 ip-10-0-130-166 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 18 00:38:25.349246 ip-10-0-130-166 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 18 00:38:25.349572 ip-10-0-130-166 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 18 00:38:35.517124 ip-10-0-130-166 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 18 00:38:35.517146 ip-10-0-130-166 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot b7196a948b80442b81aa70ad58d85012 --
Jul 18 00:40:32.107477 ip-10-0-130-166 systemd[1]: Starting Kubernetes Kubelet...
Jul 18 00:40:32.427729 ip-10-0-130-166 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 00:40:32.427729 ip-10-0-130-166 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 18 00:40:32.427729 ip-10-0-130-166 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 00:40:32.427729 ip-10-0-130-166 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 18 00:40:32.427729 ip-10-0-130-166 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 00:40:32.429214 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.429041    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 18 00:40:32.434052 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434037    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 00:40:32.434052 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434051    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 00:40:32.434119 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434057    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 00:40:32.434119 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434060    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 00:40:32.434119 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434063    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 00:40:32.434119 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434066    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 00:40:32.434119 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434069    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 00:40:32.434119 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434073    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 00:40:32.434119 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434075    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 00:40:32.434119 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434078    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 00:40:32.434119 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434080    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 00:40:32.434119 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434084    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 00:40:32.434119 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434089    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 00:40:32.434119 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434093    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 00:40:32.434119 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434096    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 00:40:32.434119 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434098    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 00:40:32.434119 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434101    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 00:40:32.434119 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434104    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 00:40:32.434119 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434107    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 00:40:32.434119 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434110    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 00:40:32.434119 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434112    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 00:40:32.434601 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434115    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 00:40:32.434601 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434118    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 00:40:32.434601 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434121    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 00:40:32.434601 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434123    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 00:40:32.434601 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434127    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 00:40:32.434601 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434130    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 00:40:32.434601 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434132    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 00:40:32.434601 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434135    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 00:40:32.434601 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434138    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 00:40:32.434601 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434140    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 00:40:32.434601 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434142    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 00:40:32.434601 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434145    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 00:40:32.434601 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434147    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 00:40:32.434601 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434150    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 00:40:32.434601 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434152    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 00:40:32.434601 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434154    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 00:40:32.434601 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434157    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 00:40:32.434601 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434159    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 00:40:32.434601 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434162    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 00:40:32.434601 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434164    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 00:40:32.435098 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434166    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 00:40:32.435098 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434169    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 00:40:32.435098 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434171    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 00:40:32.435098 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434174    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 00:40:32.435098 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434176    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 00:40:32.435098 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434192    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 00:40:32.435098 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434201    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 00:40:32.435098 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434204    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 00:40:32.435098 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434207    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 00:40:32.435098 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434209    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 00:40:32.435098 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434212    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 00:40:32.435098 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434215    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 00:40:32.435098 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434218    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 00:40:32.435098 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434221    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 00:40:32.435098 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434223    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 00:40:32.435098 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434226    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 00:40:32.435098 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434228    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 00:40:32.435098 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434231    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 00:40:32.435098 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434234    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 00:40:32.435098 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434236    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 00:40:32.435681 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434239    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 00:40:32.435681 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434241    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 00:40:32.435681 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434244    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 00:40:32.435681 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434246    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 00:40:32.435681 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434248    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 00:40:32.435681 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434251    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 00:40:32.435681 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434253    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 00:40:32.435681 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434256    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 00:40:32.435681 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434258    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 00:40:32.435681 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434260    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 00:40:32.435681 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434263    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 00:40:32.435681 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434267    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 00:40:32.435681 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434269    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 00:40:32.435681 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434272    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 00:40:32.435681 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434276    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 00:40:32.435681 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434278    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 00:40:32.435681 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434281    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 00:40:32.435681 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434283    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 00:40:32.435681 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434286    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 00:40:32.436203 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434289    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 00:40:32.436203 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434291    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 00:40:32.436203 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434294    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 00:40:32.436203 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434296    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 00:40:32.436203 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434299    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 00:40:32.436203 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434302    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 00:40:32.436203 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434305    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 00:40:32.436203 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434307    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 00:40:32.436203 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434310    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 00:40:32.436203 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434313    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 00:40:32.436203 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434315    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 00:40:32.436203 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434318    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 00:40:32.436203 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434320    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 00:40:32.436203 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434322    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 00:40:32.436203 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434326    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 00:40:32.436203 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434330    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 00:40:32.436203 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434332    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 00:40:32.436203 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434335    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 00:40:32.436203 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.434337    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 00:40:32.437014 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.436999    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 00:40:32.437014 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437015    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 00:40:32.437068 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437019    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 00:40:32.437068 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437021    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 00:40:32.437068 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437025    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 00:40:32.437068 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437028    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 00:40:32.437068 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437031    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 00:40:32.437068 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437033    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 00:40:32.437068 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437036    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 00:40:32.437068 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437039    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 00:40:32.437068 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437041    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 00:40:32.437068 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437044    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 00:40:32.437068 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437049    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 00:40:32.437068 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437053    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 00:40:32.437068 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437057    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 00:40:32.437068 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437060    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 00:40:32.437068 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437062    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 00:40:32.437068 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437065    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 00:40:32.437068 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437068    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 00:40:32.437068 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437070    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 00:40:32.437068 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437073    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 00:40:32.437068 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437076    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 00:40:32.437593 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437079    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 00:40:32.437593 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437082    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 00:40:32.437593 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437085    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 00:40:32.437593 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437087    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 00:40:32.437593 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437090    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 00:40:32.437593 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437092    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 00:40:32.437593 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437095    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 00:40:32.437593 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437097    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 00:40:32.437593 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437099    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 00:40:32.437593 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437102    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 00:40:32.437593 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437105    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 00:40:32.437593 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437107    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 00:40:32.437593 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437110    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 00:40:32.437593 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437112    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 00:40:32.437593 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437115    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 00:40:32.437593 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437117    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 00:40:32.437593 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437122    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 00:40:32.437593 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437125    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 00:40:32.437593 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437128    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 00:40:32.437593 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437130    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 00:40:32.438143 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437132    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 00:40:32.438143 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437135    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 00:40:32.438143 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437137    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 00:40:32.438143 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437139    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 00:40:32.438143 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437142    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 00:40:32.438143 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437145    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 00:40:32.438143 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437147    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 00:40:32.438143 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437150    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 00:40:32.438143 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437152    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 00:40:32.438143 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437155    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 00:40:32.438143 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437158    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 00:40:32.438143 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437160    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 00:40:32.438143 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437163    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 00:40:32.438143 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437166    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 00:40:32.438143 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437169    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 00:40:32.438143 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437171    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 00:40:32.438143 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437174    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 00:40:32.438143 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437177    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 00:40:32.438143 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437196    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 00:40:32.438143 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437200    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 00:40:32.438653 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437203    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 00:40:32.438653 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437205    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 00:40:32.438653 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437208    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 00:40:32.438653 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437210    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 00:40:32.438653 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437213    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 00:40:32.438653 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437217    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 00:40:32.438653 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437219    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 00:40:32.438653 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437222    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 00:40:32.438653 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437224    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 00:40:32.438653 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437227    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 00:40:32.438653 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437229    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 00:40:32.438653 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437231    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 00:40:32.438653 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437234    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 00:40:32.438653 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437236    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 00:40:32.438653 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437239    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 00:40:32.438653 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437242    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 00:40:32.438653 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437244    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 00:40:32.438653 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437247    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 00:40:32.438653 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437249    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 00:40:32.438653 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437252    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 00:40:32.439133 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437254    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 00:40:32.439133 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437258    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 00:40:32.439133 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437261    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 00:40:32.439133 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437263    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 00:40:32.439133 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437266    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 00:40:32.439133 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437269    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 00:40:32.439133 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437272    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 00:40:32.439133 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437275    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 00:40:32.439133 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437277    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 00:40:32.439133 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437279    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 00:40:32.439133 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437282    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 00:40:32.439133 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437284    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 00:40:32.439133 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437287    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 00:40:32.439133 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437290    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 00:40:32.439133 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437292    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 00:40:32.439133 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437295    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 00:40:32.439133 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437297    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 00:40:32.439133 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437673    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 00:40:32.439133 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437678    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 00:40:32.439133 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437681    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 00:40:32.439626 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437683    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 00:40:32.439626 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437686    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 00:40:32.439626 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437688    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 00:40:32.439626 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437691    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 00:40:32.439626 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437693    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 00:40:32.439626 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437696    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 00:40:32.439626 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437698    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 00:40:32.439626 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437700    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 00:40:32.439626 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437704    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 00:40:32.439626 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437707    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 00:40:32.439626 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437710    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 00:40:32.439626 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437712    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 00:40:32.439626 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437715    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 00:40:32.439626 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437718    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 00:40:32.439626 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437721    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 00:40:32.439626 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437725    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 00:40:32.439626 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437729    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 00:40:32.439626 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437732    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 00:40:32.439626 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437735    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 00:40:32.439626 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437739    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 00:40:32.440132 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437742    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 00:40:32.440132 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437744    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 00:40:32.440132 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437747    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 00:40:32.440132 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437749    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 00:40:32.440132 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437752    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 00:40:32.440132 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437754    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 00:40:32.440132 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437757    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 00:40:32.440132 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437759    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 00:40:32.440132 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437761    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 00:40:32.440132 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437764    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 00:40:32.440132 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437766    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 00:40:32.440132 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437769    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 00:40:32.440132 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437771    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 00:40:32.440132 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437774    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 00:40:32.440132 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437776    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 00:40:32.440132 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437778    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 00:40:32.440132 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437781    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 00:40:32.440132 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437783    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 00:40:32.440132 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437786    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 00:40:32.440605 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437789    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 00:40:32.440605 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437792    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 00:40:32.440605 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437795    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 00:40:32.440605 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437797    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 00:40:32.440605 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437800    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 00:40:32.440605 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437803    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 00:40:32.440605 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437805    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 00:40:32.440605 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437808    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 00:40:32.440605 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437811    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 00:40:32.440605 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437813    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 00:40:32.440605 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437816    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 00:40:32.440605 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437819    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 00:40:32.440605 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437821    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 00:40:32.440605 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437824    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 00:40:32.440605 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437826    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 00:40:32.440605 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437828    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 00:40:32.440605 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437831    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 00:40:32.440605 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437833    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 00:40:32.440605 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437836    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 00:40:32.440605 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437838    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 00:40:32.441104 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437840    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 00:40:32.441104 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437843    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 00:40:32.441104 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437845    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 00:40:32.441104 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437848    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 00:40:32.441104 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437850    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 00:40:32.441104 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437853    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 00:40:32.441104 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437855    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 00:40:32.441104 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437858    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 00:40:32.441104 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437860    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 00:40:32.441104 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437863    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 00:40:32.441104 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437868    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 00:40:32.441104 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437871    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 00:40:32.441104 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437874    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 00:40:32.441104 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437878    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 00:40:32.441104 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437881    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 00:40:32.441104 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437883    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 00:40:32.441104 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437886    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 00:40:32.441104 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437888    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 00:40:32.441104 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437891    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 00:40:32.441104 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437893    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 00:40:32.441610 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437896    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 00:40:32.441610 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437898    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 00:40:32.441610 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437901    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 00:40:32.441610 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437904    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 00:40:32.441610 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437906    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 00:40:32.441610 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437908    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 00:40:32.441610 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437911    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 00:40:32.441610 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437913    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 00:40:32.441610 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437915    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 00:40:32.441610 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437918    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 00:40:32.441610 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437920    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 00:40:32.441610 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437923    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 00:40:32.441610 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437926    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 00:40:32.441610 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437929    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 00:40:32.441610 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437931    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 00:40:32.441610 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437933    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 00:40:32.441610 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.437936    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 00:40:32.441610 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438005    2575 flags.go:64] FLAG: --address="0.0.0.0"
Jul 18 00:40:32.441610 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438012    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 18 00:40:32.441610 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438018    2575 flags.go:64] FLAG: --anonymous-auth="true"
Jul 18 00:40:32.442091 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438030    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 18 00:40:32.442091 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438034    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 18 00:40:32.442091 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438037    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 18 00:40:32.442091 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438041    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 18 00:40:32.442091 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438047    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 18 00:40:32.442091 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438050    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 18 00:40:32.442091 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438053    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 18 00:40:32.442091 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438057    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 18 00:40:32.442091 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438060    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 18 00:40:32.442091 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438063    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 18 00:40:32.442091 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438066    2575 flags.go:64] FLAG: --cgroup-root=""
Jul 18 00:40:32.442091 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438068    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 18 00:40:32.442091 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438071    2575 flags.go:64] FLAG: --client-ca-file=""
Jul 18 00:40:32.442091 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438075    2575 flags.go:64] FLAG: --cloud-provider="external"
Jul 18 00:40:32.442091 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438078    2575 flags.go:64] FLAG: --cluster-dns="[]"
Jul 18 00:40:32.442091 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438082    2575 flags.go:64] FLAG: --cluster-domain=""
Jul 18 00:40:32.442091 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438085    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 18 00:40:32.442091 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438088    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 18 00:40:32.442091 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438091    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 18 00:40:32.442091 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438094    2575 flags.go:64] FLAG: --container-log-max-files="5"
Jul 18 00:40:32.442091 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438097    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 18 00:40:32.442091 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438100    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 18 00:40:32.442091 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438103    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438106    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438109    2575 flags.go:64] FLAG: --contention-profiling="false"
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438112    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438115    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438118    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438120    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438124    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438127    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438130    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438132    2575 flags.go:64] FLAG: --enable-load-reader="false"
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438135    2575 flags.go:64] FLAG: --enable-server="true"
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438138    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438142    2575 flags.go:64] FLAG: --event-burst="100"
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438145    2575 flags.go:64] FLAG: --event-qps="50"
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438148    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438152    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438155    2575 flags.go:64] FLAG: --eviction-hard=""
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438158    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438161    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438164    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438167    2575 flags.go:64] FLAG: --eviction-soft=""
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438169    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438172    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438175    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 18 00:40:32.442678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438178    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438195    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438198    2575 flags.go:64] FLAG: --fail-swap-on="true"
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438201    2575 flags.go:64] FLAG: --feature-gates=""
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438204    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438207    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438210    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438213    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438215    2575 flags.go:64] FLAG: --healthz-port="10248"
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438218    2575 flags.go:64] FLAG: --help="false"
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438221    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-130-166.ec2.internal"
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438224    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438226    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438229    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438232    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438235    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438238    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438241    2575 flags.go:64] FLAG: --image-service-endpoint=""
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438243    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438247    2575 flags.go:64] FLAG: --kube-api-burst="100"
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438250    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438253    2575 flags.go:64] FLAG: --kube-api-qps="50"
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438255    2575 flags.go:64] FLAG: --kube-reserved=""
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438258    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 18 00:40:32.443309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438261    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438263    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438266    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438269    2575 flags.go:64] FLAG: --lock-file=""
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438271    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438274    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438277    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438282    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438285    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438288    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438291    2575 flags.go:64] FLAG: --logging-format="text"
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438293    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438296    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438299    2575 flags.go:64] FLAG: --manifest-url=""
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438301    2575 flags.go:64] FLAG: --manifest-url-header=""
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438305    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438308    2575 flags.go:64] FLAG: --max-open-files="1000000"
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438312    2575 flags.go:64] FLAG: --max-pods="110"
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438315    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438317    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438320    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438323    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438326    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438328    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438331    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 18 00:40:32.443885 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438338    2575 flags.go:64] FLAG: --node-status-max-images="50"
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438341    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438344    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438350    2575 flags.go:64] FLAG: --pod-cidr=""
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438353    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438358    2575 flags.go:64] FLAG: --pod-manifest-path=""
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438361    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438364    2575 flags.go:64] FLAG: --pods-per-core="0"
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438367    2575 flags.go:64] FLAG: --port="10250"
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438370    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438373    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0751c0b3b90f88040"
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438376    2575 flags.go:64] FLAG: --qos-reserved=""
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438379    2575 flags.go:64] FLAG: --read-only-port="10255"
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438382    2575 flags.go:64] FLAG: --register-node="true"
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438385    2575 flags.go:64] FLAG: --register-with-taints=""
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438388    2575 flags.go:64] FLAG: --registry-burst="10"
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438392    2575 flags.go:64] FLAG: --registry-qps="5"
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438394    2575 flags.go:64] FLAG: --reserved-cpus=""
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438397    2575 flags.go:64] FLAG: --reserved-memory=""
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438400    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438403    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438406    2575 flags.go:64] FLAG: --rotate-certificates="false"
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438409    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438411    2575 flags.go:64] FLAG: --runonce="false"
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438414    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 18 00:40:32.444613 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438417    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438420    2575 flags.go:64] FLAG: --seccomp-default="false"
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438422    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438425    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438427    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438430    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438434    2575 flags.go:64] FLAG: --storage-driver-password="root"
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438436    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438439    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438443    2575 flags.go:64] FLAG: --storage-driver-user="root"
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438447    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438450    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438453    2575 flags.go:64] FLAG: --system-cgroups=""
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438455    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438460    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438463    2575 flags.go:64] FLAG: --tls-cert-file=""
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438466    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438473    2575 flags.go:64] FLAG: --tls-min-version=""
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438475    2575 flags.go:64] FLAG: --tls-private-key-file=""
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438478    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438481    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438484    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438487    2575 flags.go:64] FLAG: --v="2"
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438490    2575 flags.go:64] FLAG: --version="false"
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438495    2575 flags.go:64] FLAG: --vmodule=""
Jul 18 00:40:32.445762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438498    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 18 00:40:32.446845 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.438501    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 18 00:40:32.446845 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438631    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 00:40:32.446845 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438635    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 00:40:32.446845 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438639    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 00:40:32.446845 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438642    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 00:40:32.446845 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438645    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 00:40:32.446845 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438647    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 00:40:32.446845 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438650    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 00:40:32.446845 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438652    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 00:40:32.446845 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438655    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 00:40:32.446845 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438657    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 00:40:32.446845 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438660    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 00:40:32.446845 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438664    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 00:40:32.446845 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438667    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 00:40:32.446845 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438670    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 00:40:32.446845 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438673    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 00:40:32.446845 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438677    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 00:40:32.446845 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438680    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 00:40:32.446845 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438682    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 00:40:32.446845 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438685    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 00:40:32.447501 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438687    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 00:40:32.447501 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438690    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 00:40:32.447501 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438692    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 00:40:32.447501 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438695    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 00:40:32.447501 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438697    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 00:40:32.447501 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438700    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 00:40:32.447501 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438702    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 00:40:32.447501 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438705    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 00:40:32.447501 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438707    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 00:40:32.447501 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438710    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 00:40:32.447501 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438712    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 00:40:32.447501 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438715    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 00:40:32.447501 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438717    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 00:40:32.447501 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438719    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 00:40:32.447501 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438722    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 00:40:32.447501 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438724    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 00:40:32.447501 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438727    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 00:40:32.447501 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438729    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 00:40:32.447501 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438731    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 00:40:32.447501 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438734    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 00:40:32.448288 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438736    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 00:40:32.448288 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438739    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 00:40:32.448288 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438741    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 00:40:32.448288 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438744    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 00:40:32.448288 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438747    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 00:40:32.448288 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438749    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 00:40:32.448288 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438753    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 00:40:32.448288 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438757    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 00:40:32.448288 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438762    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 00:40:32.448288 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438764    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 00:40:32.448288 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438767    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 00:40:32.448288 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438770    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 00:40:32.448288 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438773    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 00:40:32.448288 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438776    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 00:40:32.448288 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438778    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 00:40:32.448288 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438781    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 00:40:32.448288 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438783    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 00:40:32.448288 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438786    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 00:40:32.448288 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438788    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 00:40:32.449092 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438791    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 00:40:32.449092 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438793    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 00:40:32.449092 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438796    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 00:40:32.449092 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438798    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 00:40:32.449092 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438801    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 00:40:32.449092 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438804    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 00:40:32.449092 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438807    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 00:40:32.449092 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438809    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 00:40:32.449092 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438812    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 00:40:32.449092 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438814    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 00:40:32.449092 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438817    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 00:40:32.449092 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438819    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 00:40:32.449092 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438823    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 00:40:32.449092 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438826    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 00:40:32.449092 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438829    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 00:40:32.449092 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438831    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 00:40:32.449092 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438834    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 00:40:32.449092 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438837    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 00:40:32.449092 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438839    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 00:40:32.449671 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438842    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 00:40:32.449671 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438846    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 00:40:32.449671 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438851    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 00:40:32.449671 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438853    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 00:40:32.449671 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438856    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 00:40:32.449671 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438858    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 00:40:32.449671 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438861    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 00:40:32.449671 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438863    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 00:40:32.449671 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438866    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 00:40:32.449671 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438868    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 00:40:32.449671 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438870    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 00:40:32.449671 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438873    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 00:40:32.449671 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438875    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 00:40:32.449671 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438878    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 00:40:32.449671 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438880    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 00:40:32.449671 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438882    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 00:40:32.449671 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438885    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 00:40:32.449671 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438888    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 00:40:32.449671 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438890    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 00:40:32.449671 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438893    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 00:40:32.450498 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438895    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 00:40:32.450498 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.438897    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 00:40:32.450498 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.439373    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 00:40:32.450498 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.447046    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 18 00:40:32.450498 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.447065    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 18 00:40:32.450498 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.447636    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 18 00:40:32.450498 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.447650    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 18 00:40:32.450498 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447735    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 00:40:32.450498 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447743    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 00:40:32.450498 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447749    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 00:40:32.450498 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447753    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 00:40:32.450498 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447758    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 00:40:32.450498 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447762    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 00:40:32.450498 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447766    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 00:40:32.450498 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447770    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 00:40:32.451109 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447775    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 00:40:32.451109 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447779    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 00:40:32.451109 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447784    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 00:40:32.451109 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447788    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 00:40:32.451109 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447793    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 00:40:32.451109 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447797    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 00:40:32.451109 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447801    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 00:40:32.451109 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447806    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 00:40:32.451109 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447810    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 00:40:32.451109 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447814    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 00:40:32.451109 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447819    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 00:40:32.451109 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447823    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 00:40:32.451109 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447827    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 00:40:32.451109 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447831    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 00:40:32.451109 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447835    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 00:40:32.451109 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447840    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 00:40:32.451109 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447845    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 00:40:32.451109 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447849    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 00:40:32.451109 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447853    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 00:40:32.451109 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447857    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 00:40:32.451711 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447862    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 00:40:32.451711 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447866    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 00:40:32.451711 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447870    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 00:40:32.451711 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447875    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 00:40:32.451711 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447879    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 00:40:32.451711 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447883    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 00:40:32.451711 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447887    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 00:40:32.451711 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447891    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 00:40:32.451711 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447896    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 00:40:32.451711 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447900    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 00:40:32.451711 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447904    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 00:40:32.451711 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447909    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 00:40:32.451711 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447913    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 00:40:32.451711 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447917    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 00:40:32.451711 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447921    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 00:40:32.451711 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447925    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 00:40:32.451711 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447929    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 00:40:32.451711 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447933    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 00:40:32.451711 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447937    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 00:40:32.451711 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447942    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 00:40:32.452320 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447946    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 00:40:32.452320 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447951    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 00:40:32.452320 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447955    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 00:40:32.452320 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447959    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 00:40:32.452320 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447963    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 00:40:32.452320 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447967    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 00:40:32.452320 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447971    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 00:40:32.452320 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447975    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 00:40:32.452320 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447979    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 00:40:32.452320 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447990    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 00:40:32.452320 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447995    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 00:40:32.452320 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.447999    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 00:40:32.452320 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448003    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 00:40:32.452320 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448008    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 00:40:32.452320 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448012    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 00:40:32.452320 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448016    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 00:40:32.452320 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448023    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 00:40:32.452320 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448029    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 00:40:32.452320 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448034    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 00:40:32.452775 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448039    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 00:40:32.452775 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448043    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 00:40:32.452775 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448047    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 00:40:32.452775 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448051    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 00:40:32.452775 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448056    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 00:40:32.452775 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448068    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 00:40:32.452775 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448075    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 00:40:32.452775 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448080    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 00:40:32.452775 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448085    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 00:40:32.452775 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448089    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 00:40:32.452775 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448093    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 00:40:32.452775 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448097    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 00:40:32.452775 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448102    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 00:40:32.452775 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448106    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 00:40:32.452775 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448110    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 00:40:32.452775 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448115    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 00:40:32.452775 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448119    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 00:40:32.452775 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448123    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 00:40:32.452775 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448130    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 00:40:32.453390 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448136    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 00:40:32.453390 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448140    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 00:40:32.453390 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448144    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 00:40:32.453390 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448148    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 00:40:32.453390 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448153    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 00:40:32.453390 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448158    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 00:40:32.453390 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448162    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 00:40:32.453390 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448166    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 00:40:32.453390 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448170    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 00:40:32.453390 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448174    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 00:40:32.453390 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448178    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 00:40:32.453390 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448200    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 00:40:32.453390 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448204    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 00:40:32.453390 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.448212    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 00:40:32.453390 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448391    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 00:40:32.453756 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448398    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 00:40:32.453756 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448403    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 00:40:32.453756 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448408    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 00:40:32.453756 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448413    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 00:40:32.453756 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448417    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 00:40:32.453756 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448422    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 00:40:32.453756 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448426    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 00:40:32.453756 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448430    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 00:40:32.453756 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448434    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 00:40:32.453756 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448439    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 00:40:32.453756 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448443    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 00:40:32.453756 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448449    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 00:40:32.453756 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448453    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 00:40:32.453756 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448457    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 00:40:32.453756 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448462    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 00:40:32.453756 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448466    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 00:40:32.453756 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448470    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 00:40:32.453756 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448475    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 00:40:32.453756 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448479    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 00:40:32.453756 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448483    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 00:40:32.454296 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448488    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 00:40:32.454296 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448492    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 00:40:32.454296 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448497    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 00:40:32.454296 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448501    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 00:40:32.454296 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448505    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 00:40:32.454296 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448509    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 00:40:32.454296 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448514    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 00:40:32.454296 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448518    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 00:40:32.454296 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448522    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 00:40:32.454296 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448527    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 00:40:32.454296 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448530    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 00:40:32.454296 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448535    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 00:40:32.454296 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448539    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 00:40:32.454296 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448543    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 00:40:32.454296 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448547    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 00:40:32.454296 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448551    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 00:40:32.454296 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448555    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 00:40:32.454296 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448559    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 00:40:32.454296 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448563    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 00:40:32.454296 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448567    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 00:40:32.454805 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448571    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 00:40:32.454805 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448575    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 00:40:32.454805 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448580    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 00:40:32.454805 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448584    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 00:40:32.454805 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448588    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 00:40:32.454805 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448592    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 00:40:32.454805 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448596    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 00:40:32.454805 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448600    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 00:40:32.454805 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448604    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 00:40:32.454805 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448608    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 00:40:32.454805 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448611    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 00:40:32.454805 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448615    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 00:40:32.454805 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448620    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 00:40:32.454805 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448626    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 00:40:32.454805 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448632    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 00:40:32.454805 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448637    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 00:40:32.454805 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448642    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 00:40:32.454805 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448646    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 00:40:32.454805 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448651    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 00:40:32.455597 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448655    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 00:40:32.455597 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448661    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 00:40:32.455597 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448666    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 00:40:32.455597 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448671    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 00:40:32.455597 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448674    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 00:40:32.455597 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448678    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 00:40:32.455597 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448682    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 00:40:32.455597 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448686    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 00:40:32.455597 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448690    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 00:40:32.455597 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448696    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 00:40:32.455597 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448702    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 00:40:32.455597 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448706    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 00:40:32.455597 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448711    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 00:40:32.455597 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448716    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 00:40:32.455597 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448721    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 00:40:32.455597 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448726    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 00:40:32.455597 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448730    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 00:40:32.455597 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448734    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 00:40:32.455597 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448738    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 00:40:32.456278 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448742    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 00:40:32.456278 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448746    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 00:40:32.456278 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448750    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 00:40:32.456278 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448754    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 00:40:32.456278 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448758    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 00:40:32.456278 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448762    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 00:40:32.456278 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448766    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 00:40:32.456278 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448770    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 00:40:32.456278 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448774    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 00:40:32.456278 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448778    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 00:40:32.456278 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448783    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 00:40:32.456278 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448787    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 00:40:32.456278 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448791    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 00:40:32.456278 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448795    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 00:40:32.456278 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448799    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 00:40:32.456278 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448803    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 00:40:32.456278 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448807    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 00:40:32.456278 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448811    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 00:40:32.456278 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448815    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 00:40:32.456739 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:32.448819    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 00:40:32.456739 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.448827    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 00:40:32.456739 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.448990    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 18 00:40:32.456739 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.451570    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 18 00:40:32.456739 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.452964    2575 server.go:1019] "Starting client certificate rotation"
Jul 18 00:40:32.456739 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.453067    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 18 00:40:32.456739 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.453102    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 18 00:40:32.456739 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.455421    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 18 00:40:32.457802 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.457785    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 18 00:40:32.464731 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.464541    2575 log.go:25] "Validated CRI v1 runtime API"
Jul 18 00:40:32.468098 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.468081    2575 log.go:25] "Validated CRI v1 image API"
Jul 18 00:40:32.471424 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.471407    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 18 00:40:32.473578 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.473555    2575 fs.go:135] Filesystem UUIDs: map[06bb800f-79b7-4a4d-86cc-f0140205b42a:/dev/nvme0n1p3 51be6cdc-3fe8-4415-ab0b-5ed6c7763bef:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 18 00:40:32.473624 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.473578    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 18 00:40:32.479446 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.479332    2575 manager.go:216] Machine: {Timestamp:2026-07-18 00:40:32.478222689 +0000 UTC m=+0.267634736 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3109754 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24c479b494042985f5b05e6d5842b6 SystemUUID:ec24c479-b494-0429-85f5-b05e6d5842b6 BootID:b7196a94-8b80-442b-81aa-70ad58d85012 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c8:8d:30:36:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c8:8d:30:36:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:c6:2e:ce:dc:37 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 18 00:40:32.479446 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.479435    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 18 00:40:32.479580 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.479514    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 18 00:40:32.482161 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.482131    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 18 00:40:32.482356 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.482168    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-166.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 18 00:40:32.482828 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.482816    2575 topology_manager.go:138] "Creating topology manager with none policy"
Jul 18 00:40:32.482883 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.482834    2575 container_manager_linux.go:309] "Creating device plugin manager"
Jul 18 00:40:32.482883 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.482844    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 18 00:40:32.482883 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.482866    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 18 00:40:32.483692 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.483669    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 18 00:40:32.483990 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.483977    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 18 00:40:32.487611 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.487599    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 18 00:40:32.487723 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.487714    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 18 00:40:32.487756 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.487747    2575 kubelet.go:486] "Attempting to sync node with API server"
Jul 18 00:40:32.487793 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.487760    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 18 00:40:32.487793 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.487771    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 18 00:40:32.487793 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.487781    2575 kubelet.go:398] "Adding apiserver pod source"
Jul 18 00:40:32.487793 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.487789    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 18 00:40:32.488199 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.488168    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 18 00:40:32.488261 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.488210    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 18 00:40:32.490029 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.490010    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 18 00:40:32.491267 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.491253    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 18 00:40:32.491313 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.491284    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 18 00:40:32.492299 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.492288    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 18 00:40:32.492339 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.492306    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 18 00:40:32.492339 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.492311    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 18 00:40:32.492339 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.492318    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 18 00:40:32.492339 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.492332    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 18 00:40:32.492339 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.492341    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 18 00:40:32.492468 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.492350    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 18 00:40:32.492468 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.492358    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 18 00:40:32.492468 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.492367    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 18 00:40:32.492468 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.492375    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 18 00:40:32.492468 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.492386    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 18 00:40:32.492468 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.492394    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 18 00:40:32.493155 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.493145    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 18 00:40:32.493208 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.493158    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 18 00:40:32.496347 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.496334    2575 server.go:1268] "Started kubelet"
Jul 18 00:40:32.496429 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.496404    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 18 00:40:32.496530 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.496418    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 18 00:40:32.496530 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.496497    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 18 00:40:32.497264 ip-10-0-130-166 systemd[1]: Started Kubernetes Kubelet.
Jul 18 00:40:32.498282 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.498130    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 18 00:40:32.498747 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.498732    2575 server.go:310] "Adding debug handlers to kubelet server"
Jul 18 00:40:32.501242 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:32.499831    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-166.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 18 00:40:32.501242 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:32.499849    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 18 00:40:32.501242 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.500024    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-166.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 18 00:40:32.501242 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:32.500368    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-166.ec2.internal.18c33b70ad280e98  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-166.ec2.internal,UID:ip-10-0-130-166.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-166.ec2.internal,},FirstTimestamp:2026-07-18 00:40:32.496307864 +0000 UTC m=+0.285719912,LastTimestamp:2026-07-18 00:40:32.496307864 +0000 UTC m=+0.285719912,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-166.ec2.internal,}"
Jul 18 00:40:32.502700 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:32.502681    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 18 00:40:32.503870 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.503854    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cv5k7"
Jul 18 00:40:32.504259 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.504246    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 18 00:40:32.504323 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.504257    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 18 00:40:32.504387 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:32.504369    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 18 00:40:32.504862 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.504843    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 18 00:40:32.504862 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.504862    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 18 00:40:32.504989 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.504841    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 18 00:40:32.504989 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.504952    2575 reconstruct.go:97] "Volume reconstruction finished"
Jul 18 00:40:32.504989 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.504962    2575 reconciler.go:29] "Reconciler: start to sync state"
Jul 18 00:40:32.505141 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.505127    2575 factory.go:55] Registering systemd factory
Jul 18 00:40:32.505176 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.505164    2575 factory.go:223] Registration of the systemd container factory successfully
Jul 18 00:40:32.505405 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.505393    2575 factory.go:153] Registering CRI-O factory
Jul 18 00:40:32.505467 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.505409    2575 factory.go:223] Registration of the crio container factory successfully
Jul 18 00:40:32.505467 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.505461    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 18 00:40:32.505555 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.505487    2575 factory.go:103] Registering Raw factory
Jul 18 00:40:32.505555 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.505503    2575 manager.go:1196] Started watching for new ooms in manager
Jul 18 00:40:32.506031 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.506016    2575 manager.go:349] Starting recovery of all containers
Jul 18 00:40:32.506833 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:32.506811    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-166.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 18 00:40:32.506920 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:32.506875    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 18 00:40:32.511773 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.511754    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cv5k7"
Jul 18 00:40:32.514481 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.514461    2575 manager.go:354] Recovery completed
Jul 18 00:40:32.519541 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.519435    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 00:40:32.521297 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.521279    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 00:40:32.521365 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.521307    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 00:40:32.521365 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.521341    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientPID"
Jul 18 00:40:32.521929 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.521906    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 18 00:40:32.521929 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.521922    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 18 00:40:32.522017 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.521940    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 18 00:40:32.522017 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.521911    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 00:40:32.522664 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.522649    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 00:40:32.522714 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.522674    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 00:40:32.522714 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.522685    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientPID"
Jul 18 00:40:32.524001 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.523989    2575 policy_none.go:49] "None policy: Start"
Jul 18 00:40:32.524047 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.524004    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 18 00:40:32.524047 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.524015    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 18 00:40:32.529340 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.529324    2575 policy_none.go:47] "Start"
Jul 18 00:40:32.561783 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.561761    2575 manager.go:337] "Starting Device Plugin manager"
Jul 18 00:40:32.561878 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:32.561797    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 18 00:40:32.561878 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.561807    2575 server.go:87] "Starting device plugin registration server"
Jul 18 00:40:32.562106 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.562093    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 18 00:40:32.562155 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.562110    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 18 00:40:32.562237 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.562220    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 18 00:40:32.562333 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.562316    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 18 00:40:32.562333 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.562331    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 18 00:40:32.562792 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:32.562773    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 18 00:40:32.562851 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:32.562830    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 18 00:40:32.662640 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.662600    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 00:40:32.664648 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.663527    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 00:40:32.664648 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.663557    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 00:40:32.664648 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.663573    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientPID"
Jul 18 00:40:32.664648 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.663608    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-166.ec2.internal"
Jul 18 00:40:32.670644 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.670607    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 18 00:40:32.671446 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.671432    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-166.ec2.internal"
Jul 18 00:40:32.671514 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:32.671453    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-166.ec2.internal\": node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 18 00:40:32.672007 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.671991    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 18 00:40:32.672077 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.672038    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 18 00:40:32.672077 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.672073    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 18 00:40:32.672156 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:32.672112    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 18 00:40:32.674049 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.674028    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 00:40:32.712722 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:32.712651    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 18 00:40:32.772803 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.772772    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal"]
Jul 18 00:40:32.772903 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.772857    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 00:40:32.775441 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.775417    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 00:40:32.775558 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.775453    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 00:40:32.775558 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.775469    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientPID"
Jul 18 00:40:32.777766 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.777750    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 00:40:32.777878 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.777861    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal"
Jul 18 00:40:32.777942 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.777896    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 00:40:32.778551 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.778533    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 00:40:32.778551 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.778555    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 00:40:32.778692 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.778565    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientPID"
Jul 18 00:40:32.778692 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.778626    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 00:40:32.778692 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.778649    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 00:40:32.778692 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.778659    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientPID"
Jul 18 00:40:32.780718 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.780704    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal"
Jul 18 00:40:32.780796 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.780728    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 00:40:32.781402 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.781389    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 00:40:32.781462 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.781411    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 00:40:32.781462 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.781422    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientPID"
Jul 18 00:40:32.804850 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:32.804830    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-166.ec2.internal\" not found" node="ip-10-0-130-166.ec2.internal"
Jul 18 00:40:32.806778 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.806762    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa81fefd8cb9506ed41c32bd7a3ab6b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal\" (UID: \"fa81fefd8cb9506ed41c32bd7a3ab6b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal"
Jul 18 00:40:32.806877 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.806791    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa81fefd8cb9506ed41c32bd7a3ab6b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal\" (UID: \"fa81fefd8cb9506ed41c32bd7a3ab6b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal"
Jul 18 00:40:32.806877 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.806817    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4f18a4042ac0c4f669794ed57bc7586-config\") pod \"kube-apiserver-proxy-ip-10-0-130-166.ec2.internal\" (UID: \"a4f18a4042ac0c4f669794ed57bc7586\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal"
Jul 18 00:40:32.809062 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:32.809045    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-166.ec2.internal\" not found" node="ip-10-0-130-166.ec2.internal"
Jul 18 00:40:32.813083 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:32.813068    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 18 00:40:32.907975 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.907929    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa81fefd8cb9506ed41c32bd7a3ab6b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal\" (UID: \"fa81fefd8cb9506ed41c32bd7a3ab6b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal"
Jul 18 00:40:32.907975 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.907977    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa81fefd8cb9506ed41c32bd7a3ab6b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal\" (UID: \"fa81fefd8cb9506ed41c32bd7a3ab6b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal"
Jul 18 00:40:32.908213 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.908012    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4f18a4042ac0c4f669794ed57bc7586-config\") pod \"kube-apiserver-proxy-ip-10-0-130-166.ec2.internal\" (UID: \"a4f18a4042ac0c4f669794ed57bc7586\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal"
Jul 18 00:40:32.908213 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.908039    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa81fefd8cb9506ed41c32bd7a3ab6b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal\" (UID: \"fa81fefd8cb9506ed41c32bd7a3ab6b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal"
Jul 18 00:40:32.908213 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.908065    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4f18a4042ac0c4f669794ed57bc7586-config\") pod \"kube-apiserver-proxy-ip-10-0-130-166.ec2.internal\" (UID: \"a4f18a4042ac0c4f669794ed57bc7586\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal"
Jul 18 00:40:32.908213 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:32.908103    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa81fefd8cb9506ed41c32bd7a3ab6b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal\" (UID: \"fa81fefd8cb9506ed41c32bd7a3ab6b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal"
Jul 18 00:40:32.914048 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:32.914032    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 18 00:40:33.014972 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:33.014888    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 18 00:40:33.107280 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:33.107253    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal"
Jul 18 00:40:33.112130 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:33.112005    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal"
Jul 18 00:40:33.115151 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:33.115129    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 18 00:40:33.215243 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:33.215178    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 18 00:40:33.315708 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:33.315649    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 18 00:40:33.416244 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:33.416218    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 18 00:40:33.452337 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:33.452311    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 18 00:40:33.452748 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:33.452474    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 18 00:40:33.516472 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:33.516447    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 18 00:40:33.517542 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:33.517510    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-17 00:35:32 +0000 UTC" deadline="2028-04-20 23:23:33.352294216 +0000 UTC"
Jul 18 00:40:33.517542 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:33.517539    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15430h42m59.834757951s"
Jul 18 00:40:33.558138 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:33.558114    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 00:40:33.616966 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:33.616939    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 18 00:40:33.660691 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:33.660662    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4f18a4042ac0c4f669794ed57bc7586.slice/crio-91843de399d1f329132aaf294b0b4927fd0a2f39568fa3498c23c527317a70b4 WatchSource:0}: Error finding container 91843de399d1f329132aaf294b0b4927fd0a2f39568fa3498c23c527317a70b4: Status 404 returned error can't find the container with id 91843de399d1f329132aaf294b0b4927fd0a2f39568fa3498c23c527317a70b4
Jul 18 00:40:33.660923 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:33.660901    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa81fefd8cb9506ed41c32bd7a3ab6b4.slice/crio-a96f9eb2f80b885ce582b75bed70ec368e77a3c316e9e006ef0c81456a9dbb2d WatchSource:0}: Error finding container a96f9eb2f80b885ce582b75bed70ec368e77a3c316e9e006ef0c81456a9dbb2d: Status 404 returned error can't find the container with id a96f9eb2f80b885ce582b75bed70ec368e77a3c316e9e006ef0c81456a9dbb2d
Jul 18 00:40:33.665884 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:33.665870    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 00:40:33.674847 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:33.674810    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal" event={"ID":"fa81fefd8cb9506ed41c32bd7a3ab6b4","Type":"ContainerStarted","Data":"a96f9eb2f80b885ce582b75bed70ec368e77a3c316e9e006ef0c81456a9dbb2d"}
Jul 18 00:40:33.675629 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:33.675609    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal" event={"ID":"a4f18a4042ac0c4f669794ed57bc7586","Type":"ContainerStarted","Data":"91843de399d1f329132aaf294b0b4927fd0a2f39568fa3498c23c527317a70b4"}
Jul 18 00:40:33.707832 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:33.707808    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 00:40:33.808034 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:33.807991    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal"
Jul 18 00:40:33.819798 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:33.819772    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 18 00:40:33.820659 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:33.820641    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal"
Jul 18 00:40:33.829601 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:33.829582    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 18 00:40:33.892303 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:33.892234    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 00:40:34.351394 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.351298    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 00:40:34.488670 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.488641    2575 apiserver.go:52] "Watching apiserver"
Jul 18 00:40:34.497943 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.497910    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 18 00:40:34.499036 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.499009    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-lqwmf","openshift-multus/multus-mgzpn","openshift-ovn-kubernetes/ovnkube-node-tjb92","openshift-cluster-node-tuning-operator/tuned-6fqv2","openshift-dns/node-resolver-5ktrw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal","openshift-multus/multus-additional-cni-plugins-zh2l6","openshift-multus/network-metrics-daemon-nxj6q","openshift-network-diagnostics/network-check-target-kmtff","openshift-network-operator/iptables-alerter-wqvnm","kube-system/global-pull-secret-syncer-zghtc","kube-system/konnectivity-agent-9tn4l","kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"]
Jul 18 00:40:34.502066 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.502036    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.504870 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.504844    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9tn4l"
Jul 18 00:40:34.505678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.505658    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 18 00:40:34.505803 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.505685    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 18 00:40:34.505878 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.505834    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 18 00:40:34.505973 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.505955    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4k68p\""
Jul 18 00:40:34.506152 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.506137    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 18 00:40:34.506200 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.506181    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 18 00:40:34.506505 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.506470    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 18 00:40:34.507339 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.507322    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.508025 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.508004    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 18 00:40:34.508681 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.508595    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mk9d7\""
Jul 18 00:40:34.508681 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.508660    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 18 00:40:34.510220 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.510202    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 18 00:40:34.510926 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.510737    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 18 00:40:34.510926 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.510737    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 18 00:40:34.510926 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.510872    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.512212 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.511394    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 18 00:40:34.512212 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.511594    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hck74\""
Jul 18 00:40:34.512212 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.511641    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 18 00:40:34.512212 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.511818    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 18 00:40:34.513279 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.513257    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5ktrw"
Jul 18 00:40:34.513900 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.513879    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 18 00:40:34.513900 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.513892    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cmbnm\""
Jul 18 00:40:34.514117 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.514102    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 18 00:40:34.515667 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.515648    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 18 00:40:34.515974 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.515954    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-host-run-netns\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.516064 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.515988    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-run-systemd\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.516064 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516013    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 18 00:40:34.516216 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516195    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-45rfj\""
Jul 18 00:40:34.516291 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516013    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-run-ovn\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.516356 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516317    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13495ace-a3dd-4fc1-8035-0a2e54879d58-cnibin\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.516415 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516367    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-host-slash\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.516470 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516393    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9311a43d-6509-4370-9c1b-1db5eeb58cb0-env-overrides\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.516470 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516439    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13495ace-a3dd-4fc1-8035-0a2e54879d58-system-cni-dir\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.516574 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516467    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/13495ace-a3dd-4fc1-8035-0a2e54879d58-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.516574 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516497    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-host-run-ovn-kubernetes\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.516574 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516552    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-host-cni-bin\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.516726 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516591    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-host-cni-netd\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.516726 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516601    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 18 00:40:34.516726 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516608    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9311a43d-6509-4370-9c1b-1db5eeb58cb0-ovn-node-metrics-cert\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.516726 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13495ace-a3dd-4fc1-8035-0a2e54879d58-os-release\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.516726 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516670    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-run-openvswitch\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.516726 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516686    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.516726 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516713    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9311a43d-6509-4370-9c1b-1db5eeb58cb0-ovnkube-config\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.516726 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516729    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13495ace-a3dd-4fc1-8035-0a2e54879d58-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.517129 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516748    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-var-lib-openvswitch\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.517129 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516766    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-node-log\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.517129 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516792    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9311a43d-6509-4370-9c1b-1db5eeb58cb0-ovnkube-script-lib\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.517129 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516811    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13495ace-a3dd-4fc1-8035-0a2e54879d58-cni-binary-copy\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.517129 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516830    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/031ededa-1f92-4818-873b-631a36945bfe-agent-certs\") pod \"konnectivity-agent-9tn4l\" (UID: \"031ededa-1f92-4818-873b-631a36945bfe\") " pod="kube-system/konnectivity-agent-9tn4l"
Jul 18 00:40:34.517129 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516855    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/031ededa-1f92-4818-873b-631a36945bfe-konnectivity-ca\") pod \"konnectivity-agent-9tn4l\" (UID: \"031ededa-1f92-4818-873b-631a36945bfe\") " pod="kube-system/konnectivity-agent-9tn4l"
Jul 18 00:40:34.517129 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516871    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-etc-openvswitch\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.517129 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516896    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-log-socket\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.517129 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516921    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lt7s\" (UniqueName: \"kubernetes.io/projected/9311a43d-6509-4370-9c1b-1db5eeb58cb0-kube-api-access-7lt7s\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.517129 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516951    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k92rl\" (UniqueName: \"kubernetes.io/projected/13495ace-a3dd-4fc1-8035-0a2e54879d58-kube-api-access-k92rl\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.517129 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516967    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-host-kubelet\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.517129 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516984    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-systemd-units\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.517129 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.516999    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/13495ace-a3dd-4fc1-8035-0a2e54879d58-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.517129 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.517134    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"
Jul 18 00:40:34.519471 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.519450    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 18 00:40:34.519570 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.519526    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 18 00:40:34.519641 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.519559    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 18 00:40:34.519972 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.519955    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gnhs4\""
Jul 18 00:40:34.521086 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.521067    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:40:34.521243 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:34.521214    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmtff" podUID="909b5e56-fd38-4d1d-8123-be740dd195b0"
Jul 18 00:40:34.523675 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.523650    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:40:34.523874 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:34.523831    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxj6q" podUID="12acb4ef-54f7-4c47-884b-aa81ed6d7eb0"
Jul 18 00:40:34.526361 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.526343    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.528931 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.528906    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 18 00:40:34.529079 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.528973    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8hbc5\""
Jul 18 00:40:34.529245 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.529229    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wqvnm"
Jul 18 00:40:34.531779 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.531759    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lqwmf"
Jul 18 00:40:34.532260 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.531949    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 18 00:40:34.532260 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.532116    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 18 00:40:34.532418 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.532297    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wwjr5\""
Jul 18 00:40:34.532637 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.532618    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 18 00:40:34.534300 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.534282    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:34.534407 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:34.534346    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zghtc" podUID="a209204d-2b7f-40e7-9ccb-e79a97531adf"
Jul 18 00:40:34.534823 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.534801    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 18 00:40:34.535549 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.534812    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 18 00:40:34.535894 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.535870    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mxzf2"
Jul 18 00:40:34.536181 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.536166    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tmh7q\""
Jul 18 00:40:34.536437 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.536422    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 18 00:40:34.544714 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.544172    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mxzf2"
Jul 18 00:40:34.606915 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.606844    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 18 00:40:34.618121 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618078    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-etc-sysctl-d\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.618289 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618132    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-os-release\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.618289 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618164    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59d36460-6568-4ce0-b273-cb9b1e69a680-multus-daemon-config\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.618289 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618195    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-host-run-ovn-kubernetes\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.618289 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618237    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-host-cni-bin\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.618289 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618265    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87cc2380-3d9f-415b-91e4-62553f12db25-iptables-alerter-script\") pod \"iptables-alerter-wqvnm\" (UID: \"87cc2380-3d9f-415b-91e4-62553f12db25\") " pod="openshift-network-operator/iptables-alerter-wqvnm"
Jul 18 00:40:34.618536 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618292    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-run-openvswitch\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.618536 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618319    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13495ace-a3dd-4fc1-8035-0a2e54879d58-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.618536 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618341    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-sys\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.618536 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618365    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89f57153-62a1-404e-b478-92969538b6cf-tmp\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.618536 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618390    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-multus-socket-dir-parent\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.618536 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618414    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-var-lib-openvswitch\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.618536 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618438    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9311a43d-6509-4370-9c1b-1db5eeb58cb0-ovnkube-script-lib\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.618536 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618468    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13495ace-a3dd-4fc1-8035-0a2e54879d58-cni-binary-copy\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.618536 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618493    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/031ededa-1f92-4818-873b-631a36945bfe-konnectivity-ca\") pod \"konnectivity-agent-9tn4l\" (UID: \"031ededa-1f92-4818-873b-631a36945bfe\") " pod="kube-system/konnectivity-agent-9tn4l"
Jul 18 00:40:34.618536 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618515    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-var-lib-kubelet\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.618536 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618538    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-multus-cni-dir\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.618983 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618567    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret\") pod \"global-pull-secret-syncer-zghtc\" (UID: \"a209204d-2b7f-40e7-9ccb-e79a97531adf\") " pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:34.618983 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618593    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-log-socket\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.618983 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618618    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lt7s\" (UniqueName: \"kubernetes.io/projected/9311a43d-6509-4370-9c1b-1db5eeb58cb0-kube-api-access-7lt7s\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.618983 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618645    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-host-var-lib-cni-bin\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.618983 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618671    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-etc-kubernetes\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.618983 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618691    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-host\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.618983 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618715    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-host-var-lib-cni-multus\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.618983 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618741    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-systemd-units\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.618983 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618766    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-etc-systemd\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.618983 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618796    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/89f57153-62a1-404e-b478-92969538b6cf-etc-tuned\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.618983 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618831    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac8eced4-49d8-49d7-b990-7293cb285952-tmp-dir\") pod \"node-resolver-5ktrw\" (UID: \"ac8eced4-49d8-49d7-b990-7293cb285952\") " pod="openshift-dns/node-resolver-5ktrw"
Jul 18 00:40:34.618983 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618855    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c90e36c2-0247-44b2-9eed-a7054b50a4de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rh96r\" (UID: \"c90e36c2-0247-44b2-9eed-a7054b50a4de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"
Jul 18 00:40:34.618983 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618885    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c90e36c2-0247-44b2-9eed-a7054b50a4de-etc-selinux\") pod \"aws-ebs-csi-driver-node-rh96r\" (UID: \"c90e36c2-0247-44b2-9eed-a7054b50a4de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"
Jul 18 00:40:34.618983 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618913    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13495ace-a3dd-4fc1-8035-0a2e54879d58-cnibin\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.618983 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618938    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-host-slash\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.618983 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618963    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c90e36c2-0247-44b2-9eed-a7054b50a4de-sys-fs\") pod \"aws-ebs-csi-driver-node-rh96r\" (UID: \"c90e36c2-0247-44b2-9eed-a7054b50a4de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"
Jul 18 00:40:34.619834 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.618990    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c5317943-47c6-46a6-865a-e062f6ed279b-serviceca\") pod \"node-ca-lqwmf\" (UID: \"c5317943-47c6-46a6-865a-e062f6ed279b\") " pod="openshift-image-registry/node-ca-lqwmf"
Jul 18 00:40:34.619834 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619017    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-host-cni-netd\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.619834 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619052    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9311a43d-6509-4370-9c1b-1db5eeb58cb0-ovn-node-metrics-cert\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.619834 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619081    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13495ace-a3dd-4fc1-8035-0a2e54879d58-os-release\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.619834 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619103    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-run\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.619834 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619143    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs\") pod \"network-metrics-daemon-nxj6q\" (UID: \"12acb4ef-54f7-4c47-884b-aa81ed6d7eb0\") " pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:40:34.619834 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619169    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c90e36c2-0247-44b2-9eed-a7054b50a4de-socket-dir\") pod \"aws-ebs-csi-driver-node-rh96r\" (UID: \"c90e36c2-0247-44b2-9eed-a7054b50a4de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"
Jul 18 00:40:34.619834 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619388    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-host-run-ovn-kubernetes\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.619834 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619388    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-run-openvswitch\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.619834 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619430    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vmdx\" (UniqueName: \"kubernetes.io/projected/c90e36c2-0247-44b2-9eed-a7054b50a4de-kube-api-access-5vmdx\") pod \"aws-ebs-csi-driver-node-rh96r\" (UID: \"c90e36c2-0247-44b2-9eed-a7054b50a4de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"
Jul 18 00:40:34.619834 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619459    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-host-run-netns\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.619834 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619461    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-host-cni-bin\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.619834 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619483    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zrnv\" (UniqueName: \"kubernetes.io/projected/89f57153-62a1-404e-b478-92969538b6cf-kube-api-access-8zrnv\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.619834 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619512    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ac8eced4-49d8-49d7-b990-7293cb285952-hosts-file\") pod \"node-resolver-5ktrw\" (UID: \"ac8eced4-49d8-49d7-b990-7293cb285952\") " pod="openshift-dns/node-resolver-5ktrw"
Jul 18 00:40:34.619834 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619537    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt5nx\" (UniqueName: \"kubernetes.io/projected/ac8eced4-49d8-49d7-b990-7293cb285952-kube-api-access-kt5nx\") pod \"node-resolver-5ktrw\" (UID: \"ac8eced4-49d8-49d7-b990-7293cb285952\") " pod="openshift-dns/node-resolver-5ktrw"
Jul 18 00:40:34.619834 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619562    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqfvl\" (UniqueName: \"kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl\") pod \"network-check-target-kmtff\" (UID: \"909b5e56-fd38-4d1d-8123-be740dd195b0\") " pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:40:34.620659 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619604    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.620659 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619631    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9311a43d-6509-4370-9c1b-1db5eeb58cb0-ovnkube-config\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.620659 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619656    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-etc-modprobe-d\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.620659 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619679    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-lib-modules\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.620659 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619705    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-node-log\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.620659 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619729    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/031ededa-1f92-4818-873b-631a36945bfe-agent-certs\") pod \"konnectivity-agent-9tn4l\" (UID: \"031ededa-1f92-4818-873b-631a36945bfe\") " pod="kube-system/konnectivity-agent-9tn4l"
Jul 18 00:40:34.620659 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619753    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c90e36c2-0247-44b2-9eed-a7054b50a4de-device-dir\") pod \"aws-ebs-csi-driver-node-rh96r\" (UID: \"c90e36c2-0247-44b2-9eed-a7054b50a4de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"
Jul 18 00:40:34.620659 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619807    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-var-lib-openvswitch\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.620659 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619811    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-cnibin\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.620659 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619838    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-multus-conf-dir\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.620659 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619872    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-767pw\" (UniqueName: \"kubernetes.io/projected/59d36460-6568-4ce0-b273-cb9b1e69a680-kube-api-access-767pw\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.620659 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619903    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-etc-openvswitch\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.620659 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619940    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k92rl\" (UniqueName: \"kubernetes.io/projected/13495ace-a3dd-4fc1-8035-0a2e54879d58-kube-api-access-k92rl\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.620659 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619969    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-host-var-lib-kubelet\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.620659 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619999    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-hostroot\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.620659 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.619432    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-log-socket\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.620659 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.620157    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13495ace-a3dd-4fc1-8035-0a2e54879d58-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.621523 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.620452    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13495ace-a3dd-4fc1-8035-0a2e54879d58-cni-binary-copy\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.621523 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.620880    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9311a43d-6509-4370-9c1b-1db5eeb58cb0-ovnkube-script-lib\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.621523 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.620983    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-host-run-multus-certs\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.621523 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.621014    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87cc2380-3d9f-415b-91e4-62553f12db25-host-slash\") pod \"iptables-alerter-wqvnm\" (UID: \"87cc2380-3d9f-415b-91e4-62553f12db25\") " pod="openshift-network-operator/iptables-alerter-wqvnm"
Jul 18 00:40:34.621523 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.621043    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5317943-47c6-46a6-865a-e062f6ed279b-host\") pod \"node-ca-lqwmf\" (UID: \"c5317943-47c6-46a6-865a-e062f6ed279b\") " pod="openshift-image-registry/node-ca-lqwmf"
Jul 18 00:40:34.621523 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.621071    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-host-kubelet\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.621523 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.621131    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.621523 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.621134    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-host-kubelet\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.621523 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.621163    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-host-slash\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.621523 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.621200    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-systemd-units\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.621523 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.621236    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-host-cni-netd\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.622092 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.621584    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 18 00:40:34.622092 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.621634    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9311a43d-6509-4370-9c1b-1db5eeb58cb0-ovnkube-config\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.622092 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.621681    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-node-log\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.623217 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.623189    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13495ace-a3dd-4fc1-8035-0a2e54879d58-os-release\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.623416 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.623242    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13495ace-a3dd-4fc1-8035-0a2e54879d58-cnibin\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.623766 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.623744    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/031ededa-1f92-4818-873b-631a36945bfe-konnectivity-ca\") pod \"konnectivity-agent-9tn4l\" (UID: \"031ededa-1f92-4818-873b-631a36945bfe\") " pod="kube-system/konnectivity-agent-9tn4l"
Jul 18 00:40:34.624345 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.624323    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-etc-openvswitch\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.624427 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.624364    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-etc-kubernetes\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.624530 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.624506    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t2zk\" (UniqueName: \"kubernetes.io/projected/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-kube-api-access-6t2zk\") pod \"network-metrics-daemon-nxj6q\" (UID: \"12acb4ef-54f7-4c47-884b-aa81ed6d7eb0\") " pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:40:34.624592 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.624568    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59d36460-6568-4ce0-b273-cb9b1e69a680-cni-binary-copy\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.624650 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.624616    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-host-run-k8s-cni-cncf-io\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.624709 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.624674    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkx6m\" (UniqueName: \"kubernetes.io/projected/c5317943-47c6-46a6-865a-e062f6ed279b-kube-api-access-jkx6m\") pod \"node-ca-lqwmf\" (UID: \"c5317943-47c6-46a6-865a-e062f6ed279b\") " pod="openshift-image-registry/node-ca-lqwmf"
Jul 18 00:40:34.624762 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.624725    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/13495ace-a3dd-4fc1-8035-0a2e54879d58-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.624818 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.624769    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c90e36c2-0247-44b2-9eed-a7054b50a4de-registration-dir\") pod \"aws-ebs-csi-driver-node-rh96r\" (UID: \"c90e36c2-0247-44b2-9eed-a7054b50a4de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"
Jul 18 00:40:34.624913 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.624889    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-system-cni-dir\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.624970 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.624951    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psl29\" (UniqueName: \"kubernetes.io/projected/87cc2380-3d9f-415b-91e4-62553f12db25-kube-api-access-psl29\") pod \"iptables-alerter-wqvnm\" (UID: \"87cc2380-3d9f-415b-91e4-62553f12db25\") " pod="openshift-network-operator/iptables-alerter-wqvnm"
Jul 18 00:40:34.625031 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.624994    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a209204d-2b7f-40e7-9ccb-e79a97531adf-kubelet-config\") pod \"global-pull-secret-syncer-zghtc\" (UID: \"a209204d-2b7f-40e7-9ccb-e79a97531adf\") " pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:34.625084 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.625037    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a209204d-2b7f-40e7-9ccb-e79a97531adf-dbus\") pod \"global-pull-secret-syncer-zghtc\" (UID: \"a209204d-2b7f-40e7-9ccb-e79a97531adf\") " pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:34.625138 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.625082    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-host-run-netns\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.625138 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.625108    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9311a43d-6509-4370-9c1b-1db5eeb58cb0-ovn-node-metrics-cert\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.625138 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.625120    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-run-systemd\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.625395 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.625165    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-run-ovn\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.625395 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.625171    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-host-run-netns\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.625395 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.625197    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/13495ace-a3dd-4fc1-8035-0a2e54879d58-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.625395 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.625221    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-run-systemd\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.625395 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.625266    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-etc-sysctl-conf\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.625395 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.625267    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9311a43d-6509-4370-9c1b-1db5eeb58cb0-run-ovn\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.625395 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.625308    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9311a43d-6509-4370-9c1b-1db5eeb58cb0-env-overrides\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.625395 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.625371    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13495ace-a3dd-4fc1-8035-0a2e54879d58-system-cni-dir\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.625803 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.625421    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/13495ace-a3dd-4fc1-8035-0a2e54879d58-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.625803 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.625445    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13495ace-a3dd-4fc1-8035-0a2e54879d58-system-cni-dir\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.625803 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.625480    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-etc-sysconfig\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.625803 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.625742    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9311a43d-6509-4370-9c1b-1db5eeb58cb0-env-overrides\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.626007 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.625931    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/13495ace-a3dd-4fc1-8035-0a2e54879d58-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.630318 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.630028    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/031ededa-1f92-4818-873b-631a36945bfe-agent-certs\") pod \"konnectivity-agent-9tn4l\" (UID: \"031ededa-1f92-4818-873b-631a36945bfe\") " pod="kube-system/konnectivity-agent-9tn4l"
Jul 18 00:40:34.631840 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.631780    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lt7s\" (UniqueName: \"kubernetes.io/projected/9311a43d-6509-4370-9c1b-1db5eeb58cb0-kube-api-access-7lt7s\") pod \"ovnkube-node-tjb92\" (UID: \"9311a43d-6509-4370-9c1b-1db5eeb58cb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.634630 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.634607    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k92rl\" (UniqueName: \"kubernetes.io/projected/13495ace-a3dd-4fc1-8035-0a2e54879d58-kube-api-access-k92rl\") pod \"multus-additional-cni-plugins-zh2l6\" (UID: \"13495ace-a3dd-4fc1-8035-0a2e54879d58\") " pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.726471 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.726429    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret\") pod \"global-pull-secret-syncer-zghtc\" (UID: \"a209204d-2b7f-40e7-9ccb-e79a97531adf\") " pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:34.726649 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.726480    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-host-var-lib-cni-bin\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.726649 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.726590    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-host-var-lib-cni-bin\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.726649 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.726631    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-etc-kubernetes\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.726649 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:34.726635    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:34.726946 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.726654    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-host\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.726946 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.726672    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-host-var-lib-cni-multus\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.726946 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.726693    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-etc-systemd\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.726946 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:34.726727    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret podName:a209204d-2b7f-40e7-9ccb-e79a97531adf nodeName:}" failed. No retries permitted until 2026-07-18 00:40:35.226693903 +0000 UTC m=+3.016105940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret") pod "global-pull-secret-syncer-zghtc" (UID: "a209204d-2b7f-40e7-9ccb-e79a97531adf") : object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:34.726946 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.726758    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-host-var-lib-cni-multus\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.726946 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.726759    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/89f57153-62a1-404e-b478-92969538b6cf-etc-tuned\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.726946 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.726764    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-etc-systemd\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.726946 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.726768    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-etc-kubernetes\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.726946 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.726776    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-host\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.726946 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.726825    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac8eced4-49d8-49d7-b990-7293cb285952-tmp-dir\") pod \"node-resolver-5ktrw\" (UID: \"ac8eced4-49d8-49d7-b990-7293cb285952\") " pod="openshift-dns/node-resolver-5ktrw"
Jul 18 00:40:34.726946 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.726859    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c90e36c2-0247-44b2-9eed-a7054b50a4de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rh96r\" (UID: \"c90e36c2-0247-44b2-9eed-a7054b50a4de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"
Jul 18 00:40:34.726946 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.726886    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c90e36c2-0247-44b2-9eed-a7054b50a4de-etc-selinux\") pod \"aws-ebs-csi-driver-node-rh96r\" (UID: \"c90e36c2-0247-44b2-9eed-a7054b50a4de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"
Jul 18 00:40:34.726946 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.726912    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c90e36c2-0247-44b2-9eed-a7054b50a4de-sys-fs\") pod \"aws-ebs-csi-driver-node-rh96r\" (UID: \"c90e36c2-0247-44b2-9eed-a7054b50a4de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"
Jul 18 00:40:34.727615 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.726961    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c5317943-47c6-46a6-865a-e062f6ed279b-serviceca\") pod \"node-ca-lqwmf\" (UID: \"c5317943-47c6-46a6-865a-e062f6ed279b\") " pod="openshift-image-registry/node-ca-lqwmf"
Jul 18 00:40:34.727615 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.726978    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c90e36c2-0247-44b2-9eed-a7054b50a4de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rh96r\" (UID: \"c90e36c2-0247-44b2-9eed-a7054b50a4de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"
Jul 18 00:40:34.727615 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.726990    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-run\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.727615 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727026    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs\") pod \"network-metrics-daemon-nxj6q\" (UID: \"12acb4ef-54f7-4c47-884b-aa81ed6d7eb0\") " pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:40:34.727615 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727039    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c90e36c2-0247-44b2-9eed-a7054b50a4de-etc-selinux\") pod \"aws-ebs-csi-driver-node-rh96r\" (UID: \"c90e36c2-0247-44b2-9eed-a7054b50a4de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"
Jul 18 00:40:34.727615 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727048    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c90e36c2-0247-44b2-9eed-a7054b50a4de-sys-fs\") pod \"aws-ebs-csi-driver-node-rh96r\" (UID: \"c90e36c2-0247-44b2-9eed-a7054b50a4de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"
Jul 18 00:40:34.727615 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727101    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-run\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.727615 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:34.727110    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:34.727615 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727129    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c90e36c2-0247-44b2-9eed-a7054b50a4de-socket-dir\") pod \"aws-ebs-csi-driver-node-rh96r\" (UID: \"c90e36c2-0247-44b2-9eed-a7054b50a4de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"
Jul 18 00:40:34.727615 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727140    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac8eced4-49d8-49d7-b990-7293cb285952-tmp-dir\") pod \"node-resolver-5ktrw\" (UID: \"ac8eced4-49d8-49d7-b990-7293cb285952\") " pod="openshift-dns/node-resolver-5ktrw"
Jul 18 00:40:34.727615 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727168    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vmdx\" (UniqueName: \"kubernetes.io/projected/c90e36c2-0247-44b2-9eed-a7054b50a4de-kube-api-access-5vmdx\") pod \"aws-ebs-csi-driver-node-rh96r\" (UID: \"c90e36c2-0247-44b2-9eed-a7054b50a4de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"
Jul 18 00:40:34.727615 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:34.727205    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs podName:12acb4ef-54f7-4c47-884b-aa81ed6d7eb0 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:35.227171582 +0000 UTC m=+3.016583622 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs") pod "network-metrics-daemon-nxj6q" (UID: "12acb4ef-54f7-4c47-884b-aa81ed6d7eb0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:34.727615 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727242    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c90e36c2-0247-44b2-9eed-a7054b50a4de-socket-dir\") pod \"aws-ebs-csi-driver-node-rh96r\" (UID: \"c90e36c2-0247-44b2-9eed-a7054b50a4de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"
Jul 18 00:40:34.727615 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727249    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-host-run-netns\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.727615 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727283    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zrnv\" (UniqueName: \"kubernetes.io/projected/89f57153-62a1-404e-b478-92969538b6cf-kube-api-access-8zrnv\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.727615 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727309    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ac8eced4-49d8-49d7-b990-7293cb285952-hosts-file\") pod \"node-resolver-5ktrw\" (UID: \"ac8eced4-49d8-49d7-b990-7293cb285952\") " pod="openshift-dns/node-resolver-5ktrw"
Jul 18 00:40:34.727615 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727334    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt5nx\" (UniqueName: \"kubernetes.io/projected/ac8eced4-49d8-49d7-b990-7293cb285952-kube-api-access-kt5nx\") pod \"node-resolver-5ktrw\" (UID: \"ac8eced4-49d8-49d7-b990-7293cb285952\") " pod="openshift-dns/node-resolver-5ktrw"
Jul 18 00:40:34.728500 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727343    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-host-run-netns\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.728500 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727360    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqfvl\" (UniqueName: \"kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl\") pod \"network-check-target-kmtff\" (UID: \"909b5e56-fd38-4d1d-8123-be740dd195b0\") " pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:40:34.728500 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727388    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-etc-modprobe-d\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.728500 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727398    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ac8eced4-49d8-49d7-b990-7293cb285952-hosts-file\") pod \"node-resolver-5ktrw\" (UID: \"ac8eced4-49d8-49d7-b990-7293cb285952\") " pod="openshift-dns/node-resolver-5ktrw"
Jul 18 00:40:34.728500 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727415    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-lib-modules\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.728500 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727514    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c5317943-47c6-46a6-865a-e062f6ed279b-serviceca\") pod \"node-ca-lqwmf\" (UID: \"c5317943-47c6-46a6-865a-e062f6ed279b\") " pod="openshift-image-registry/node-ca-lqwmf"
Jul 18 00:40:34.728500 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727540    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-lib-modules\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.728500 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727555    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c90e36c2-0247-44b2-9eed-a7054b50a4de-device-dir\") pod \"aws-ebs-csi-driver-node-rh96r\" (UID: \"c90e36c2-0247-44b2-9eed-a7054b50a4de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"
Jul 18 00:40:34.728500 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727559    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-etc-modprobe-d\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.728500 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727583    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-cnibin\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.728500 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727610    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-multus-conf-dir\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.728500 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727637    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-767pw\" (UniqueName: \"kubernetes.io/projected/59d36460-6568-4ce0-b273-cb9b1e69a680-kube-api-access-767pw\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.728500 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727654    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-cnibin\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.728500 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727666    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-host-var-lib-kubelet\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.728500 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727690    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-hostroot\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.728500 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727689    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-multus-conf-dir\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.728500 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727612    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c90e36c2-0247-44b2-9eed-a7054b50a4de-device-dir\") pod \"aws-ebs-csi-driver-node-rh96r\" (UID: \"c90e36c2-0247-44b2-9eed-a7054b50a4de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"
Jul 18 00:40:34.728500 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727715    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-host-run-multus-certs\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.729541 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727747    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-host-var-lib-kubelet\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.729541 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727756    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-host-run-multus-certs\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.729541 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727759    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87cc2380-3d9f-415b-91e4-62553f12db25-host-slash\") pod \"iptables-alerter-wqvnm\" (UID: \"87cc2380-3d9f-415b-91e4-62553f12db25\") " pod="openshift-network-operator/iptables-alerter-wqvnm"
Jul 18 00:40:34.729541 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727794    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87cc2380-3d9f-415b-91e4-62553f12db25-host-slash\") pod \"iptables-alerter-wqvnm\" (UID: \"87cc2380-3d9f-415b-91e4-62553f12db25\") " pod="openshift-network-operator/iptables-alerter-wqvnm"
Jul 18 00:40:34.729541 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727797    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5317943-47c6-46a6-865a-e062f6ed279b-host\") pod \"node-ca-lqwmf\" (UID: \"c5317943-47c6-46a6-865a-e062f6ed279b\") " pod="openshift-image-registry/node-ca-lqwmf"
Jul 18 00:40:34.729541 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727827    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-etc-kubernetes\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.729541 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727771    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-hostroot\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.729541 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727867    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t2zk\" (UniqueName: \"kubernetes.io/projected/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-kube-api-access-6t2zk\") pod \"network-metrics-daemon-nxj6q\" (UID: \"12acb4ef-54f7-4c47-884b-aa81ed6d7eb0\") " pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:40:34.729541 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727916    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59d36460-6568-4ce0-b273-cb9b1e69a680-cni-binary-copy\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.729541 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727943    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-host-run-k8s-cni-cncf-io\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.729541 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727970    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkx6m\" (UniqueName: \"kubernetes.io/projected/c5317943-47c6-46a6-865a-e062f6ed279b-kube-api-access-jkx6m\") pod \"node-ca-lqwmf\" (UID: \"c5317943-47c6-46a6-865a-e062f6ed279b\") " pod="openshift-image-registry/node-ca-lqwmf"
Jul 18 00:40:34.729541 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.727998    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c90e36c2-0247-44b2-9eed-a7054b50a4de-registration-dir\") pod \"aws-ebs-csi-driver-node-rh96r\" (UID: \"c90e36c2-0247-44b2-9eed-a7054b50a4de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"
Jul 18 00:40:34.729541 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728023    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-system-cni-dir\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.729541 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728049    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psl29\" (UniqueName: \"kubernetes.io/projected/87cc2380-3d9f-415b-91e4-62553f12db25-kube-api-access-psl29\") pod \"iptables-alerter-wqvnm\" (UID: \"87cc2380-3d9f-415b-91e4-62553f12db25\") " pod="openshift-network-operator/iptables-alerter-wqvnm"
Jul 18 00:40:34.729541 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728076    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a209204d-2b7f-40e7-9ccb-e79a97531adf-kubelet-config\") pod \"global-pull-secret-syncer-zghtc\" (UID: \"a209204d-2b7f-40e7-9ccb-e79a97531adf\") " pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:34.729541 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728101    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a209204d-2b7f-40e7-9ccb-e79a97531adf-dbus\") pod \"global-pull-secret-syncer-zghtc\" (UID: \"a209204d-2b7f-40e7-9ccb-e79a97531adf\") " pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:34.729541 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728168    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-etc-kubernetes\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.730231 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728224    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-etc-sysctl-conf\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.730231 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728249    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-etc-sysconfig\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.730231 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728265    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-etc-sysctl-d\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.730231 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728277    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a209204d-2b7f-40e7-9ccb-e79a97531adf-dbus\") pod \"global-pull-secret-syncer-zghtc\" (UID: \"a209204d-2b7f-40e7-9ccb-e79a97531adf\") " pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:34.730231 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728281    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-os-release\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.730231 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728319    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-os-release\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.730231 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728323    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59d36460-6568-4ce0-b273-cb9b1e69a680-multus-daemon-config\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.730231 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728346    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5317943-47c6-46a6-865a-e062f6ed279b-host\") pod \"node-ca-lqwmf\" (UID: \"c5317943-47c6-46a6-865a-e062f6ed279b\") " pod="openshift-image-registry/node-ca-lqwmf"
Jul 18 00:40:34.730231 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728355    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87cc2380-3d9f-415b-91e4-62553f12db25-iptables-alerter-script\") pod \"iptables-alerter-wqvnm\" (UID: \"87cc2380-3d9f-415b-91e4-62553f12db25\") " pod="openshift-network-operator/iptables-alerter-wqvnm"
Jul 18 00:40:34.730231 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728386    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-sys\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.730231 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728409    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89f57153-62a1-404e-b478-92969538b6cf-tmp\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.730231 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728435    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-multus-socket-dir-parent\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.730231 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728467    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-var-lib-kubelet\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.730231 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728484    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-etc-sysctl-conf\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.730231 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728493    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-multus-cni-dir\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.730231 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728520    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-etc-sysconfig\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.730231 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728582    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-multus-cni-dir\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.730231 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728597    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-etc-sysctl-d\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.730903 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728653    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a209204d-2b7f-40e7-9ccb-e79a97531adf-kubelet-config\") pod \"global-pull-secret-syncer-zghtc\" (UID: \"a209204d-2b7f-40e7-9ccb-e79a97531adf\") " pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:34.730903 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728688    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-host-run-k8s-cni-cncf-io\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.730903 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728904    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c90e36c2-0247-44b2-9eed-a7054b50a4de-registration-dir\") pod \"aws-ebs-csi-driver-node-rh96r\" (UID: \"c90e36c2-0247-44b2-9eed-a7054b50a4de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"
Jul 18 00:40:34.730903 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.728943    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-system-cni-dir\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.730903 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.729138    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59d36460-6568-4ce0-b273-cb9b1e69a680-cni-binary-copy\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.730903 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.729203    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-sys\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.730903 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.729527    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59d36460-6568-4ce0-b273-cb9b1e69a680-multus-socket-dir-parent\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.730903 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.729607    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89f57153-62a1-404e-b478-92969538b6cf-var-lib-kubelet\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.730903 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.729708    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/89f57153-62a1-404e-b478-92969538b6cf-etc-tuned\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.730903 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.729905    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87cc2380-3d9f-415b-91e4-62553f12db25-iptables-alerter-script\") pod \"iptables-alerter-wqvnm\" (UID: \"87cc2380-3d9f-415b-91e4-62553f12db25\") " pod="openshift-network-operator/iptables-alerter-wqvnm"
Jul 18 00:40:34.730903 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.730205    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59d36460-6568-4ce0-b273-cb9b1e69a680-multus-daemon-config\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.731527 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.731498    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89f57153-62a1-404e-b478-92969538b6cf-tmp\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.735187 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:34.735041    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 00:40:34.735187 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:34.735068    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 00:40:34.735187 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:34.735083    2575 projected.go:196] Error preparing data for projected volume kube-api-access-jqfvl for pod openshift-network-diagnostics/network-check-target-kmtff: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:34.735187 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:34.735148    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl podName:909b5e56-fd38-4d1d-8123-be740dd195b0 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:35.235128216 +0000 UTC m=+3.024540255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jqfvl" (UniqueName: "kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl") pod "network-check-target-kmtff" (UID: "909b5e56-fd38-4d1d-8123-be740dd195b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:34.737686 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.737638    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vmdx\" (UniqueName: \"kubernetes.io/projected/c90e36c2-0247-44b2-9eed-a7054b50a4de-kube-api-access-5vmdx\") pod \"aws-ebs-csi-driver-node-rh96r\" (UID: \"c90e36c2-0247-44b2-9eed-a7054b50a4de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"
Jul 18 00:40:34.738232 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.738186    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zrnv\" (UniqueName: \"kubernetes.io/projected/89f57153-62a1-404e-b478-92969538b6cf-kube-api-access-8zrnv\") pod \"tuned-6fqv2\" (UID: \"89f57153-62a1-404e-b478-92969538b6cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.738656 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.738631    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkx6m\" (UniqueName: \"kubernetes.io/projected/c5317943-47c6-46a6-865a-e062f6ed279b-kube-api-access-jkx6m\") pod \"node-ca-lqwmf\" (UID: \"c5317943-47c6-46a6-865a-e062f6ed279b\") " pod="openshift-image-registry/node-ca-lqwmf"
Jul 18 00:40:34.738814 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.738793    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-767pw\" (UniqueName: \"kubernetes.io/projected/59d36460-6568-4ce0-b273-cb9b1e69a680-kube-api-access-767pw\") pod \"multus-mgzpn\" (UID: \"59d36460-6568-4ce0-b273-cb9b1e69a680\") " pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.738884 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.738832    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt5nx\" (UniqueName: \"kubernetes.io/projected/ac8eced4-49d8-49d7-b990-7293cb285952-kube-api-access-kt5nx\") pod \"node-resolver-5ktrw\" (UID: \"ac8eced4-49d8-49d7-b990-7293cb285952\") " pod="openshift-dns/node-resolver-5ktrw"
Jul 18 00:40:34.739267 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.739216    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t2zk\" (UniqueName: \"kubernetes.io/projected/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-kube-api-access-6t2zk\") pod \"network-metrics-daemon-nxj6q\" (UID: \"12acb4ef-54f7-4c47-884b-aa81ed6d7eb0\") " pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:40:34.740487 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.740464    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psl29\" (UniqueName: \"kubernetes.io/projected/87cc2380-3d9f-415b-91e4-62553f12db25-kube-api-access-psl29\") pod \"iptables-alerter-wqvnm\" (UID: \"87cc2380-3d9f-415b-91e4-62553f12db25\") " pod="openshift-network-operator/iptables-alerter-wqvnm"
Jul 18 00:40:34.821370 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.821331    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zh2l6"
Jul 18 00:40:34.829275 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.829237    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9tn4l"
Jul 18 00:40:34.839358 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.839336    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:40:34.847273 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.847255    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6fqv2"
Jul 18 00:40:34.854007 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.853989    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5ktrw"
Jul 18 00:40:34.863865 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.863847    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r"
Jul 18 00:40:34.872845 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.872823    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mgzpn"
Jul 18 00:40:34.880667 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.880648    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wqvnm"
Jul 18 00:40:34.887425 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:34.887403    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lqwmf"
Jul 18 00:40:35.233747 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:35.233659    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret\") pod \"global-pull-secret-syncer-zghtc\" (UID: \"a209204d-2b7f-40e7-9ccb-e79a97531adf\") " pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:35.233747 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:35.233703    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs\") pod \"network-metrics-daemon-nxj6q\" (UID: \"12acb4ef-54f7-4c47-884b-aa81ed6d7eb0\") " pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:40:35.233973 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:35.233849    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:35.233973 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:35.233848    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:35.233973 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:35.233911    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs podName:12acb4ef-54f7-4c47-884b-aa81ed6d7eb0 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:36.233896164 +0000 UTC m=+4.023308207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs") pod "network-metrics-daemon-nxj6q" (UID: "12acb4ef-54f7-4c47-884b-aa81ed6d7eb0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:35.233973 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:35.233931    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret podName:a209204d-2b7f-40e7-9ccb-e79a97531adf nodeName:}" failed. No retries permitted until 2026-07-18 00:40:36.233920433 +0000 UTC m=+4.023332472 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret") pod "global-pull-secret-syncer-zghtc" (UID: "a209204d-2b7f-40e7-9ccb-e79a97531adf") : object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:35.334992 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:35.334908    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqfvl\" (UniqueName: \"kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl\") pod \"network-check-target-kmtff\" (UID: \"909b5e56-fd38-4d1d-8123-be740dd195b0\") " pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:40:35.335189 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:35.335116    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 00:40:35.335189 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:35.335139    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 00:40:35.335189 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:35.335153    2575 projected.go:196] Error preparing data for projected volume kube-api-access-jqfvl for pod openshift-network-diagnostics/network-check-target-kmtff: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:35.335321 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:35.335228    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl podName:909b5e56-fd38-4d1d-8123-be740dd195b0 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:36.335208659 +0000 UTC m=+4.124620699 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jqfvl" (UniqueName: "kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl") pod "network-check-target-kmtff" (UID: "909b5e56-fd38-4d1d-8123-be740dd195b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:35.547649 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:35.547547    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 00:35:34 +0000 UTC" deadline="2028-02-10 21:51:19.481304204 +0000 UTC"
Jul 18 00:40:35.547649 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:35.547583    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13749h10m43.933725269s"
Jul 18 00:40:35.673006 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:35.672978    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:40:35.673144 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:35.673116    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmtff" podUID="909b5e56-fd38-4d1d-8123-be740dd195b0"
Jul 18 00:40:35.680608 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:35.680579    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87cc2380_3d9f_415b_91e4_62553f12db25.slice/crio-2e71451469d0f14c90690ef696b95cf2d29d20952f65ef3d765508ba44479633 WatchSource:0}: Error finding container 2e71451469d0f14c90690ef696b95cf2d29d20952f65ef3d765508ba44479633: Status 404 returned error can't find the container with id 2e71451469d0f14c90690ef696b95cf2d29d20952f65ef3d765508ba44479633
Jul 18 00:40:35.702912 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:35.702806    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5317943_47c6_46a6_865a_e062f6ed279b.slice/crio-b4bab213994bcb8c8e68033a1e0036783b7fef814377049a0187f52922ee6124 WatchSource:0}: Error finding container b4bab213994bcb8c8e68033a1e0036783b7fef814377049a0187f52922ee6124: Status 404 returned error can't find the container with id b4bab213994bcb8c8e68033a1e0036783b7fef814377049a0187f52922ee6124
Jul 18 00:40:35.706757 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:35.706731    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc90e36c2_0247_44b2_9eed_a7054b50a4de.slice/crio-252aab657d5a6e9aa113cc776f262ad212cc0d67bf161296e663b4d01f70df11 WatchSource:0}: Error finding container 252aab657d5a6e9aa113cc776f262ad212cc0d67bf161296e663b4d01f70df11: Status 404 returned error can't find the container with id 252aab657d5a6e9aa113cc776f262ad212cc0d67bf161296e663b4d01f70df11
Jul 18 00:40:35.707759 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:35.707735    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac8eced4_49d8_49d7_b990_7293cb285952.slice/crio-76b72226f5b6bae33c8b2a0d5c29bb37c6c3766e3d201a31621dcbe115cc543c WatchSource:0}: Error finding container 76b72226f5b6bae33c8b2a0d5c29bb37c6c3766e3d201a31621dcbe115cc543c: Status 404 returned error can't find the container with id 76b72226f5b6bae33c8b2a0d5c29bb37c6c3766e3d201a31621dcbe115cc543c
Jul 18 00:40:35.708824 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:35.708799    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13495ace_a3dd_4fc1_8035_0a2e54879d58.slice/crio-7f6a0b0dc7320373e237c01db0b355bcba3620833727e1c6f3b7bde5138b5e1e WatchSource:0}: Error finding container 7f6a0b0dc7320373e237c01db0b355bcba3620833727e1c6f3b7bde5138b5e1e: Status 404 returned error can't find the container with id 7f6a0b0dc7320373e237c01db0b355bcba3620833727e1c6f3b7bde5138b5e1e
Jul 18 00:40:35.711159 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:40:35.711128    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9311a43d_6509_4370_9c1b_1db5eeb58cb0.slice/crio-858a184bb79232bf1c03140ba946bce9e5d640fbdf34edd4ab2f1e03ac0c7547 WatchSource:0}: Error finding container 858a184bb79232bf1c03140ba946bce9e5d640fbdf34edd4ab2f1e03ac0c7547: Status 404 returned error can't find the container with id 858a184bb79232bf1c03140ba946bce9e5d640fbdf34edd4ab2f1e03ac0c7547
Jul 18 00:40:36.242770 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:36.242508    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret\") pod \"global-pull-secret-syncer-zghtc\" (UID: \"a209204d-2b7f-40e7-9ccb-e79a97531adf\") " pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:36.242965 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:36.242814    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs\") pod \"network-metrics-daemon-nxj6q\" (UID: \"12acb4ef-54f7-4c47-884b-aa81ed6d7eb0\") " pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:40:36.243324 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:36.243037    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:36.243324 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:36.243108    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs podName:12acb4ef-54f7-4c47-884b-aa81ed6d7eb0 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:38.24308786 +0000 UTC m=+6.032499921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs") pod "network-metrics-daemon-nxj6q" (UID: "12acb4ef-54f7-4c47-884b-aa81ed6d7eb0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:36.243772 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:36.243571    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:36.243772 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:36.243629    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret podName:a209204d-2b7f-40e7-9ccb-e79a97531adf nodeName:}" failed. No retries permitted until 2026-07-18 00:40:38.243610756 +0000 UTC m=+6.033022827 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret") pod "global-pull-secret-syncer-zghtc" (UID: "a209204d-2b7f-40e7-9ccb-e79a97531adf") : object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:36.343265 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:36.343222    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqfvl\" (UniqueName: \"kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl\") pod \"network-check-target-kmtff\" (UID: \"909b5e56-fd38-4d1d-8123-be740dd195b0\") " pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:40:36.343506 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:36.343480    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 00:40:36.343589 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:36.343519    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 00:40:36.343589 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:36.343534    2575 projected.go:196] Error preparing data for projected volume kube-api-access-jqfvl for pod openshift-network-diagnostics/network-check-target-kmtff: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:36.343708 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:36.343592    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl podName:909b5e56-fd38-4d1d-8123-be740dd195b0 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:38.343574021 +0000 UTC m=+6.132986058 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jqfvl" (UniqueName: "kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl") pod "network-check-target-kmtff" (UID: "909b5e56-fd38-4d1d-8123-be740dd195b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:36.548679 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:36.548562    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 00:35:34 +0000 UTC" deadline="2027-12-30 09:14:50.272330732 +0000 UTC"
Jul 18 00:40:36.548679 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:36.548631    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12728h34m13.723704316s"
Jul 18 00:40:36.675559 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:36.675529    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:40:36.675732 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:36.675674    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxj6q" podUID="12acb4ef-54f7-4c47-884b-aa81ed6d7eb0"
Jul 18 00:40:36.676117 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:36.676096    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:36.676219 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:36.676199    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zghtc" podUID="a209204d-2b7f-40e7-9ccb-e79a97531adf"
Jul 18 00:40:36.700701 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:36.700394    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6fqv2" event={"ID":"89f57153-62a1-404e-b478-92969538b6cf","Type":"ContainerStarted","Data":"92f92d910ffb6d2cabd11311408042a993ba028bc4e0074868baaa7f61e24a0c"}
Jul 18 00:40:36.708618 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:36.708563    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zh2l6" event={"ID":"13495ace-a3dd-4fc1-8035-0a2e54879d58","Type":"ContainerStarted","Data":"7f6a0b0dc7320373e237c01db0b355bcba3620833727e1c6f3b7bde5138b5e1e"}
Jul 18 00:40:36.715134 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:36.715100    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r" event={"ID":"c90e36c2-0247-44b2-9eed-a7054b50a4de","Type":"ContainerStarted","Data":"252aab657d5a6e9aa113cc776f262ad212cc0d67bf161296e663b4d01f70df11"}
Jul 18 00:40:36.728737 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:36.728706    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wqvnm" event={"ID":"87cc2380-3d9f-415b-91e4-62553f12db25","Type":"ContainerStarted","Data":"2e71451469d0f14c90690ef696b95cf2d29d20952f65ef3d765508ba44479633"}
Jul 18 00:40:36.738507 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:36.738476    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal" event={"ID":"a4f18a4042ac0c4f669794ed57bc7586","Type":"ContainerStarted","Data":"d2dcd0cd76c8dd0bc44d956ea9acd93fb73e59b30c32e5600dac85d621c3b0b8"}
Jul 18 00:40:36.748788 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:36.748760    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9tn4l" event={"ID":"031ededa-1f92-4818-873b-631a36945bfe","Type":"ContainerStarted","Data":"4b4093f7ee01b92445fd8a4027e6b9ae6919a2ffa19011682b8998b0f2823926"}
Jul 18 00:40:36.755037 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:36.754922    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal" podStartSLOduration=2.754904615 podStartE2EDuration="2.754904615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:36.754226211 +0000 UTC m=+4.543638261" watchObservedRunningTime="2026-07-18 00:40:36.754904615 +0000 UTC m=+4.544316677"
Jul 18 00:40:36.762398 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:36.762336    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mgzpn" event={"ID":"59d36460-6568-4ce0-b273-cb9b1e69a680","Type":"ContainerStarted","Data":"476f2c2f7e2d78987a051ec736e8bef118c81580860dd098ad19395bd80f9dc1"}
Jul 18 00:40:36.775374 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:36.775261    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjb92" event={"ID":"9311a43d-6509-4370-9c1b-1db5eeb58cb0","Type":"ContainerStarted","Data":"858a184bb79232bf1c03140ba946bce9e5d640fbdf34edd4ab2f1e03ac0c7547"}
Jul 18 00:40:36.783575 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:36.783504    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5ktrw" event={"ID":"ac8eced4-49d8-49d7-b990-7293cb285952","Type":"ContainerStarted","Data":"76b72226f5b6bae33c8b2a0d5c29bb37c6c3766e3d201a31621dcbe115cc543c"}
Jul 18 00:40:36.788188 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:36.788126    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lqwmf" event={"ID":"c5317943-47c6-46a6-865a-e062f6ed279b","Type":"ContainerStarted","Data":"b4bab213994bcb8c8e68033a1e0036783b7fef814377049a0187f52922ee6124"}
Jul 18 00:40:36.792904 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:36.792799    2575 generic.go:356] "Generic (PLEG): container finished" podID="fa81fefd8cb9506ed41c32bd7a3ab6b4" containerID="1b6fbb318a021d504eb291f27efa63ad5379bd0992d943f2f3ef48634c3859e2" exitCode=0
Jul 18 00:40:36.792904 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:36.792835    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal" event={"ID":"fa81fefd8cb9506ed41c32bd7a3ab6b4","Type":"ContainerDied","Data":"1b6fbb318a021d504eb291f27efa63ad5379bd0992d943f2f3ef48634c3859e2"}
Jul 18 00:40:37.672781 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:37.672747    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:40:37.673221 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:37.672874    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmtff" podUID="909b5e56-fd38-4d1d-8123-be740dd195b0"
Jul 18 00:40:37.808987 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:37.808951    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal" event={"ID":"fa81fefd8cb9506ed41c32bd7a3ab6b4","Type":"ContainerStarted","Data":"b5327b7da14d809b914ba487b176dd7dc7e3e80a5ef7cc23b50f871f759f1fca"}
Jul 18 00:40:38.261022 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:38.260710    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret\") pod \"global-pull-secret-syncer-zghtc\" (UID: \"a209204d-2b7f-40e7-9ccb-e79a97531adf\") " pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:38.261022 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:38.260772    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs\") pod \"network-metrics-daemon-nxj6q\" (UID: \"12acb4ef-54f7-4c47-884b-aa81ed6d7eb0\") " pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:40:38.261022 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:38.260829    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:38.261022 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:38.260895    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret podName:a209204d-2b7f-40e7-9ccb-e79a97531adf nodeName:}" failed. No retries permitted until 2026-07-18 00:40:42.260876566 +0000 UTC m=+10.050288605 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret") pod "global-pull-secret-syncer-zghtc" (UID: "a209204d-2b7f-40e7-9ccb-e79a97531adf") : object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:38.261022 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:38.260956    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:38.261022 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:38.260994    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs podName:12acb4ef-54f7-4c47-884b-aa81ed6d7eb0 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:42.260982528 +0000 UTC m=+10.050394567 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs") pod "network-metrics-daemon-nxj6q" (UID: "12acb4ef-54f7-4c47-884b-aa81ed6d7eb0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:38.361934 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:38.361895    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqfvl\" (UniqueName: \"kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl\") pod \"network-check-target-kmtff\" (UID: \"909b5e56-fd38-4d1d-8123-be740dd195b0\") " pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:40:38.362131 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:38.362079    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 00:40:38.362131 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:38.362104    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 00:40:38.362131 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:38.362118    2575 projected.go:196] Error preparing data for projected volume kube-api-access-jqfvl for pod openshift-network-diagnostics/network-check-target-kmtff: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:38.362379 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:38.362177    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl podName:909b5e56-fd38-4d1d-8123-be740dd195b0 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:42.362157318 +0000 UTC m=+10.151569359 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jqfvl" (UniqueName: "kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl") pod "network-check-target-kmtff" (UID: "909b5e56-fd38-4d1d-8123-be740dd195b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:38.674625 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:38.674592    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:38.675097 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:38.674730    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zghtc" podUID="a209204d-2b7f-40e7-9ccb-e79a97531adf"
Jul 18 00:40:38.675164 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:38.675115    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:40:38.675293 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:38.675237    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxj6q" podUID="12acb4ef-54f7-4c47-884b-aa81ed6d7eb0"
Jul 18 00:40:39.672948 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:39.672917    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:40:39.673131 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:39.673050    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmtff" podUID="909b5e56-fd38-4d1d-8123-be740dd195b0"
Jul 18 00:40:40.673147 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:40.673114    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:40:40.673602 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:40.673274    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxj6q" podUID="12acb4ef-54f7-4c47-884b-aa81ed6d7eb0"
Jul 18 00:40:40.673702 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:40.673685    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:40.673801 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:40.673781    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zghtc" podUID="a209204d-2b7f-40e7-9ccb-e79a97531adf"
Jul 18 00:40:41.672354 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:41.672319    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:40:41.672534 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:41.672452    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmtff" podUID="909b5e56-fd38-4d1d-8123-be740dd195b0"
Jul 18 00:40:42.295634 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:42.295599    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs\") pod \"network-metrics-daemon-nxj6q\" (UID: \"12acb4ef-54f7-4c47-884b-aa81ed6d7eb0\") " pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:40:42.296066 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:42.295683    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret\") pod \"global-pull-secret-syncer-zghtc\" (UID: \"a209204d-2b7f-40e7-9ccb-e79a97531adf\") " pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:42.296066 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:42.295768    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:42.296066 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:42.295795    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:42.296066 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:42.295840    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs podName:12acb4ef-54f7-4c47-884b-aa81ed6d7eb0 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:50.295818848 +0000 UTC m=+18.085230903 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs") pod "network-metrics-daemon-nxj6q" (UID: "12acb4ef-54f7-4c47-884b-aa81ed6d7eb0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:42.296066 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:42.295862    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret podName:a209204d-2b7f-40e7-9ccb-e79a97531adf nodeName:}" failed. No retries permitted until 2026-07-18 00:40:50.295852747 +0000 UTC m=+18.085264788 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret") pod "global-pull-secret-syncer-zghtc" (UID: "a209204d-2b7f-40e7-9ccb-e79a97531adf") : object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:42.396165 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:42.396134    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqfvl\" (UniqueName: \"kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl\") pod \"network-check-target-kmtff\" (UID: \"909b5e56-fd38-4d1d-8123-be740dd195b0\") " pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:40:42.396352 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:42.396301    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 00:40:42.396352 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:42.396325    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 00:40:42.396352 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:42.396339    2575 projected.go:196] Error preparing data for projected volume kube-api-access-jqfvl for pod openshift-network-diagnostics/network-check-target-kmtff: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:42.396528 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:42.396388    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl podName:909b5e56-fd38-4d1d-8123-be740dd195b0 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:50.396371844 +0000 UTC m=+18.185783880 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jqfvl" (UniqueName: "kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl") pod "network-check-target-kmtff" (UID: "909b5e56-fd38-4d1d-8123-be740dd195b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:42.673986 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:42.673953    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:40:42.674166 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:42.674068    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxj6q" podUID="12acb4ef-54f7-4c47-884b-aa81ed6d7eb0"
Jul 18 00:40:42.674460 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:42.674311    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:42.674460 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:42.674425    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zghtc" podUID="a209204d-2b7f-40e7-9ccb-e79a97531adf"
Jul 18 00:40:43.673293 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:43.673251    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:40:43.673676 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:43.673384    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmtff" podUID="909b5e56-fd38-4d1d-8123-be740dd195b0"
Jul 18 00:40:44.673950 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:44.673917    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:40:44.674375 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:44.674031    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxj6q" podUID="12acb4ef-54f7-4c47-884b-aa81ed6d7eb0"
Jul 18 00:40:44.674375 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:44.674329    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:44.674489 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:44.674435    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zghtc" podUID="a209204d-2b7f-40e7-9ccb-e79a97531adf"
Jul 18 00:40:45.672272 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:45.672243    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:40:45.672431 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:45.672409    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmtff" podUID="909b5e56-fd38-4d1d-8123-be740dd195b0"
Jul 18 00:40:46.672723 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:46.672680    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:40:46.673137 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:46.672819    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxj6q" podUID="12acb4ef-54f7-4c47-884b-aa81ed6d7eb0"
Jul 18 00:40:46.673137 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:46.672895    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:46.673137 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:46.672999    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zghtc" podUID="a209204d-2b7f-40e7-9ccb-e79a97531adf"
Jul 18 00:40:47.673047 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:47.673017    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:40:47.673455 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:47.673124    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmtff" podUID="909b5e56-fd38-4d1d-8123-be740dd195b0"
Jul 18 00:40:48.672788 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:48.672755    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:48.672985 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:48.672876    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:40:48.672985 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:48.672928    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zghtc" podUID="a209204d-2b7f-40e7-9ccb-e79a97531adf"
Jul 18 00:40:48.673084 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:48.672978    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxj6q" podUID="12acb4ef-54f7-4c47-884b-aa81ed6d7eb0"
Jul 18 00:40:49.672883 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:49.672850    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:40:49.673060 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:49.672975    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmtff" podUID="909b5e56-fd38-4d1d-8123-be740dd195b0"
Jul 18 00:40:50.361062 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:50.361026    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs\") pod \"network-metrics-daemon-nxj6q\" (UID: \"12acb4ef-54f7-4c47-884b-aa81ed6d7eb0\") " pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:40:50.361568 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:50.361123    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret\") pod \"global-pull-secret-syncer-zghtc\" (UID: \"a209204d-2b7f-40e7-9ccb-e79a97531adf\") " pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:50.361568 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:50.361205    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:50.361568 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:50.361223    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:50.361568 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:50.361271    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs podName:12acb4ef-54f7-4c47-884b-aa81ed6d7eb0 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:06.361254683 +0000 UTC m=+34.150666720 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs") pod "network-metrics-daemon-nxj6q" (UID: "12acb4ef-54f7-4c47-884b-aa81ed6d7eb0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:40:50.361568 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:50.361291    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret podName:a209204d-2b7f-40e7-9ccb-e79a97531adf nodeName:}" failed. No retries permitted until 2026-07-18 00:41:06.361282563 +0000 UTC m=+34.150694597 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret") pod "global-pull-secret-syncer-zghtc" (UID: "a209204d-2b7f-40e7-9ccb-e79a97531adf") : object "kube-system"/"original-pull-secret" not registered
Jul 18 00:40:50.461758 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:50.461724    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqfvl\" (UniqueName: \"kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl\") pod \"network-check-target-kmtff\" (UID: \"909b5e56-fd38-4d1d-8123-be740dd195b0\") " pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:40:50.461925 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:50.461875    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 00:40:50.461925 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:50.461899    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 00:40:50.461925 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:50.461908    2575 projected.go:196] Error preparing data for projected volume kube-api-access-jqfvl for pod openshift-network-diagnostics/network-check-target-kmtff: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:50.462121 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:50.461965    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl podName:909b5e56-fd38-4d1d-8123-be740dd195b0 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:06.461949378 +0000 UTC m=+34.251361412 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jqfvl" (UniqueName: "kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl") pod "network-check-target-kmtff" (UID: "909b5e56-fd38-4d1d-8123-be740dd195b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:40:50.673090 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:50.673004    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:40:50.673252 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:50.673150    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxj6q" podUID="12acb4ef-54f7-4c47-884b-aa81ed6d7eb0"
Jul 18 00:40:50.673338 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:50.673005    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:50.673474 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:50.673450    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zghtc" podUID="a209204d-2b7f-40e7-9ccb-e79a97531adf"
Jul 18 00:40:51.672448 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:51.672412    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:40:51.672896 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:51.672580    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmtff" podUID="909b5e56-fd38-4d1d-8123-be740dd195b0"
Jul 18 00:40:52.672987 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:52.672957    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:52.673402 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:52.673066    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zghtc" podUID="a209204d-2b7f-40e7-9ccb-e79a97531adf"
Jul 18 00:40:52.673402 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:52.673099    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:40:52.673402 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:52.673201    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxj6q" podUID="12acb4ef-54f7-4c47-884b-aa81ed6d7eb0"
Jul 18 00:40:53.672871 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:53.672829    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:40:53.673032 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:53.672948    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmtff" podUID="909b5e56-fd38-4d1d-8123-be740dd195b0"
Jul 18 00:40:54.672409 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:54.672382    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:54.673199 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:54.673154    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zghtc" podUID="a209204d-2b7f-40e7-9ccb-e79a97531adf"
Jul 18 00:40:54.673535 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:54.673267    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:40:54.673535 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:54.673391    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxj6q" podUID="12acb4ef-54f7-4c47-884b-aa81ed6d7eb0"
Jul 18 00:40:54.860176 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:54.859500    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lqwmf" event={"ID":"c5317943-47c6-46a6-865a-e062f6ed279b","Type":"ContainerStarted","Data":"b4f84062ac144db5ba6d9f29d7ec5b8bdf8854381a6cd55c4b735c37be2f9850"}
Jul 18 00:40:54.861972 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:54.861943    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6fqv2" event={"ID":"89f57153-62a1-404e-b478-92969538b6cf","Type":"ContainerStarted","Data":"f854bce241ba12094bf16092745f4c5d46563bcee1c1afc8393ba52d480a54ba"}
Jul 18 00:40:54.874295 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:54.874204    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal" podStartSLOduration=20.874166301 podStartE2EDuration="20.874166301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:37.825234253 +0000 UTC m=+5.614646314" watchObservedRunningTime="2026-07-18 00:40:54.874166301 +0000 UTC m=+22.663578360"
Jul 18 00:40:54.899671 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:54.899622    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6fqv2" podStartSLOduration=4.043572127 podStartE2EDuration="22.899601062s" totalImagesPullingTime="18.856028935s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:54.899527165 +0000 UTC m=+22.688939221" watchObservedRunningTime="2026-07-18 00:40:54.899601062 +0000 UTC m=+22.689013119"
Jul 18 00:40:54.900510 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:54.900472    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lqwmf" podStartSLOduration=4.001597362 podStartE2EDuration="22.900456019s" totalImagesPullingTime="18.898858657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:54.875281236 +0000 UTC m=+22.664693293" watchObservedRunningTime="2026-07-18 00:40:54.900456019 +0000 UTC m=+22.689868078"
Jul 18 00:40:55.672604 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:55.672302    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:40:55.672800 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:55.672700    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmtff" podUID="909b5e56-fd38-4d1d-8123-be740dd195b0"
Jul 18 00:40:55.864844 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:55.864808    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9tn4l" event={"ID":"031ededa-1f92-4818-873b-631a36945bfe","Type":"ContainerStarted","Data":"7808ab5f8d968f840ceab94fc9cddbb5a79c9e365b1a83fd0206a55e27bd5608"}
Jul 18 00:40:55.866830 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:55.866800    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mgzpn" event={"ID":"59d36460-6568-4ce0-b273-cb9b1e69a680","Type":"ContainerStarted","Data":"ba21e1d779b08987db0257543581c9dfc069e389411762ff727d7080f6e57106"}
Jul 18 00:40:55.876062 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:55.876042    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 00:40:55.876424 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:55.876404    2575 generic.go:356] "Generic (PLEG): container finished" podID="9311a43d-6509-4370-9c1b-1db5eeb58cb0" containerID="cb5e8fd633063e6d7c97fd8b464d559fa408654576fb57c5d62fbdc9c846245d" exitCode=1
Jul 18 00:40:55.876495 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:55.876479    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjb92" event={"ID":"9311a43d-6509-4370-9c1b-1db5eeb58cb0","Type":"ContainerStarted","Data":"33c84be5349ac86f097e800ab895c781e69d49525b91864699987e1798c9307a"}
Jul 18 00:40:55.876563 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:55.876551    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjb92" event={"ID":"9311a43d-6509-4370-9c1b-1db5eeb58cb0","Type":"ContainerStarted","Data":"c9e21e1c9ce67d12e3c4600faf3fe969e1fa5beeea2062fd4aac28a5ca5309df"}
Jul 18 00:40:55.876618 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:55.876595    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjb92" event={"ID":"9311a43d-6509-4370-9c1b-1db5eeb58cb0","Type":"ContainerStarted","Data":"4856abab0b475af7352a51f2cf5fa0cd2020de582c505315a1640067aecce192"}
Jul 18 00:40:55.876662 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:55.876642    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjb92" event={"ID":"9311a43d-6509-4370-9c1b-1db5eeb58cb0","Type":"ContainerStarted","Data":"de6b78b04633efc71e98958c4b074aa028fd12e11e896063d0a3750a741f3e19"}
Jul 18 00:40:55.876699 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:55.876675    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjb92" event={"ID":"9311a43d-6509-4370-9c1b-1db5eeb58cb0","Type":"ContainerDied","Data":"cb5e8fd633063e6d7c97fd8b464d559fa408654576fb57c5d62fbdc9c846245d"}
Jul 18 00:40:55.876728 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:55.876703    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjb92" event={"ID":"9311a43d-6509-4370-9c1b-1db5eeb58cb0","Type":"ContainerStarted","Data":"2c4dfe5de5600bdeb89bfd7368199b8ff34d3c3c75545114ef134740e4743162"}
Jul 18 00:40:55.878540 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:55.878514    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5ktrw" event={"ID":"ac8eced4-49d8-49d7-b990-7293cb285952","Type":"ContainerStarted","Data":"b2c1f290fa276846e42133fdb61cca2162abf271c85c9ae9b14b62e0f70798ae"}
Jul 18 00:40:55.880615 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:55.880593    2575 generic.go:356] "Generic (PLEG): container finished" podID="13495ace-a3dd-4fc1-8035-0a2e54879d58" containerID="82deaf04e3d5f5a3758bf80406d29ac218b22ab3b5da62a33fd17614f2d0498c" exitCode=0
Jul 18 00:40:55.880696 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:55.880686    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zh2l6" event={"ID":"13495ace-a3dd-4fc1-8035-0a2e54879d58","Type":"ContainerDied","Data":"82deaf04e3d5f5a3758bf80406d29ac218b22ab3b5da62a33fd17614f2d0498c"}
Jul 18 00:40:55.882149 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:55.882118    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r" event={"ID":"c90e36c2-0247-44b2-9eed-a7054b50a4de","Type":"ContainerStarted","Data":"3302fb25fde8a94c11167f4c7f9319e323e4de8e8c759f8fbb37d5245f4ec984"}
Jul 18 00:40:55.898479 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:55.898440    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9tn4l" podStartSLOduration=5.041477291 podStartE2EDuration="23.898427558s" totalImagesPullingTime="18.856950267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:55.898230289 +0000 UTC m=+23.687642346" watchObservedRunningTime="2026-07-18 00:40:55.898427558 +0000 UTC m=+23.687839615"
Jul 18 00:40:55.942850 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:55.942824    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 18 00:40:55.969932 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:55.969885    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mgzpn" podStartSLOduration=4.789017064 podStartE2EDuration="23.969871254s" totalImagesPullingTime="19.18085419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:55.969767672 +0000 UTC m=+23.759179728" watchObservedRunningTime="2026-07-18 00:40:55.969871254 +0000 UTC m=+23.759283310"
Jul 18 00:40:55.989261 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:55.989207    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5ktrw" podStartSLOduration=5.096260611 podStartE2EDuration="23.989174433s" totalImagesPullingTime="18.892913822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:55.988931759 +0000 UTC m=+23.778343815" watchObservedRunningTime="2026-07-18 00:40:55.989174433 +0000 UTC m=+23.778586489"
Jul 18 00:40:56.575379 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:56.575142    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-18T00:40:55.94284696Z","UUID":"56225bf6-153b-4501-9255-184479f7d449","Handler":null,"Name":"","Endpoint":""}
Jul 18 00:40:56.577007 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:56.576983    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 18 00:40:56.577137 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:56.577032    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 18 00:40:56.672681 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:56.672365    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:56.672681 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:56.672395    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:40:56.672681 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:56.672490    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zghtc" podUID="a209204d-2b7f-40e7-9ccb-e79a97531adf"
Jul 18 00:40:56.675060 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:56.675003    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxj6q" podUID="12acb4ef-54f7-4c47-884b-aa81ed6d7eb0"
Jul 18 00:40:56.886635 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:56.886593    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r" event={"ID":"c90e36c2-0247-44b2-9eed-a7054b50a4de","Type":"ContainerStarted","Data":"43a9983112fd7f4fd39c452263270bd2e7cc4e06d1afd63bd55d10fc93a59047"}
Jul 18 00:40:56.888064 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:56.888038    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wqvnm" event={"ID":"87cc2380-3d9f-415b-91e4-62553f12db25","Type":"ContainerStarted","Data":"caf30dadc808b9d8102fc8227937d08b0618668be82d2b8cfaba35f6b875450d"}
Jul 18 00:40:56.902611 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:56.902572    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wqvnm" podStartSLOduration=5.993945366 podStartE2EDuration="24.902558875s" totalImagesPullingTime="18.908613509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:56.902520498 +0000 UTC m=+24.691932555" watchObservedRunningTime="2026-07-18 00:40:56.902558875 +0000 UTC m=+24.691970932"
Jul 18 00:40:57.414552 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:57.414521    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9tn4l"
Jul 18 00:40:57.415209 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:57.415174    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9tn4l"
Jul 18 00:40:57.673055 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:57.672978    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:40:57.673203 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:57.673100    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmtff" podUID="909b5e56-fd38-4d1d-8123-be740dd195b0"
Jul 18 00:40:57.894416 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:57.894389    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 00:40:57.894860 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:57.894835    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjb92" event={"ID":"9311a43d-6509-4370-9c1b-1db5eeb58cb0","Type":"ContainerStarted","Data":"2e4ef5d19211dc73b8daea51ae36ca20316f6345b75fb4076f26a1833dcdd447"}
Jul 18 00:40:57.897200 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:57.897154    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r" event={"ID":"c90e36c2-0247-44b2-9eed-a7054b50a4de","Type":"ContainerStarted","Data":"bb4f83fbf632b86c01858adfa7bdf6a334fbb2902b98529ead770163d00a40ef"}
Jul 18 00:40:57.897468 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:57.897412    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9tn4l"
Jul 18 00:40:57.897964 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:57.897936    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9tn4l"
Jul 18 00:40:57.914792 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:57.914744    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh96r" podStartSLOduration=5.110146364 podStartE2EDuration="25.914730079s" totalImagesPullingTime="20.804583715s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:57.91363165 +0000 UTC m=+25.703043706" watchObservedRunningTime="2026-07-18 00:40:57.914730079 +0000 UTC m=+25.704142117"
Jul 18 00:40:58.673561 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:58.673524    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:40:58.673721 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:58.673648    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxj6q" podUID="12acb4ef-54f7-4c47-884b-aa81ed6d7eb0"
Jul 18 00:40:58.673721 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:58.673707    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:40:58.673845 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:58.673827    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zghtc" podUID="a209204d-2b7f-40e7-9ccb-e79a97531adf"
Jul 18 00:40:59.673438 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:40:59.673222    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:40:59.673888 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:40:59.673516    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmtff" podUID="909b5e56-fd38-4d1d-8123-be740dd195b0"
Jul 18 00:41:00.672528 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:00.672492    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:41:00.672689 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:00.672492    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:41:00.672689 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:00.672621    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxj6q" podUID="12acb4ef-54f7-4c47-884b-aa81ed6d7eb0"
Jul 18 00:41:00.672689 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:00.672664    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zghtc" podUID="a209204d-2b7f-40e7-9ccb-e79a97531adf"
Jul 18 00:41:00.906546 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:00.906517    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 00:41:00.907298 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:00.906893    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjb92" event={"ID":"9311a43d-6509-4370-9c1b-1db5eeb58cb0","Type":"ContainerStarted","Data":"798a9d01abde4408ad67bdcb1a802485c7c69be365d0a00948c018af2d41f147"}
Jul 18 00:41:00.907298 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:00.907133    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:41:00.907400 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:00.907334    2575 scope.go:117] "RemoveContainer" containerID="cb5e8fd633063e6d7c97fd8b464d559fa408654576fb57c5d62fbdc9c846245d"
Jul 18 00:41:00.908793 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:00.908774    2575 generic.go:356] "Generic (PLEG): container finished" podID="13495ace-a3dd-4fc1-8035-0a2e54879d58" containerID="ebd922779f9c85f9dd906ff759ce2c174443478426b29831c5f03394bb18c6dd" exitCode=0
Jul 18 00:41:00.908897 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:00.908808    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zh2l6" event={"ID":"13495ace-a3dd-4fc1-8035-0a2e54879d58","Type":"ContainerDied","Data":"ebd922779f9c85f9dd906ff759ce2c174443478426b29831c5f03394bb18c6dd"}
Jul 18 00:41:00.924151 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:00.924129    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:41:00.995951 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:00.995928    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:41:01.672820 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:01.672794    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:41:01.672940 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:01.672904    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmtff" podUID="909b5e56-fd38-4d1d-8123-be740dd195b0"
Jul 18 00:41:01.887200 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:01.887147    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nxj6q"]
Jul 18 00:41:01.887352 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:01.887304    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:41:01.887429 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:01.887407    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxj6q" podUID="12acb4ef-54f7-4c47-884b-aa81ed6d7eb0"
Jul 18 00:41:01.893372 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:01.893342    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kmtff"]
Jul 18 00:41:01.894166 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:01.894144    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zghtc"]
Jul 18 00:41:01.894308 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:01.894291    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:41:01.894437 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:01.894413    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zghtc" podUID="a209204d-2b7f-40e7-9ccb-e79a97531adf"
Jul 18 00:41:01.915245 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:01.915220    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 00:41:01.915687 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:01.915652    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjb92" event={"ID":"9311a43d-6509-4370-9c1b-1db5eeb58cb0","Type":"ContainerStarted","Data":"e27d377a65679fde948d921e0d6c9ca41a0649f128ff0874eab276e4e5994880"}
Jul 18 00:41:01.915955 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:01.915936    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:41:01.918244 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:01.918224    2575 generic.go:356] "Generic (PLEG): container finished" podID="13495ace-a3dd-4fc1-8035-0a2e54879d58" containerID="c1087333e42650822a0c4c1f6f3bfab455a5b84cf16bd638bd7acc0d4b6e52f8" exitCode=0
Jul 18 00:41:01.918335 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:01.918282    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:41:01.918335 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:01.918308    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zh2l6" event={"ID":"13495ace-a3dd-4fc1-8035-0a2e54879d58","Type":"ContainerDied","Data":"c1087333e42650822a0c4c1f6f3bfab455a5b84cf16bd638bd7acc0d4b6e52f8"}
Jul 18 00:41:01.918427 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:01.918373    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmtff" podUID="909b5e56-fd38-4d1d-8123-be740dd195b0"
Jul 18 00:41:01.935167 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:01.935144    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:41:01.943976 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:01.943937    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tjb92" podStartSLOduration=10.805018476 podStartE2EDuration="29.943918945s" totalImagesPullingTime="19.138900469s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:01.942637431 +0000 UTC m=+29.732049487" watchObservedRunningTime="2026-07-18 00:41:01.943918945 +0000 UTC m=+29.733331003"
Jul 18 00:41:02.923220 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:02.923025    2575 generic.go:356] "Generic (PLEG): container finished" podID="13495ace-a3dd-4fc1-8035-0a2e54879d58" containerID="e4c8b8823e0d3472f602e48b27e8a44c6f5366c8afeddadb1faa863add7d8a12" exitCode=0
Jul 18 00:41:02.923602 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:02.923112    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zh2l6" event={"ID":"13495ace-a3dd-4fc1-8035-0a2e54879d58","Type":"ContainerDied","Data":"e4c8b8823e0d3472f602e48b27e8a44c6f5366c8afeddadb1faa863add7d8a12"}
Jul 18 00:41:03.672344 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:03.672319    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:41:03.672506 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:03.672434    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zghtc" podUID="a209204d-2b7f-40e7-9ccb-e79a97531adf"
Jul 18 00:41:03.672506 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:03.672447    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:41:03.672607 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:03.672546    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmtff" podUID="909b5e56-fd38-4d1d-8123-be740dd195b0"
Jul 18 00:41:03.672607 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:03.672577    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:41:03.672707 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:03.672657    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxj6q" podUID="12acb4ef-54f7-4c47-884b-aa81ed6d7eb0"
Jul 18 00:41:05.673219 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:05.673163    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:41:05.673219 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:05.673202    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:41:05.673784 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:05.673295    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:41:05.673784 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:05.673304    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zghtc" podUID="a209204d-2b7f-40e7-9ccb-e79a97531adf"
Jul 18 00:41:05.673784 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:05.673395    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kmtff" podUID="909b5e56-fd38-4d1d-8123-be740dd195b0"
Jul 18 00:41:05.673784 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:05.673516    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxj6q" podUID="12acb4ef-54f7-4c47-884b-aa81ed6d7eb0"
Jul 18 00:41:06.382113 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.382076    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs\") pod \"network-metrics-daemon-nxj6q\" (UID: \"12acb4ef-54f7-4c47-884b-aa81ed6d7eb0\") " pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:41:06.382321 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.382173    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret\") pod \"global-pull-secret-syncer-zghtc\" (UID: \"a209204d-2b7f-40e7-9ccb-e79a97531adf\") " pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:41:06.382321 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:06.382253    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:41:06.382321 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:06.382310    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 00:41:06.382469 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:06.382341    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs podName:12acb4ef-54f7-4c47-884b-aa81ed6d7eb0 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:38.382317897 +0000 UTC m=+66.171729939 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs") pod "network-metrics-daemon-nxj6q" (UID: "12acb4ef-54f7-4c47-884b-aa81ed6d7eb0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 00:41:06.382469 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:06.382372    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret podName:a209204d-2b7f-40e7-9ccb-e79a97531adf nodeName:}" failed. No retries permitted until 2026-07-18 00:41:38.382355107 +0000 UTC m=+66.171767147 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret") pod "global-pull-secret-syncer-zghtc" (UID: "a209204d-2b7f-40e7-9ccb-e79a97531adf") : object "kube-system"/"original-pull-secret" not registered
Jul 18 00:41:06.482828 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.482790    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqfvl\" (UniqueName: \"kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl\") pod \"network-check-target-kmtff\" (UID: \"909b5e56-fd38-4d1d-8123-be740dd195b0\") " pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:41:06.483034 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:06.482975    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 00:41:06.483034 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:06.483002    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 00:41:06.483034 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:06.483017    2575 projected.go:196] Error preparing data for projected volume kube-api-access-jqfvl for pod openshift-network-diagnostics/network-check-target-kmtff: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:41:06.483217 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:06.483079    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl podName:909b5e56-fd38-4d1d-8123-be740dd195b0 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:38.483065806 +0000 UTC m=+66.272477840 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jqfvl" (UniqueName: "kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl") pod "network-check-target-kmtff" (UID: "909b5e56-fd38-4d1d-8123-be740dd195b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 00:41:06.517884 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.517856    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeReady"
Jul 18 00:41:06.518047 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.518017    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 18 00:41:06.559175 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.559100    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b6fc46484-nrvvm"]
Jul 18 00:41:06.576833 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.576804    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nmq5l"]
Jul 18 00:41:06.577001 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.576940    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.579742 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.579591    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h4ffv\""
Jul 18 00:41:06.579742 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.579591    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 18 00:41:06.579742 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.579670    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 18 00:41:06.580223 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.580174    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 18 00:41:06.588889 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.588866    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 18 00:41:06.589012 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.588946    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-c92dm"]
Jul 18 00:41:06.589147 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.589127    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nmq5l"
Jul 18 00:41:06.591742 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.591723    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9hbbz\""
Jul 18 00:41:06.591742 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.591743    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 18 00:41:06.591898 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.591786    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 18 00:41:06.601328 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.601308    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b6fc46484-nrvvm"]
Jul 18 00:41:06.601433 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.601337    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nmq5l"]
Jul 18 00:41:06.601433 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.601355    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c92dm"]
Jul 18 00:41:06.601541 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.601448    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c92dm"
Jul 18 00:41:06.604116 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.604085    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 18 00:41:06.604407 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.604388    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-txq7s\""
Jul 18 00:41:06.604496 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.604418    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 18 00:41:06.604496 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.604460    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 18 00:41:06.683874 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.683834    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-bound-sa-token\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.683874 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.683875    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c62e8a4-baf6-4539-a474-4c87460ddf70-ca-trust-extracted\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.684338 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.683894    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvg7b\" (UniqueName: \"kubernetes.io/projected/53da426e-0564-4c0a-bbda-6d0f37267192-kube-api-access-xvg7b\") pod \"dns-default-nmq5l\" (UID: \"53da426e-0564-4c0a-bbda-6d0f37267192\") " pod="openshift-dns/dns-default-nmq5l"
Jul 18 00:41:06.684338 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.683916    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62f3563e-fc37-4270-9d39-53090eec3241-cert\") pod \"ingress-canary-c92dm\" (UID: \"62f3563e-fc37-4270-9d39-53090eec3241\") " pod="openshift-ingress-canary/ingress-canary-c92dm"
Jul 18 00:41:06.684338 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.683941    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c62e8a4-baf6-4539-a474-4c87460ddf70-installation-pull-secrets\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.684338 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.684006    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c62e8a4-baf6-4539-a474-4c87460ddf70-image-registry-private-configuration\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.684338 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.684028    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-certificates\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.684338 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.684047    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tqqw\" (UniqueName: \"kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-kube-api-access-4tqqw\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.684338 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.684067    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53da426e-0564-4c0a-bbda-6d0f37267192-config-volume\") pod \"dns-default-nmq5l\" (UID: \"53da426e-0564-4c0a-bbda-6d0f37267192\") " pod="openshift-dns/dns-default-nmq5l"
Jul 18 00:41:06.684338 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.684096    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.684338 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.684115    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c62e8a4-baf6-4539-a474-4c87460ddf70-trusted-ca\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.684338 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.684135    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53da426e-0564-4c0a-bbda-6d0f37267192-metrics-tls\") pod \"dns-default-nmq5l\" (UID: \"53da426e-0564-4c0a-bbda-6d0f37267192\") " pod="openshift-dns/dns-default-nmq5l"
Jul 18 00:41:06.684338 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.684165    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53da426e-0564-4c0a-bbda-6d0f37267192-tmp-dir\") pod \"dns-default-nmq5l\" (UID: \"53da426e-0564-4c0a-bbda-6d0f37267192\") " pod="openshift-dns/dns-default-nmq5l"
Jul 18 00:41:06.684338 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.684271    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n82dd\" (UniqueName: \"kubernetes.io/projected/62f3563e-fc37-4270-9d39-53090eec3241-kube-api-access-n82dd\") pod \"ingress-canary-c92dm\" (UID: \"62f3563e-fc37-4270-9d39-53090eec3241\") " pod="openshift-ingress-canary/ingress-canary-c92dm"
Jul 18 00:41:06.784743 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.784706    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-bound-sa-token\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.784922 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.784753    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c62e8a4-baf6-4539-a474-4c87460ddf70-ca-trust-extracted\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.784922 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.784774    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvg7b\" (UniqueName: \"kubernetes.io/projected/53da426e-0564-4c0a-bbda-6d0f37267192-kube-api-access-xvg7b\") pod \"dns-default-nmq5l\" (UID: \"53da426e-0564-4c0a-bbda-6d0f37267192\") " pod="openshift-dns/dns-default-nmq5l"
Jul 18 00:41:06.784922 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.784793    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62f3563e-fc37-4270-9d39-53090eec3241-cert\") pod \"ingress-canary-c92dm\" (UID: \"62f3563e-fc37-4270-9d39-53090eec3241\") " pod="openshift-ingress-canary/ingress-canary-c92dm"
Jul 18 00:41:06.784922 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.784913    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c62e8a4-baf6-4539-a474-4c87460ddf70-installation-pull-secrets\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.785111 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.784995    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c62e8a4-baf6-4539-a474-4c87460ddf70-image-registry-private-configuration\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.785111 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.785028    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-certificates\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.785111 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.785056    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tqqw\" (UniqueName: \"kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-kube-api-access-4tqqw\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.785111 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.785078    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53da426e-0564-4c0a-bbda-6d0f37267192-config-volume\") pod \"dns-default-nmq5l\" (UID: \"53da426e-0564-4c0a-bbda-6d0f37267192\") " pod="openshift-dns/dns-default-nmq5l"
Jul 18 00:41:06.785111 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.785100    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.785390 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.785121    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c62e8a4-baf6-4539-a474-4c87460ddf70-trusted-ca\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.785390 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.785141    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53da426e-0564-4c0a-bbda-6d0f37267192-metrics-tls\") pod \"dns-default-nmq5l\" (UID: \"53da426e-0564-4c0a-bbda-6d0f37267192\") " pod="openshift-dns/dns-default-nmq5l"
Jul 18 00:41:06.785390 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.785160    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53da426e-0564-4c0a-bbda-6d0f37267192-tmp-dir\") pod \"dns-default-nmq5l\" (UID: \"53da426e-0564-4c0a-bbda-6d0f37267192\") " pod="openshift-dns/dns-default-nmq5l"
Jul 18 00:41:06.785390 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.785215    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n82dd\" (UniqueName: \"kubernetes.io/projected/62f3563e-fc37-4270-9d39-53090eec3241-kube-api-access-n82dd\") pod \"ingress-canary-c92dm\" (UID: \"62f3563e-fc37-4270-9d39-53090eec3241\") " pod="openshift-ingress-canary/ingress-canary-c92dm"
Jul 18 00:41:06.785390 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.785220    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c62e8a4-baf6-4539-a474-4c87460ddf70-ca-trust-extracted\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.785390 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:06.785374    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 00:41:06.785390 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:06.785391    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b6fc46484-nrvvm: secret "image-registry-tls" not found
Jul 18 00:41:06.785704 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:06.785448    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls podName:0c62e8a4-baf6-4539-a474-4c87460ddf70 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:07.285428142 +0000 UTC m=+35.074840191 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls") pod "image-registry-b6fc46484-nrvvm" (UID: "0c62e8a4-baf6-4539-a474-4c87460ddf70") : secret "image-registry-tls" not found
Jul 18 00:41:06.785805 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.785782    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-certificates\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.785899 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.785823    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53da426e-0564-4c0a-bbda-6d0f37267192-config-volume\") pod \"dns-default-nmq5l\" (UID: \"53da426e-0564-4c0a-bbda-6d0f37267192\") " pod="openshift-dns/dns-default-nmq5l"
Jul 18 00:41:06.785899 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.785860    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53da426e-0564-4c0a-bbda-6d0f37267192-tmp-dir\") pod \"dns-default-nmq5l\" (UID: \"53da426e-0564-4c0a-bbda-6d0f37267192\") " pod="openshift-dns/dns-default-nmq5l"
Jul 18 00:41:06.785982 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:06.785938    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 00:41:06.785982 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:06.785978    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53da426e-0564-4c0a-bbda-6d0f37267192-metrics-tls podName:53da426e-0564-4c0a-bbda-6d0f37267192 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:07.285964505 +0000 UTC m=+35.075376559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53da426e-0564-4c0a-bbda-6d0f37267192-metrics-tls") pod "dns-default-nmq5l" (UID: "53da426e-0564-4c0a-bbda-6d0f37267192") : secret "dns-default-metrics-tls" not found
Jul 18 00:41:06.786090 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.786070    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c62e8a4-baf6-4539-a474-4c87460ddf70-trusted-ca\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.789784 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.789755    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c62e8a4-baf6-4539-a474-4c87460ddf70-image-registry-private-configuration\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.789921 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.789765    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62f3563e-fc37-4270-9d39-53090eec3241-cert\") pod \"ingress-canary-c92dm\" (UID: \"62f3563e-fc37-4270-9d39-53090eec3241\") " pod="openshift-ingress-canary/ingress-canary-c92dm"
Jul 18 00:41:06.791562 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.791537    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c62e8a4-baf6-4539-a474-4c87460ddf70-installation-pull-secrets\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.795009 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.794674    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvg7b\" (UniqueName: \"kubernetes.io/projected/53da426e-0564-4c0a-bbda-6d0f37267192-kube-api-access-xvg7b\") pod \"dns-default-nmq5l\" (UID: \"53da426e-0564-4c0a-bbda-6d0f37267192\") " pod="openshift-dns/dns-default-nmq5l"
Jul 18 00:41:06.795009 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.794775    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-bound-sa-token\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.795213 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.795063    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n82dd\" (UniqueName: \"kubernetes.io/projected/62f3563e-fc37-4270-9d39-53090eec3241-kube-api-access-n82dd\") pod \"ingress-canary-c92dm\" (UID: \"62f3563e-fc37-4270-9d39-53090eec3241\") " pod="openshift-ingress-canary/ingress-canary-c92dm"
Jul 18 00:41:06.795275 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.795249    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tqqw\" (UniqueName: \"kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-kube-api-access-4tqqw\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:06.910587 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:06.910550    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c92dm"
Jul 18 00:41:07.195178 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:07.195095    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c92dm"]
Jul 18 00:41:07.290798 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:07.290759    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:07.290798 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:07.290792    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53da426e-0564-4c0a-bbda-6d0f37267192-metrics-tls\") pod \"dns-default-nmq5l\" (UID: \"53da426e-0564-4c0a-bbda-6d0f37267192\") " pod="openshift-dns/dns-default-nmq5l"
Jul 18 00:41:07.290987 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:07.290892    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 00:41:07.290987 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:07.290915    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 00:41:07.290987 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:07.290935    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b6fc46484-nrvvm: secret "image-registry-tls" not found
Jul 18 00:41:07.290987 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:07.290944    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53da426e-0564-4c0a-bbda-6d0f37267192-metrics-tls podName:53da426e-0564-4c0a-bbda-6d0f37267192 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:08.290931096 +0000 UTC m=+36.080343132 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53da426e-0564-4c0a-bbda-6d0f37267192-metrics-tls") pod "dns-default-nmq5l" (UID: "53da426e-0564-4c0a-bbda-6d0f37267192") : secret "dns-default-metrics-tls" not found
Jul 18 00:41:07.290987 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:07.290979    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls podName:0c62e8a4-baf6-4539-a474-4c87460ddf70 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:08.290963703 +0000 UTC m=+36.080375739 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls") pod "image-registry-b6fc46484-nrvvm" (UID: "0c62e8a4-baf6-4539-a474-4c87460ddf70") : secret "image-registry-tls" not found
Jul 18 00:41:07.672844 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:07.672674    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:41:07.672989 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:07.672676    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:41:07.673048 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:07.672676    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:41:07.675515 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:07.675495    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 18 00:41:07.675639 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:07.675496    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d2hq6\""
Jul 18 00:41:07.675639 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:07.675539    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 18 00:41:07.675639 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:07.675499    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 18 00:41:07.676443 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:07.676419    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-475p8\""
Jul 18 00:41:07.676443 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:07.676435    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 18 00:41:07.948986 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:07.948949    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c92dm" event={"ID":"62f3563e-fc37-4270-9d39-53090eec3241","Type":"ContainerStarted","Data":"e52e36aff3c4d20313f676ff514d2c8c9102440048fab05c49f1da13ac74900e"}
Jul 18 00:41:07.952200 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:07.952164    2575 generic.go:356] "Generic (PLEG): container finished" podID="13495ace-a3dd-4fc1-8035-0a2e54879d58" containerID="e3f1eca85f2b2ff53bab43da119ff8d41126ac91e2cf8e1c0df0b23c4d81fe3c" exitCode=0
Jul 18 00:41:07.952338 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:07.952235    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zh2l6" event={"ID":"13495ace-a3dd-4fc1-8035-0a2e54879d58","Type":"ContainerDied","Data":"e3f1eca85f2b2ff53bab43da119ff8d41126ac91e2cf8e1c0df0b23c4d81fe3c"}
Jul 18 00:41:08.299246 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:08.299151    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:08.299246 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:08.299226    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53da426e-0564-4c0a-bbda-6d0f37267192-metrics-tls\") pod \"dns-default-nmq5l\" (UID: \"53da426e-0564-4c0a-bbda-6d0f37267192\") " pod="openshift-dns/dns-default-nmq5l"
Jul 18 00:41:08.299469 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:08.299320    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 00:41:08.299469 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:08.299342    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b6fc46484-nrvvm: secret "image-registry-tls" not found
Jul 18 00:41:08.299469 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:08.299357    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 00:41:08.299469 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:08.299408    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls podName:0c62e8a4-baf6-4539-a474-4c87460ddf70 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:10.299386342 +0000 UTC m=+38.088798378 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls") pod "image-registry-b6fc46484-nrvvm" (UID: "0c62e8a4-baf6-4539-a474-4c87460ddf70") : secret "image-registry-tls" not found
Jul 18 00:41:08.299469 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:08.299425    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53da426e-0564-4c0a-bbda-6d0f37267192-metrics-tls podName:53da426e-0564-4c0a-bbda-6d0f37267192 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:10.299417189 +0000 UTC m=+38.088829225 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53da426e-0564-4c0a-bbda-6d0f37267192-metrics-tls") pod "dns-default-nmq5l" (UID: "53da426e-0564-4c0a-bbda-6d0f37267192") : secret "dns-default-metrics-tls" not found
Jul 18 00:41:08.958292 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:08.958252    2575 generic.go:356] "Generic (PLEG): container finished" podID="13495ace-a3dd-4fc1-8035-0a2e54879d58" containerID="8f5811317e25306e9d854365ee4780501cc3e32b94b401638b35b199b76f127e" exitCode=0
Jul 18 00:41:08.958803 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:08.958304    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zh2l6" event={"ID":"13495ace-a3dd-4fc1-8035-0a2e54879d58","Type":"ContainerDied","Data":"8f5811317e25306e9d854365ee4780501cc3e32b94b401638b35b199b76f127e"}
Jul 18 00:41:09.964214 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:09.964118    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zh2l6" event={"ID":"13495ace-a3dd-4fc1-8035-0a2e54879d58","Type":"ContainerStarted","Data":"f24bea9b62aeb7c9d7aa52f76d5e182cf393f51f5c7d2363e78d6a6a3ef60ff6"}
Jul 18 00:41:09.988171 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:09.988113    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zh2l6" podStartSLOduration=9.345650962 podStartE2EDuration="37.988095392s" totalImagesPullingTime="28.64244443s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:09.986987034 +0000 UTC m=+37.776399091" watchObservedRunningTime="2026-07-18 00:41:09.988095392 +0000 UTC m=+37.777507450"
Jul 18 00:41:10.315253 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:10.315129    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:10.315403 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:10.315285    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53da426e-0564-4c0a-bbda-6d0f37267192-metrics-tls\") pod \"dns-default-nmq5l\" (UID: \"53da426e-0564-4c0a-bbda-6d0f37267192\") " pod="openshift-dns/dns-default-nmq5l"
Jul 18 00:41:10.315403 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:10.315360    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 00:41:10.315403 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:10.315384    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b6fc46484-nrvvm: secret "image-registry-tls" not found
Jul 18 00:41:10.315522 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:10.315411    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 00:41:10.315522 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:10.315450    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls podName:0c62e8a4-baf6-4539-a474-4c87460ddf70 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:14.315431079 +0000 UTC m=+42.104843114 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls") pod "image-registry-b6fc46484-nrvvm" (UID: "0c62e8a4-baf6-4539-a474-4c87460ddf70") : secret "image-registry-tls" not found
Jul 18 00:41:10.315522 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:10.315469    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53da426e-0564-4c0a-bbda-6d0f37267192-metrics-tls podName:53da426e-0564-4c0a-bbda-6d0f37267192 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:14.315459834 +0000 UTC m=+42.104871877 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53da426e-0564-4c0a-bbda-6d0f37267192-metrics-tls") pod "dns-default-nmq5l" (UID: "53da426e-0564-4c0a-bbda-6d0f37267192") : secret "dns-default-metrics-tls" not found
Jul 18 00:41:10.967970 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:10.967769    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c92dm" event={"ID":"62f3563e-fc37-4270-9d39-53090eec3241","Type":"ContainerStarted","Data":"7d8b256451095f11fc41a66a803b471e579e34e971448c8d50e49c882d8cc59d"}
Jul 18 00:41:10.983730 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:10.983689    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-c92dm" podStartSLOduration=2.345304582 podStartE2EDuration="4.983675529s" totalImagesPullingTime="2.638370947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:10.983269408 +0000 UTC m=+38.772681465" watchObservedRunningTime="2026-07-18 00:41:10.983675529 +0000 UTC m=+38.773087586"
Jul 18 00:41:14.038701 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.038662    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jppsq"]
Jul 18 00:41:14.063267 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.063241    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jppsq"]
Jul 18 00:41:14.063444 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.063356    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jppsq"
Jul 18 00:41:14.065823 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.065801    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 18 00:41:14.065937 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.065842    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rtqnw\""
Jul 18 00:41:14.066808 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.066788    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 18 00:41:14.147375 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.147342    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz6lq\" (UniqueName: \"kubernetes.io/projected/96797281-81c7-459c-9ab4-b05b2d4980f7-kube-api-access-qz6lq\") pod \"migrator-7cc9c7ffd7-jppsq\" (UID: \"96797281-81c7-459c-9ab4-b05b2d4980f7\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jppsq"
Jul 18 00:41:14.248162 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.248124    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz6lq\" (UniqueName: \"kubernetes.io/projected/96797281-81c7-459c-9ab4-b05b2d4980f7-kube-api-access-qz6lq\") pod \"migrator-7cc9c7ffd7-jppsq\" (UID: \"96797281-81c7-459c-9ab4-b05b2d4980f7\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jppsq"
Jul 18 00:41:14.259664 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.259641    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz6lq\" (UniqueName: \"kubernetes.io/projected/96797281-81c7-459c-9ab4-b05b2d4980f7-kube-api-access-qz6lq\") pod \"migrator-7cc9c7ffd7-jppsq\" (UID: \"96797281-81c7-459c-9ab4-b05b2d4980f7\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jppsq"
Jul 18 00:41:14.349381 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.349295    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:14.349381 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.349333    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53da426e-0564-4c0a-bbda-6d0f37267192-metrics-tls\") pod \"dns-default-nmq5l\" (UID: \"53da426e-0564-4c0a-bbda-6d0f37267192\") " pod="openshift-dns/dns-default-nmq5l"
Jul 18 00:41:14.349602 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:14.349459    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 00:41:14.349602 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:14.349469    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 00:41:14.349602 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:14.349493    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b6fc46484-nrvvm: secret "image-registry-tls" not found
Jul 18 00:41:14.349602 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:14.349516    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53da426e-0564-4c0a-bbda-6d0f37267192-metrics-tls podName:53da426e-0564-4c0a-bbda-6d0f37267192 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:22.349499852 +0000 UTC m=+50.138911890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53da426e-0564-4c0a-bbda-6d0f37267192-metrics-tls") pod "dns-default-nmq5l" (UID: "53da426e-0564-4c0a-bbda-6d0f37267192") : secret "dns-default-metrics-tls" not found
Jul 18 00:41:14.349602 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:14.349547    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls podName:0c62e8a4-baf6-4539-a474-4c87460ddf70 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:22.349529822 +0000 UTC m=+50.138941875 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls") pod "image-registry-b6fc46484-nrvvm" (UID: "0c62e8a4-baf6-4539-a474-4c87460ddf70") : secret "image-registry-tls" not found
Jul 18 00:41:14.372848 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.372821    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jppsq"
Jul 18 00:41:14.521020 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.520992    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jppsq"]
Jul 18 00:41:14.525616 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:41:14.525590    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96797281_81c7_459c_9ab4_b05b2d4980f7.slice/crio-a1f8a1623c0313cb2bad037f6adfc91f4466d69b66f023817e7086ee3df70595 WatchSource:0}: Error finding container a1f8a1623c0313cb2bad037f6adfc91f4466d69b66f023817e7086ee3df70595: Status 404 returned error can't find the container with id a1f8a1623c0313cb2bad037f6adfc91f4466d69b66f023817e7086ee3df70595
Jul 18 00:41:14.570654 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.570629    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-f8w54"]
Jul 18 00:41:14.602910 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.602833    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f8w54"]
Jul 18 00:41:14.603046 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.602951    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:14.605684 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.605653    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 18 00:41:14.605684 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.605674    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 18 00:41:14.605858 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.605740    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 18 00:41:14.605858 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.605764    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w2tbv\""
Jul 18 00:41:14.605858 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.605775    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 18 00:41:14.752753 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.752717    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-data-volume\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:14.752753 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.752761    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m22pr\" (UniqueName: \"kubernetes.io/projected/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-kube-api-access-m22pr\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:14.753009 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.752797    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-crio-socket\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:14.753009 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.752815    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:14.753009 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.752919    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:14.854160 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.854073    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-data-volume\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:14.854160 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.854109    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m22pr\" (UniqueName: \"kubernetes.io/projected/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-kube-api-access-m22pr\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:14.854160 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.854146    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-crio-socket\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:14.854458 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.854166    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:14.854458 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.854230    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:14.854458 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:14.854308    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 00:41:14.854458 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.854363    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-crio-socket\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:14.854458 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:14.854377    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-insights-runtime-extractor-tls podName:c7854b84-8d2b-4dbf-b79c-f7213d24a1ab nodeName:}" failed. No retries permitted until 2026-07-18 00:41:15.354358573 +0000 UTC m=+43.143770607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f8w54" (UID: "c7854b84-8d2b-4dbf-b79c-f7213d24a1ab") : secret "insights-runtime-extractor-tls" not found
Jul 18 00:41:14.854458 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:14.854311    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 00:41:14.854458 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:14.854438    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-kube-rbac-proxy-cm podName:c7854b84-8d2b-4dbf-b79c-f7213d24a1ab nodeName:}" failed. No retries permitted until 2026-07-18 00:41:15.354425013 +0000 UTC m=+43.143837047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f8w54" (UID: "c7854b84-8d2b-4dbf-b79c-f7213d24a1ab") : configmap "kube-rbac-proxy" not found
Jul 18 00:41:14.854701 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.854480    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-data-volume\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:14.863170 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.863138    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m22pr\" (UniqueName: \"kubernetes.io/projected/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-kube-api-access-m22pr\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:14.977934 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:14.977900    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jppsq" event={"ID":"96797281-81c7-459c-9ab4-b05b2d4980f7","Type":"ContainerStarted","Data":"a1f8a1623c0313cb2bad037f6adfc91f4466d69b66f023817e7086ee3df70595"}
Jul 18 00:41:15.358862 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:15.358810    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:15.359338 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:15.358903    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:15.359338 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:15.358993    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 00:41:15.359338 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:15.359024    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 00:41:15.359338 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:15.359076    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-kube-rbac-proxy-cm podName:c7854b84-8d2b-4dbf-b79c-f7213d24a1ab nodeName:}" failed. No retries permitted until 2026-07-18 00:41:16.35905518 +0000 UTC m=+44.148467218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f8w54" (UID: "c7854b84-8d2b-4dbf-b79c-f7213d24a1ab") : configmap "kube-rbac-proxy" not found
Jul 18 00:41:15.359338 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:15.359106    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-insights-runtime-extractor-tls podName:c7854b84-8d2b-4dbf-b79c-f7213d24a1ab nodeName:}" failed. No retries permitted until 2026-07-18 00:41:16.359084334 +0000 UTC m=+44.148496391 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f8w54" (UID: "c7854b84-8d2b-4dbf-b79c-f7213d24a1ab") : secret "insights-runtime-extractor-tls" not found
Jul 18 00:41:16.368246 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:16.368221    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:16.368623 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:16.368343    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:16.368623 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:16.368369    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 00:41:16.368623 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:16.368446    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-kube-rbac-proxy-cm podName:c7854b84-8d2b-4dbf-b79c-f7213d24a1ab nodeName:}" failed. No retries permitted until 2026-07-18 00:41:18.368423394 +0000 UTC m=+46.157835431 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f8w54" (UID: "c7854b84-8d2b-4dbf-b79c-f7213d24a1ab") : configmap "kube-rbac-proxy" not found
Jul 18 00:41:16.368623 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:16.368507    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 00:41:16.368623 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:16.368561    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-insights-runtime-extractor-tls podName:c7854b84-8d2b-4dbf-b79c-f7213d24a1ab nodeName:}" failed. No retries permitted until 2026-07-18 00:41:18.36854408 +0000 UTC m=+46.157956136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f8w54" (UID: "c7854b84-8d2b-4dbf-b79c-f7213d24a1ab") : secret "insights-runtime-extractor-tls" not found
Jul 18 00:41:16.961834 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:16.961800    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5ktrw_ac8eced4-49d8-49d7-b990-7293cb285952/dns-node-resolver/0.log"
Jul 18 00:41:16.983360 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:16.983326    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jppsq" event={"ID":"96797281-81c7-459c-9ab4-b05b2d4980f7","Type":"ContainerStarted","Data":"f3be83fba5f84c5af2e70a1fbaf0a6b924c5dc941c44f5b53aabad7b86e1e0aa"}
Jul 18 00:41:16.983473 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:16.983383    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jppsq" event={"ID":"96797281-81c7-459c-9ab4-b05b2d4980f7","Type":"ContainerStarted","Data":"cfda365cf3c1a719f1f8c594ffdc4d38a87681272fa2e7c5684be2e0b4a6acef"}
Jul 18 00:41:16.997827 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:16.997782    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jppsq" podStartSLOduration=1.312158715 podStartE2EDuration="2.99776656s" totalImagesPullingTime="1.685607845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:16.997741232 +0000 UTC m=+44.787153289" watchObservedRunningTime="2026-07-18 00:41:16.99776656 +0000 UTC m=+44.787178617"
Jul 18 00:41:18.162628 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:18.162600    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lqwmf_c5317943-47c6-46a6-865a-e062f6ed279b/node-ca/0.log"
Jul 18 00:41:18.383535 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:18.383502    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:18.383690 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:18.383558    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:18.383690 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:18.383665    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 00:41:18.383690 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:18.383677    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 00:41:18.383788 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:18.383727    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-insights-runtime-extractor-tls podName:c7854b84-8d2b-4dbf-b79c-f7213d24a1ab nodeName:}" failed. No retries permitted until 2026-07-18 00:41:22.383710935 +0000 UTC m=+50.173122969 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f8w54" (UID: "c7854b84-8d2b-4dbf-b79c-f7213d24a1ab") : secret "insights-runtime-extractor-tls" not found
Jul 18 00:41:18.383788 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:18.383742    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-kube-rbac-proxy-cm podName:c7854b84-8d2b-4dbf-b79c-f7213d24a1ab nodeName:}" failed. No retries permitted until 2026-07-18 00:41:22.383735762 +0000 UTC m=+50.173147796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f8w54" (UID: "c7854b84-8d2b-4dbf-b79c-f7213d24a1ab") : configmap "kube-rbac-proxy" not found
Jul 18 00:41:18.762423 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:18.762398    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c92dm_62f3563e-fc37-4270-9d39-53090eec3241/serve-healthcheck-canary/0.log"
Jul 18 00:41:18.962834 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:18.962808    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-jppsq_96797281-81c7-459c-9ab4-b05b2d4980f7/migrator/0.log"
Jul 18 00:41:19.162954 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:19.162933    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-jppsq_96797281-81c7-459c-9ab4-b05b2d4980f7/graceful-termination/0.log"
Jul 18 00:41:22.414249 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:22.414211    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:22.414249 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:22.414253    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53da426e-0564-4c0a-bbda-6d0f37267192-metrics-tls\") pod \"dns-default-nmq5l\" (UID: \"53da426e-0564-4c0a-bbda-6d0f37267192\") " pod="openshift-dns/dns-default-nmq5l"
Jul 18 00:41:22.414670 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:22.414345    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 00:41:22.414670 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:22.414355    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 00:41:22.414670 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:22.414375    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b6fc46484-nrvvm: secret "image-registry-tls" not found
Jul 18 00:41:22.414670 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:22.414408    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53da426e-0564-4c0a-bbda-6d0f37267192-metrics-tls podName:53da426e-0564-4c0a-bbda-6d0f37267192 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:38.414392293 +0000 UTC m=+66.203804330 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53da426e-0564-4c0a-bbda-6d0f37267192-metrics-tls") pod "dns-default-nmq5l" (UID: "53da426e-0564-4c0a-bbda-6d0f37267192") : secret "dns-default-metrics-tls" not found
Jul 18 00:41:22.414670 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:22.414425    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls podName:0c62e8a4-baf6-4539-a474-4c87460ddf70 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:38.414414039 +0000 UTC m=+66.203826074 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls") pod "image-registry-b6fc46484-nrvvm" (UID: "0c62e8a4-baf6-4539-a474-4c87460ddf70") : secret "image-registry-tls" not found
Jul 18 00:41:22.414670 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:22.414442    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:22.414670 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:22.414493    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:22.414670 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:22.414555    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 00:41:22.414670 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:22.414589    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-kube-rbac-proxy-cm podName:c7854b84-8d2b-4dbf-b79c-f7213d24a1ab nodeName:}" failed. No retries permitted until 2026-07-18 00:41:30.414577904 +0000 UTC m=+58.203989939 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f8w54" (UID: "c7854b84-8d2b-4dbf-b79c-f7213d24a1ab") : configmap "kube-rbac-proxy" not found
Jul 18 00:41:22.414670 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:22.414590    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 00:41:22.414670 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:22.414635    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-insights-runtime-extractor-tls podName:c7854b84-8d2b-4dbf-b79c-f7213d24a1ab nodeName:}" failed. No retries permitted until 2026-07-18 00:41:30.414621429 +0000 UTC m=+58.204033464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f8w54" (UID: "c7854b84-8d2b-4dbf-b79c-f7213d24a1ab") : secret "insights-runtime-extractor-tls" not found
Jul 18 00:41:30.483679 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:30.483642    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:30.484141 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:30.483751    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:30.484141 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:30.483874    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 00:41:30.484141 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:41:30.483955    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-insights-runtime-extractor-tls podName:c7854b84-8d2b-4dbf-b79c-f7213d24a1ab nodeName:}" failed. No retries permitted until 2026-07-18 00:41:46.483935815 +0000 UTC m=+74.273347851 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f8w54" (UID: "c7854b84-8d2b-4dbf-b79c-f7213d24a1ab") : secret "insights-runtime-extractor-tls" not found
Jul 18 00:41:30.484320 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:30.484298    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:33.950575 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:33.950548    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tjb92"
Jul 18 00:41:38.443774 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.443735    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:38.443774 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.443775    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53da426e-0564-4c0a-bbda-6d0f37267192-metrics-tls\") pod \"dns-default-nmq5l\" (UID: \"53da426e-0564-4c0a-bbda-6d0f37267192\") " pod="openshift-dns/dns-default-nmq5l"
Jul 18 00:41:38.444317 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.443802    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret\") pod \"global-pull-secret-syncer-zghtc\" (UID: \"a209204d-2b7f-40e7-9ccb-e79a97531adf\") " pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:41:38.444317 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.443870    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs\") pod \"network-metrics-daemon-nxj6q\" (UID: \"12acb4ef-54f7-4c47-884b-aa81ed6d7eb0\") " pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:41:38.446294 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.446251    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53da426e-0564-4c0a-bbda-6d0f37267192-metrics-tls\") pod \"dns-default-nmq5l\" (UID: \"53da426e-0564-4c0a-bbda-6d0f37267192\") " pod="openshift-dns/dns-default-nmq5l"
Jul 18 00:41:38.446469 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.446305    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls\") pod \"image-registry-b6fc46484-nrvvm\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") " pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:38.446589 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.446562    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 18 00:41:38.447652 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.447616    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 18 00:41:38.456655 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.456633    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a209204d-2b7f-40e7-9ccb-e79a97531adf-original-pull-secret\") pod \"global-pull-secret-syncer-zghtc\" (UID: \"a209204d-2b7f-40e7-9ccb-e79a97531adf\") " pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:41:38.456740 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.456698    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12acb4ef-54f7-4c47-884b-aa81ed6d7eb0-metrics-certs\") pod \"network-metrics-daemon-nxj6q\" (UID: \"12acb4ef-54f7-4c47-884b-aa81ed6d7eb0\") " pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:41:38.544640 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.544600    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqfvl\" (UniqueName: \"kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl\") pod \"network-check-target-kmtff\" (UID: \"909b5e56-fd38-4d1d-8123-be740dd195b0\") " pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:41:38.547225 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.547207    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 18 00:41:38.557679 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.557658    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 18 00:41:38.568109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.568088    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqfvl\" (UniqueName: \"kubernetes.io/projected/909b5e56-fd38-4d1d-8123-be740dd195b0-kube-api-access-jqfvl\") pod \"network-check-target-kmtff\" (UID: \"909b5e56-fd38-4d1d-8123-be740dd195b0\") " pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:41:38.581870 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.581850    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zghtc"
Jul 18 00:41:38.592627 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.592609    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d2hq6\""
Jul 18 00:41:38.594725 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.594713    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-475p8\""
Jul 18 00:41:38.598760 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.598749    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxj6q"
Jul 18 00:41:38.602932 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.602921    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:41:38.694068 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.694005    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h4ffv\""
Jul 18 00:41:38.702040 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.702013    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:38.702224 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.702208    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9hbbz\""
Jul 18 00:41:38.710547 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.710396    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nmq5l"
Jul 18 00:41:38.743122 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.743085    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zghtc"]
Jul 18 00:41:38.767008 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.766982    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nxj6q"]
Jul 18 00:41:38.775933 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:41:38.775901    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12acb4ef_54f7_4c47_884b_aa81ed6d7eb0.slice/crio-50d0248691f5fb59812f213609a7afa622bf8f27e6f22224ef2331b2589e333d WatchSource:0}: Error finding container 50d0248691f5fb59812f213609a7afa622bf8f27e6f22224ef2331b2589e333d: Status 404 returned error can't find the container with id 50d0248691f5fb59812f213609a7afa622bf8f27e6f22224ef2331b2589e333d
Jul 18 00:41:38.804321 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.804288    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kmtff"]
Jul 18 00:41:38.811982 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:41:38.811951    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod909b5e56_fd38_4d1d_8123_be740dd195b0.slice/crio-3beccdb9510206a2610065fd5e097950d51d7a9ab1af156223a745b4cfcb459c WatchSource:0}: Error finding container 3beccdb9510206a2610065fd5e097950d51d7a9ab1af156223a745b4cfcb459c: Status 404 returned error can't find the container with id 3beccdb9510206a2610065fd5e097950d51d7a9ab1af156223a745b4cfcb459c
Jul 18 00:41:38.867149 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.866996    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b6fc46484-nrvvm"]
Jul 18 00:41:38.869386 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:41:38.869359    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c62e8a4_baf6_4539_a474_4c87460ddf70.slice/crio-2151503648f5f4b10f1219f5739e436522955735e78a3753855c543f5a6d8a35 WatchSource:0}: Error finding container 2151503648f5f4b10f1219f5739e436522955735e78a3753855c543f5a6d8a35: Status 404 returned error can't find the container with id 2151503648f5f4b10f1219f5739e436522955735e78a3753855c543f5a6d8a35
Jul 18 00:41:38.880307 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:38.880284    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nmq5l"]
Jul 18 00:41:38.883176 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:41:38.883155    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53da426e_0564_4c0a_bbda_6d0f37267192.slice/crio-fb2f70d8d175090cf751b115ff3b9b7488c721074cefb3fc850efd5a503bc84f WatchSource:0}: Error finding container fb2f70d8d175090cf751b115ff3b9b7488c721074cefb3fc850efd5a503bc84f: Status 404 returned error can't find the container with id fb2f70d8d175090cf751b115ff3b9b7488c721074cefb3fc850efd5a503bc84f
Jul 18 00:41:39.044733 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:39.044702    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nmq5l" event={"ID":"53da426e-0564-4c0a-bbda-6d0f37267192","Type":"ContainerStarted","Data":"fb2f70d8d175090cf751b115ff3b9b7488c721074cefb3fc850efd5a503bc84f"}
Jul 18 00:41:39.045782 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:39.045755    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nxj6q" event={"ID":"12acb4ef-54f7-4c47-884b-aa81ed6d7eb0","Type":"ContainerStarted","Data":"50d0248691f5fb59812f213609a7afa622bf8f27e6f22224ef2331b2589e333d"}
Jul 18 00:41:39.046849 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:39.046829    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zghtc" event={"ID":"a209204d-2b7f-40e7-9ccb-e79a97531adf","Type":"ContainerStarted","Data":"fdede894d96ed2b488565971b5f5581c21e6c37f0d2427efd709ac8baac8f2f5"}
Jul 18 00:41:39.048254 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:39.048233    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b6fc46484-nrvvm" event={"ID":"0c62e8a4-baf6-4539-a474-4c87460ddf70","Type":"ContainerStarted","Data":"bec95c4673cd9c946bdd7145b146e4d6836eb299ffd9702f78f330901c794c63"}
Jul 18 00:41:39.048352 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:39.048269    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b6fc46484-nrvvm" event={"ID":"0c62e8a4-baf6-4539-a474-4c87460ddf70","Type":"ContainerStarted","Data":"2151503648f5f4b10f1219f5739e436522955735e78a3753855c543f5a6d8a35"}
Jul 18 00:41:39.048352 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:39.048321    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:41:39.049329 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:39.049307    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kmtff" event={"ID":"909b5e56-fd38-4d1d-8123-be740dd195b0","Type":"ContainerStarted","Data":"3beccdb9510206a2610065fd5e097950d51d7a9ab1af156223a745b4cfcb459c"}
Jul 18 00:41:39.066971 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:39.066933    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b6fc46484-nrvvm" podStartSLOduration=75.066920749 podStartE2EDuration="1m15.066920749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:40:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:39.065927365 +0000 UTC m=+66.855339422" watchObservedRunningTime="2026-07-18 00:41:39.066920749 +0000 UTC m=+66.856332831"
Jul 18 00:41:39.440807 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:39.440725    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b6fc46484-nrvvm"]
Jul 18 00:41:42.065173 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:42.065137    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nmq5l" event={"ID":"53da426e-0564-4c0a-bbda-6d0f37267192","Type":"ContainerStarted","Data":"6cdf5070b0166c0c73be8a97328ae2e641c493229c3a17b493123dcfb9a18185"}
Jul 18 00:41:42.065621 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:42.065225    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nmq5l" event={"ID":"53da426e-0564-4c0a-bbda-6d0f37267192","Type":"ContainerStarted","Data":"b8c329c0bdfe9d427443a93f5aef407edbde327f6e7e06efa07deaad41060a41"}
Jul 18 00:41:42.065621 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:42.065257    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nmq5l"
Jul 18 00:41:42.067214 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:42.067174    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nxj6q" event={"ID":"12acb4ef-54f7-4c47-884b-aa81ed6d7eb0","Type":"ContainerStarted","Data":"0b51a88a2a6d6aeefb3690a69436bdea90b160dee92d975f22e75dd6ebc7dd35"}
Jul 18 00:41:42.067330 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:42.067242    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nxj6q" event={"ID":"12acb4ef-54f7-4c47-884b-aa81ed6d7eb0","Type":"ContainerStarted","Data":"798001e3f7380473a700c1f7b59aa20a47563d8e880153c361313822edf47baa"}
Jul 18 00:41:42.081975 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:42.081920    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nmq5l" podStartSLOduration=33.812195188 podStartE2EDuration="36.081901794s" totalImagesPullingTime="2.269706606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:42.081588267 +0000 UTC m=+69.871000326" watchObservedRunningTime="2026-07-18 00:41:42.081901794 +0000 UTC m=+69.871313850"
Jul 18 00:41:42.098765 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:42.098689    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nxj6q" podStartSLOduration=67.747648792 podStartE2EDuration="1m10.098669217s" totalImagesPullingTime="2.351020425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:42.097994675 +0000 UTC m=+69.887406732" watchObservedRunningTime="2026-07-18 00:41:42.098669217 +0000 UTC m=+69.888081275"
Jul 18 00:41:44.075712 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:44.075621    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zghtc" event={"ID":"a209204d-2b7f-40e7-9ccb-e79a97531adf","Type":"ContainerStarted","Data":"369061a7e5efa8508bb3fadb64fa7f7fd43345e4ed1ef1d1ae8487eaba696445"}
Jul 18 00:41:44.077104 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:44.077084    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kmtff" event={"ID":"909b5e56-fd38-4d1d-8123-be740dd195b0","Type":"ContainerStarted","Data":"c327ef122e4e9e3b6889a00266f0a97b840027ce839df3494f2c683186a5bd36"}
Jul 18 00:41:44.077211 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:44.077132    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:41:44.089077 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:44.089041    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zghtc" podStartSLOduration=66.04114589 podStartE2EDuration="1m11.089028296s" totalImagesPullingTime="5.047882406s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:44.088652556 +0000 UTC m=+71.878064614" watchObservedRunningTime="2026-07-18 00:41:44.089028296 +0000 UTC m=+71.878440353"
Jul 18 00:41:44.103298 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:44.103259    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kmtff" podStartSLOduration=67.12148978 podStartE2EDuration="1m12.103245866s" totalImagesPullingTime="4.981756086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:44.102171592 +0000 UTC m=+71.891583648" watchObservedRunningTime="2026-07-18 00:41:44.103245866 +0000 UTC m=+71.892657951"
Jul 18 00:41:46.503977 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:46.503939    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:46.506313 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:46.506296    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7854b84-8d2b-4dbf-b79c-f7213d24a1ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8w54\" (UID: \"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab\") " pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:46.714604 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:46.714573    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w2tbv\""
Jul 18 00:41:46.722896 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:46.722876    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f8w54"
Jul 18 00:41:46.874778 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:46.874618    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f8w54"]
Jul 18 00:41:46.877295 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:41:46.877266    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7854b84_8d2b_4dbf_b79c_f7213d24a1ab.slice/crio-49fe1450fc66905e456476b1dbd1a68f97d8fb22f670ffabdbcedb0bf78bd46b WatchSource:0}: Error finding container 49fe1450fc66905e456476b1dbd1a68f97d8fb22f670ffabdbcedb0bf78bd46b: Status 404 returned error can't find the container with id 49fe1450fc66905e456476b1dbd1a68f97d8fb22f670ffabdbcedb0bf78bd46b
Jul 18 00:41:47.087725 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:47.087644    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f8w54" event={"ID":"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab","Type":"ContainerStarted","Data":"49fe1450fc66905e456476b1dbd1a68f97d8fb22f670ffabdbcedb0bf78bd46b"}
Jul 18 00:41:52.073405 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:52.073321    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nmq5l"
Jul 18 00:41:52.112032 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:52.111983    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f8w54" event={"ID":"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab","Type":"ContainerStarted","Data":"110ca5c85340f55e0285b35816f78f7f8c52a2739142945d198eeb11a683e44e"}
Jul 18 00:41:55.123561 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:55.123529    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f8w54" event={"ID":"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab","Type":"ContainerStarted","Data":"d94257f964b05e8e6c63d24d17027cc9d081b837675a74157555c55f95156e1a"}
Jul 18 00:41:59.138060 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:59.138027    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f8w54" event={"ID":"c7854b84-8d2b-4dbf-b79c-f7213d24a1ab","Type":"ContainerStarted","Data":"68c9837c03f77c8c374bb501ca8d14af49d4f2b9692212caf4cbd126e34bb52b"}
Jul 18 00:41:59.159774 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:59.159721    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-f8w54" podStartSLOduration=33.664440556 podStartE2EDuration="45.15970712s" totalImagesPullingTime="11.495266564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:41:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:59.158201555 +0000 UTC m=+86.947613606" watchObservedRunningTime="2026-07-18 00:41:59.15970712 +0000 UTC m=+86.949119177"
Jul 18 00:41:59.607729 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:59.607651    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-52zxk"]
Jul 18 00:41:59.610479 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:59.610462    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-52zxk"
Jul 18 00:41:59.612978 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:59.612957    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 18 00:41:59.613121 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:59.613105    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-f6nj8\""
Jul 18 00:41:59.613174 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:59.613150    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 18 00:41:59.620856 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:59.620835    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-52zxk"]
Jul 18 00:41:59.704931 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:59.704896    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfgfv\" (UniqueName: \"kubernetes.io/projected/61a01215-46f4-4d8d-96e4-21a5f53b4e8e-kube-api-access-cfgfv\") pod \"downloads-5bc67dcd46-52zxk\" (UID: \"61a01215-46f4-4d8d-96e4-21a5f53b4e8e\") " pod="openshift-console/downloads-5bc67dcd46-52zxk"
Jul 18 00:41:59.805892 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:59.805861    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfgfv\" (UniqueName: \"kubernetes.io/projected/61a01215-46f4-4d8d-96e4-21a5f53b4e8e-kube-api-access-cfgfv\") pod \"downloads-5bc67dcd46-52zxk\" (UID: \"61a01215-46f4-4d8d-96e4-21a5f53b4e8e\") " pod="openshift-console/downloads-5bc67dcd46-52zxk"
Jul 18 00:41:59.814356 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:59.814330    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfgfv\" (UniqueName: \"kubernetes.io/projected/61a01215-46f4-4d8d-96e4-21a5f53b4e8e-kube-api-access-cfgfv\") pod \"downloads-5bc67dcd46-52zxk\" (UID: \"61a01215-46f4-4d8d-96e4-21a5f53b4e8e\") " pod="openshift-console/downloads-5bc67dcd46-52zxk"
Jul 18 00:41:59.919409 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:41:59.919378    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-52zxk"
Jul 18 00:42:00.058363 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:00.058143    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-52zxk"]
Jul 18 00:42:00.060994 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:42:00.060952    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61a01215_46f4_4d8d_96e4_21a5f53b4e8e.slice/crio-e3da1a2af896272e023589cc2ab8e26b255ab8b83a73f8dff14ca87a6d7bf512 WatchSource:0}: Error finding container e3da1a2af896272e023589cc2ab8e26b255ab8b83a73f8dff14ca87a6d7bf512: Status 404 returned error can't find the container with id e3da1a2af896272e023589cc2ab8e26b255ab8b83a73f8dff14ca87a6d7bf512
Jul 18 00:42:00.142368 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:00.142335    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-52zxk" event={"ID":"61a01215-46f4-4d8d-96e4-21a5f53b4e8e","Type":"ContainerStarted","Data":"e3da1a2af896272e023589cc2ab8e26b255ab8b83a73f8dff14ca87a6d7bf512"}
Jul 18 00:42:01.064703 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:01.064673    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:42:06.091981 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.091937    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b6fc46484-nrvvm" podUID="0c62e8a4-baf6-4539-a474-4c87460ddf70" containerName="registry" containerID="cri-o://bec95c4673cd9c946bdd7145b146e4d6836eb299ffd9702f78f330901c794c63" gracePeriod=30
Jul 18 00:42:06.340140 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.340115    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:42:06.456045 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.456005    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tqqw\" (UniqueName: \"kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-kube-api-access-4tqqw\") pod \"0c62e8a4-baf6-4539-a474-4c87460ddf70\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") "
Jul 18 00:42:06.456045 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.456054    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c62e8a4-baf6-4539-a474-4c87460ddf70-trusted-ca\") pod \"0c62e8a4-baf6-4539-a474-4c87460ddf70\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") "
Jul 18 00:42:06.456293 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.456082    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-bound-sa-token\") pod \"0c62e8a4-baf6-4539-a474-4c87460ddf70\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") "
Jul 18 00:42:06.456293 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.456106    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c62e8a4-baf6-4539-a474-4c87460ddf70-image-registry-private-configuration\") pod \"0c62e8a4-baf6-4539-a474-4c87460ddf70\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") "
Jul 18 00:42:06.456293 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.456204    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c62e8a4-baf6-4539-a474-4c87460ddf70-ca-trust-extracted\") pod \"0c62e8a4-baf6-4539-a474-4c87460ddf70\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") "
Jul 18 00:42:06.456458 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.456391    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c62e8a4-baf6-4539-a474-4c87460ddf70-installation-pull-secrets\") pod \"0c62e8a4-baf6-4539-a474-4c87460ddf70\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") "
Jul 18 00:42:06.456510 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.456455    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls\") pod \"0c62e8a4-baf6-4539-a474-4c87460ddf70\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") "
Jul 18 00:42:06.456510 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.456487    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-certificates\") pod \"0c62e8a4-baf6-4539-a474-4c87460ddf70\" (UID: \"0c62e8a4-baf6-4539-a474-4c87460ddf70\") "
Jul 18 00:42:06.456682 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.456655    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c62e8a4-baf6-4539-a474-4c87460ddf70-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0c62e8a4-baf6-4539-a474-4c87460ddf70" (UID: "0c62e8a4-baf6-4539-a474-4c87460ddf70"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 00:42:06.456996 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.456976    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0c62e8a4-baf6-4539-a474-4c87460ddf70" (UID: "0c62e8a4-baf6-4539-a474-4c87460ddf70"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 00:42:06.459354 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.459298    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-kube-api-access-4tqqw" (OuterVolumeSpecName: "kube-api-access-4tqqw") pod "0c62e8a4-baf6-4539-a474-4c87460ddf70" (UID: "0c62e8a4-baf6-4539-a474-4c87460ddf70"). InnerVolumeSpecName "kube-api-access-4tqqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 00:42:06.459733 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.459709    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0c62e8a4-baf6-4539-a474-4c87460ddf70" (UID: "0c62e8a4-baf6-4539-a474-4c87460ddf70"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 00:42:06.459889 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.459848    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0c62e8a4-baf6-4539-a474-4c87460ddf70" (UID: "0c62e8a4-baf6-4539-a474-4c87460ddf70"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 00:42:06.460002 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.459941    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c62e8a4-baf6-4539-a474-4c87460ddf70-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0c62e8a4-baf6-4539-a474-4c87460ddf70" (UID: "0c62e8a4-baf6-4539-a474-4c87460ddf70"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:42:06.460799 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.460775    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c62e8a4-baf6-4539-a474-4c87460ddf70-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0c62e8a4-baf6-4539-a474-4c87460ddf70" (UID: "0c62e8a4-baf6-4539-a474-4c87460ddf70"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:42:06.467695 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.467667    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c62e8a4-baf6-4539-a474-4c87460ddf70-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0c62e8a4-baf6-4539-a474-4c87460ddf70" (UID: "0c62e8a4-baf6-4539-a474-4c87460ddf70"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 00:42:06.557533 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.557503    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c62e8a4-baf6-4539-a474-4c87460ddf70-ca-trust-extracted\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:42:06.557533 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.557531    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c62e8a4-baf6-4539-a474-4c87460ddf70-installation-pull-secrets\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:42:06.557771 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.557549    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-tls\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:42:06.557771 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.557559    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c62e8a4-baf6-4539-a474-4c87460ddf70-registry-certificates\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:42:06.557771 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.557568    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tqqw\" (UniqueName: \"kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-kube-api-access-4tqqw\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:42:06.557771 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.557575    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c62e8a4-baf6-4539-a474-4c87460ddf70-trusted-ca\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:42:06.557771 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.557583    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c62e8a4-baf6-4539-a474-4c87460ddf70-bound-sa-token\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:42:06.557771 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:06.557592    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c62e8a4-baf6-4539-a474-4c87460ddf70-image-registry-private-configuration\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:42:07.169847 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:07.169811    2575 generic.go:356] "Generic (PLEG): container finished" podID="0c62e8a4-baf6-4539-a474-4c87460ddf70" containerID="bec95c4673cd9c946bdd7145b146e4d6836eb299ffd9702f78f330901c794c63" exitCode=0
Jul 18 00:42:07.170320 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:07.169870    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b6fc46484-nrvvm"
Jul 18 00:42:07.170320 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:07.169894    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b6fc46484-nrvvm" event={"ID":"0c62e8a4-baf6-4539-a474-4c87460ddf70","Type":"ContainerDied","Data":"bec95c4673cd9c946bdd7145b146e4d6836eb299ffd9702f78f330901c794c63"}
Jul 18 00:42:07.170320 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:07.169946    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b6fc46484-nrvvm" event={"ID":"0c62e8a4-baf6-4539-a474-4c87460ddf70","Type":"ContainerDied","Data":"2151503648f5f4b10f1219f5739e436522955735e78a3753855c543f5a6d8a35"}
Jul 18 00:42:07.170320 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:07.169975    2575 scope.go:117] "RemoveContainer" containerID="bec95c4673cd9c946bdd7145b146e4d6836eb299ffd9702f78f330901c794c63"
Jul 18 00:42:07.179258 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:07.179234    2575 scope.go:117] "RemoveContainer" containerID="bec95c4673cd9c946bdd7145b146e4d6836eb299ffd9702f78f330901c794c63"
Jul 18 00:42:07.179580 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:42:07.179547    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bec95c4673cd9c946bdd7145b146e4d6836eb299ffd9702f78f330901c794c63\": container with ID starting with bec95c4673cd9c946bdd7145b146e4d6836eb299ffd9702f78f330901c794c63 not found: ID does not exist" containerID="bec95c4673cd9c946bdd7145b146e4d6836eb299ffd9702f78f330901c794c63"
Jul 18 00:42:07.179669 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:07.179585    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bec95c4673cd9c946bdd7145b146e4d6836eb299ffd9702f78f330901c794c63"} err="failed to get container status \"bec95c4673cd9c946bdd7145b146e4d6836eb299ffd9702f78f330901c794c63\": rpc error: code = NotFound desc = could not find container \"bec95c4673cd9c946bdd7145b146e4d6836eb299ffd9702f78f330901c794c63\": container with ID starting with bec95c4673cd9c946bdd7145b146e4d6836eb299ffd9702f78f330901c794c63 not found: ID does not exist"
Jul 18 00:42:07.187171 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:07.187147    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b6fc46484-nrvvm"]
Jul 18 00:42:07.192682 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:07.192646    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b6fc46484-nrvvm"]
Jul 18 00:42:08.679569 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:08.679534    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c62e8a4-baf6-4539-a474-4c87460ddf70" path="/var/lib/kubelet/pods/0c62e8a4-baf6-4539-a474-4c87460ddf70/volumes"
Jul 18 00:42:12.034824 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.034785    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-ml7pc"]
Jul 18 00:42:12.035247 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.035096    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c62e8a4-baf6-4539-a474-4c87460ddf70" containerName="registry"
Jul 18 00:42:12.035247 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.035110    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c62e8a4-baf6-4539-a474-4c87460ddf70" containerName="registry"
Jul 18 00:42:12.035247 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.035160    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c62e8a4-baf6-4539-a474-4c87460ddf70" containerName="registry"
Jul 18 00:42:12.039493 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.039471    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ml7pc"
Jul 18 00:42:12.042730 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.042500    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 18 00:42:12.042730 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.042542    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 18 00:42:12.043664 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.043643    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 18 00:42:12.043765 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.043692    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 18 00:42:12.043935 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.043915    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 18 00:42:12.044042 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.043951    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-mnq4q\""
Jul 18 00:42:12.046609 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.046592    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-ml7pc"]
Jul 18 00:42:12.054350 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.054326    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5bb22"]
Jul 18 00:42:12.057424 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.057402    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-hb2m2"]
Jul 18 00:42:12.057562 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.057541    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.060816 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.060571    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2"
Jul 18 00:42:12.060816 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.060589    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 18 00:42:12.060816 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.060637    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hlh57\""
Jul 18 00:42:12.060816 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.060745    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 18 00:42:12.061128 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.061102    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 18 00:42:12.063844 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.063639    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 18 00:42:12.063844 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.063735    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-m2jwt\""
Jul 18 00:42:12.063844 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.063783    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 18 00:42:12.064036 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.064001    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 18 00:42:12.078408 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.078386    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-hb2m2"]
Jul 18 00:42:12.197013 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.196977    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-node-exporter-textfile\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.197219 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.197024    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q65n9\" (UniqueName: \"kubernetes.io/projected/8ba9a1c4-2b55-469d-b739-886d9af055b7-kube-api-access-q65n9\") pod \"openshift-state-metrics-79f6958cdf-ml7pc\" (UID: \"8ba9a1c4-2b55-469d-b739-886d9af055b7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ml7pc"
Jul 18 00:42:12.197219 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.197063    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-node-exporter-wtmp\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.197219 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.197098    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ac13500-567a-4f83-b31c-c0a9b7ba674d-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-hb2m2\" (UID: \"9ac13500-567a-4f83-b31c-c0a9b7ba674d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2"
Jul 18 00:42:12.197219 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.197125    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chrnq\" (UniqueName: \"kubernetes.io/projected/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-kube-api-access-chrnq\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.197219 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.197153    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-sys\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.197219 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.197207    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghzlf\" (UniqueName: \"kubernetes.io/projected/9ac13500-567a-4f83-b31c-c0a9b7ba674d-kube-api-access-ghzlf\") pod \"kube-state-metrics-56c5594674-hb2m2\" (UID: \"9ac13500-567a-4f83-b31c-c0a9b7ba674d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2"
Jul 18 00:42:12.197514 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.197244    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ac13500-567a-4f83-b31c-c0a9b7ba674d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-hb2m2\" (UID: \"9ac13500-567a-4f83-b31c-c0a9b7ba674d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2"
Jul 18 00:42:12.197514 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.197265    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ba9a1c4-2b55-469d-b739-886d9af055b7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-ml7pc\" (UID: \"8ba9a1c4-2b55-469d-b739-886d9af055b7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ml7pc"
Jul 18 00:42:12.197514 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.197291    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ba9a1c4-2b55-469d-b739-886d9af055b7-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-ml7pc\" (UID: \"8ba9a1c4-2b55-469d-b739-886d9af055b7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ml7pc"
Jul 18 00:42:12.197514 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.197309    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-metrics-client-ca\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.197514 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.197324    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9ac13500-567a-4f83-b31c-c0a9b7ba674d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-hb2m2\" (UID: \"9ac13500-567a-4f83-b31c-c0a9b7ba674d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2"
Jul 18 00:42:12.197514 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.197389    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-node-exporter-accelerators-collector-config\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.197514 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.197476    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.197785 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.197513    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-node-exporter-tls\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.197785 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.197544    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9ac13500-567a-4f83-b31c-c0a9b7ba674d-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-hb2m2\" (UID: \"9ac13500-567a-4f83-b31c-c0a9b7ba674d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2"
Jul 18 00:42:12.197785 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.197590    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ac13500-567a-4f83-b31c-c0a9b7ba674d-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-hb2m2\" (UID: \"9ac13500-567a-4f83-b31c-c0a9b7ba674d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2"
Jul 18 00:42:12.197785 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.197621    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ba9a1c4-2b55-469d-b739-886d9af055b7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-ml7pc\" (UID: \"8ba9a1c4-2b55-469d-b739-886d9af055b7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ml7pc"
Jul 18 00:42:12.197785 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.197660    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-root\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.298402 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.298325    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-node-exporter-textfile\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.298402 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.298357    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q65n9\" (UniqueName: \"kubernetes.io/projected/8ba9a1c4-2b55-469d-b739-886d9af055b7-kube-api-access-q65n9\") pod \"openshift-state-metrics-79f6958cdf-ml7pc\" (UID: \"8ba9a1c4-2b55-469d-b739-886d9af055b7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ml7pc"
Jul 18 00:42:12.298777 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.298544    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-node-exporter-wtmp\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.298777 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.298622    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ac13500-567a-4f83-b31c-c0a9b7ba674d-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-hb2m2\" (UID: \"9ac13500-567a-4f83-b31c-c0a9b7ba674d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2"
Jul 18 00:42:12.298777 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.298657    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chrnq\" (UniqueName: \"kubernetes.io/projected/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-kube-api-access-chrnq\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.298777 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.298685    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-node-exporter-textfile\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.298777 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.298698    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-sys\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.298777 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.298699    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-node-exporter-wtmp\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.298777 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.298747    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghzlf\" (UniqueName: \"kubernetes.io/projected/9ac13500-567a-4f83-b31c-c0a9b7ba674d-kube-api-access-ghzlf\") pod \"kube-state-metrics-56c5594674-hb2m2\" (UID: \"9ac13500-567a-4f83-b31c-c0a9b7ba674d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2"
Jul 18 00:42:12.298777 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.298767    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ac13500-567a-4f83-b31c-c0a9b7ba674d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-hb2m2\" (UID: \"9ac13500-567a-4f83-b31c-c0a9b7ba674d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2"
Jul 18 00:42:12.298777 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.298771    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-sys\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.299258 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.298786    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ba9a1c4-2b55-469d-b739-886d9af055b7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-ml7pc\" (UID: \"8ba9a1c4-2b55-469d-b739-886d9af055b7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ml7pc"
Jul 18 00:42:12.299258 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.298897    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ba9a1c4-2b55-469d-b739-886d9af055b7-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-ml7pc\" (UID: \"8ba9a1c4-2b55-469d-b739-886d9af055b7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ml7pc"
Jul 18 00:42:12.299258 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.298917    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-metrics-client-ca\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.299258 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.298935    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9ac13500-567a-4f83-b31c-c0a9b7ba674d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-hb2m2\" (UID: \"9ac13500-567a-4f83-b31c-c0a9b7ba674d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2"
Jul 18 00:42:12.299258 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.298959    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-node-exporter-accelerators-collector-config\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.299258 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.298982    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.299258 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.298997    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-node-exporter-tls\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.299258 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.299020    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9ac13500-567a-4f83-b31c-c0a9b7ba674d-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-hb2m2\" (UID: \"9ac13500-567a-4f83-b31c-c0a9b7ba674d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2"
Jul 18 00:42:12.299258 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.299040    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ac13500-567a-4f83-b31c-c0a9b7ba674d-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-hb2m2\" (UID: \"9ac13500-567a-4f83-b31c-c0a9b7ba674d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2"
Jul 18 00:42:12.299258 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.299063    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ba9a1c4-2b55-469d-b739-886d9af055b7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-ml7pc\" (UID: \"8ba9a1c4-2b55-469d-b739-886d9af055b7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ml7pc"
Jul 18 00:42:12.299258 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.299080    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-root\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.299258 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.299163    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-root\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.299994 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.299360    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ac13500-567a-4f83-b31c-c0a9b7ba674d-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-hb2m2\" (UID: \"9ac13500-567a-4f83-b31c-c0a9b7ba674d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2"
Jul 18 00:42:12.299994 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.299504    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9ac13500-567a-4f83-b31c-c0a9b7ba674d-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-hb2m2\" (UID: \"9ac13500-567a-4f83-b31c-c0a9b7ba674d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2"
Jul 18 00:42:12.299994 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.299606    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-node-exporter-accelerators-collector-config\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.299994 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.299813    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9ac13500-567a-4f83-b31c-c0a9b7ba674d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-hb2m2\" (UID: \"9ac13500-567a-4f83-b31c-c0a9b7ba674d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2"
Jul 18 00:42:12.300249 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.300229    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-metrics-client-ca\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.300335 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.300301    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ba9a1c4-2b55-469d-b739-886d9af055b7-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-ml7pc\" (UID: \"8ba9a1c4-2b55-469d-b739-886d9af055b7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ml7pc"
Jul 18 00:42:12.301924 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.301903    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ba9a1c4-2b55-469d-b739-886d9af055b7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-ml7pc\" (UID: \"8ba9a1c4-2b55-469d-b739-886d9af055b7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ml7pc"
Jul 18 00:42:12.303249 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.302453    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ac13500-567a-4f83-b31c-c0a9b7ba674d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-hb2m2\" (UID: \"9ac13500-567a-4f83-b31c-c0a9b7ba674d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2"
Jul 18 00:42:12.303249 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.302808    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ba9a1c4-2b55-469d-b739-886d9af055b7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-ml7pc\" (UID: \"8ba9a1c4-2b55-469d-b739-886d9af055b7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ml7pc"
Jul 18 00:42:12.303249 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.302876    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ac13500-567a-4f83-b31c-c0a9b7ba674d-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-hb2m2\" (UID: \"9ac13500-567a-4f83-b31c-c0a9b7ba674d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2"
Jul 18 00:42:12.303249 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.302902    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.303558 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.303535    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-node-exporter-tls\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.307471 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.307446    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q65n9\" (UniqueName: \"kubernetes.io/projected/8ba9a1c4-2b55-469d-b739-886d9af055b7-kube-api-access-q65n9\") pod \"openshift-state-metrics-79f6958cdf-ml7pc\" (UID: \"8ba9a1c4-2b55-469d-b739-886d9af055b7\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ml7pc"
Jul 18 00:42:12.307576 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.307483    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chrnq\" (UniqueName: \"kubernetes.io/projected/2e715093-02fc-4f5e-9ca5-9a49aeeb7b59-kube-api-access-chrnq\") pod \"node-exporter-5bb22\" (UID: \"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59\") " pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.308288 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.308271    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghzlf\" (UniqueName: \"kubernetes.io/projected/9ac13500-567a-4f83-b31c-c0a9b7ba674d-kube-api-access-ghzlf\") pod \"kube-state-metrics-56c5594674-hb2m2\" (UID: \"9ac13500-567a-4f83-b31c-c0a9b7ba674d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2"
Jul 18 00:42:12.351240 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.351205    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ml7pc"
Jul 18 00:42:12.368735 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.368708    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5bb22"
Jul 18 00:42:12.374795 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:12.374772    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2"
Jul 18 00:42:13.123953 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.123916    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 00:42:13.147270 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.147236    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.150393 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.150366    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 00:42:13.151362 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.150560    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 18 00:42:13.151362 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.150586    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bxkkw\""
Jul 18 00:42:13.151362 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.150811    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 18 00:42:13.151362 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.150909    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 18 00:42:13.151362 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.151004    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 18 00:42:13.151362 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.151049    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 18 00:42:13.151362 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.151100    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 18 00:42:13.151362 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.151111    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 18 00:42:13.151362 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.151245    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 18 00:42:13.151826 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.151554    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 18 00:42:13.307490 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.307455    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.307754 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.307509    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.307754 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.307530    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-config-out\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.307754 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.307557    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.307754 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.307580    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.307754 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.307603    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.307754 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.307675    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.307754 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.307731    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.308305 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.307806    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.308305 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.307833    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4c4b\" (UniqueName: \"kubernetes.io/projected/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-kube-api-access-j4c4b\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.308305 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.307862    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.308305 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.307889    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-web-config\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.308305 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.307913    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.408550 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.408476    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.408550 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.408523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.408550 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.408553    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-config-out\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.408550 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.408597    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.408938 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.408626    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.408938 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.408643    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.408938 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.408670    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.408938 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.408705    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.408938 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.408753    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.408938 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.408779    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4c4b\" (UniqueName: \"kubernetes.io/projected/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-kube-api-access-j4c4b\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.408938 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.408803    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.408938 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.408825    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-web-config\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.408938 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.408849    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.409398 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.409245    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.409659 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.409633    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.410475 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.410447    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.412437 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.412411    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.412557 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.412535    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.413057 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.413038    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.413134 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.413069    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-config-out\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.413802 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.413780    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.414055 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.414029    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-web-config\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.414502 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.414480    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.414677 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.414651    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.415223 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.415174    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.417845 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.417827    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4c4b\" (UniqueName: \"kubernetes.io/projected/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-kube-api-access-j4c4b\") pod \"alertmanager-main-0\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:13.462945 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:13.462906    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:42:15.082830 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.082806    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kmtff"
Jul 18 00:42:15.136900 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.136872    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-847d574c6-mz4pw"]
Jul 18 00:42:15.283224 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.283162    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-847d574c6-mz4pw"]
Jul 18 00:42:15.283410 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.283314    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.286977 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.286954    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-99jnz\""
Jul 18 00:42:15.287118 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.287015    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 18 00:42:15.287118 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.287024    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 18 00:42:15.287118 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.286956    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-465mb0r52vn1m\""
Jul 18 00:42:15.287309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.287168    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 18 00:42:15.287309 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.287252    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 18 00:42:15.287498 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.287483    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 18 00:42:15.427121 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.427078    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7111db5e-d779-41fd-831f-55768cb56c59-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.427339 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.427135    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7111db5e-d779-41fd-831f-55768cb56c59-secret-grpc-tls\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.427339 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.427166    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxhgn\" (UniqueName: \"kubernetes.io/projected/7111db5e-d779-41fd-831f-55768cb56c59-kube-api-access-sxhgn\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.427339 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.427217    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7111db5e-d779-41fd-831f-55768cb56c59-secret-thanos-querier-tls\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.427339 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.427274    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7111db5e-d779-41fd-831f-55768cb56c59-metrics-client-ca\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.427339 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.427312    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7111db5e-d779-41fd-831f-55768cb56c59-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.427592 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.427361    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7111db5e-d779-41fd-831f-55768cb56c59-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.427592 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.427400    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7111db5e-d779-41fd-831f-55768cb56c59-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.528615 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.528573    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7111db5e-d779-41fd-831f-55768cb56c59-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.528811 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.528636    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7111db5e-d779-41fd-831f-55768cb56c59-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.528811 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.528677    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7111db5e-d779-41fd-831f-55768cb56c59-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.528811 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.528707    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7111db5e-d779-41fd-831f-55768cb56c59-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.528811 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.528735    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7111db5e-d779-41fd-831f-55768cb56c59-secret-grpc-tls\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.528811 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.528767    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxhgn\" (UniqueName: \"kubernetes.io/projected/7111db5e-d779-41fd-831f-55768cb56c59-kube-api-access-sxhgn\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.528811 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.528807    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7111db5e-d779-41fd-831f-55768cb56c59-secret-thanos-querier-tls\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.529136 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.528845    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7111db5e-d779-41fd-831f-55768cb56c59-metrics-client-ca\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.529814 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.529775    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7111db5e-d779-41fd-831f-55768cb56c59-metrics-client-ca\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.531814 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.531789    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7111db5e-d779-41fd-831f-55768cb56c59-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.532775 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.532561    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7111db5e-d779-41fd-831f-55768cb56c59-secret-grpc-tls\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.532775 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.532753    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7111db5e-d779-41fd-831f-55768cb56c59-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.532918 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.532753    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7111db5e-d779-41fd-831f-55768cb56c59-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.533509 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.533483    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7111db5e-d779-41fd-831f-55768cb56c59-secret-thanos-querier-tls\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.533610 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.533534    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7111db5e-d779-41fd-831f-55768cb56c59-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.536625 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.536603    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxhgn\" (UniqueName: \"kubernetes.io/projected/7111db5e-d779-41fd-831f-55768cb56c59-kube-api-access-sxhgn\") pod \"thanos-querier-847d574c6-mz4pw\" (UID: \"7111db5e-d779-41fd-831f-55768cb56c59\") " pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:15.595625 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:15.595588    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:16.366767 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.366737    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 00:42:16.373453 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.373430    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5699b5bd57-pjrgs"]
Jul 18 00:42:16.393158 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.393131    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5699b5bd57-pjrgs"]
Jul 18 00:42:16.393345 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.393260    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:16.396146 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.396124    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 18 00:42:16.396466 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.396417    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 18 00:42:16.396546 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.396417    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-298kk\""
Jul 18 00:42:16.396546 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.396434    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 18 00:42:16.396653 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.396561    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6ftll53l7gmcc\""
Jul 18 00:42:16.396653 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.396597    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 18 00:42:16.536317 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.536240    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c028b2a4-ac11-4827-9d86-889d7d19f609-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5699b5bd57-pjrgs\" (UID: \"c028b2a4-ac11-4827-9d86-889d7d19f609\") " pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:16.536317 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.536280    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c028b2a4-ac11-4827-9d86-889d7d19f609-metrics-server-audit-profiles\") pod \"metrics-server-5699b5bd57-pjrgs\" (UID: \"c028b2a4-ac11-4827-9d86-889d7d19f609\") " pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:16.536317 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.536303    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c028b2a4-ac11-4827-9d86-889d7d19f609-client-ca-bundle\") pod \"metrics-server-5699b5bd57-pjrgs\" (UID: \"c028b2a4-ac11-4827-9d86-889d7d19f609\") " pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:16.536517 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.536322    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c028b2a4-ac11-4827-9d86-889d7d19f609-secret-metrics-server-client-certs\") pod \"metrics-server-5699b5bd57-pjrgs\" (UID: \"c028b2a4-ac11-4827-9d86-889d7d19f609\") " pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:16.536517 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.536411    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c028b2a4-ac11-4827-9d86-889d7d19f609-audit-log\") pod \"metrics-server-5699b5bd57-pjrgs\" (UID: \"c028b2a4-ac11-4827-9d86-889d7d19f609\") " pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:16.536517 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.536460    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtbvc\" (UniqueName: \"kubernetes.io/projected/c028b2a4-ac11-4827-9d86-889d7d19f609-kube-api-access-dtbvc\") pod \"metrics-server-5699b5bd57-pjrgs\" (UID: \"c028b2a4-ac11-4827-9d86-889d7d19f609\") " pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:16.536517 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.536484    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c028b2a4-ac11-4827-9d86-889d7d19f609-secret-metrics-server-tls\") pod \"metrics-server-5699b5bd57-pjrgs\" (UID: \"c028b2a4-ac11-4827-9d86-889d7d19f609\") " pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:16.571203 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:42:16.571151    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca1a1e6e_b27c_4ab4_ba6e_e40d5dfa503d.slice/crio-d44f559259899895be5e05e29db82ab1c4ae09a8fc0c6c847177416d7eae3772 WatchSource:0}: Error finding container d44f559259899895be5e05e29db82ab1c4ae09a8fc0c6c847177416d7eae3772: Status 404 returned error can't find the container with id d44f559259899895be5e05e29db82ab1c4ae09a8fc0c6c847177416d7eae3772
Jul 18 00:42:16.579430 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.579298    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-ml7pc"]
Jul 18 00:42:16.580527 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.580485    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-hb2m2"]
Jul 18 00:42:16.581930 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.581866    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-847d574c6-mz4pw"]
Jul 18 00:42:16.582831 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:42:16.582802    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba9a1c4_2b55_469d_b739_886d9af055b7.slice/crio-88a4dd90b2ac42c267519a383976d967011c95dae513858a423b0889c6e9bc99 WatchSource:0}: Error finding container 88a4dd90b2ac42c267519a383976d967011c95dae513858a423b0889c6e9bc99: Status 404 returned error can't find the container with id 88a4dd90b2ac42c267519a383976d967011c95dae513858a423b0889c6e9bc99
Jul 18 00:42:16.583407 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:42:16.583383    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ac13500_567a_4f83_b31c_c0a9b7ba674d.slice/crio-ff09ae549f705d85cf0c41c590e9835db19d15e2a11bdc37dd3825d8a8b6f075 WatchSource:0}: Error finding container ff09ae549f705d85cf0c41c590e9835db19d15e2a11bdc37dd3825d8a8b6f075: Status 404 returned error can't find the container with id ff09ae549f705d85cf0c41c590e9835db19d15e2a11bdc37dd3825d8a8b6f075
Jul 18 00:42:16.585736 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:42:16.585719    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7111db5e_d779_41fd_831f_55768cb56c59.slice/crio-a7320ac6cb5f851a5f0a61cead34a318d32f94f44680b013cfd6b9762d7f124e WatchSource:0}: Error finding container a7320ac6cb5f851a5f0a61cead34a318d32f94f44680b013cfd6b9762d7f124e: Status 404 returned error can't find the container with id a7320ac6cb5f851a5f0a61cead34a318d32f94f44680b013cfd6b9762d7f124e
Jul 18 00:42:16.637081 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.637057    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c028b2a4-ac11-4827-9d86-889d7d19f609-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5699b5bd57-pjrgs\" (UID: \"c028b2a4-ac11-4827-9d86-889d7d19f609\") " pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:16.637216 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.637097    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c028b2a4-ac11-4827-9d86-889d7d19f609-metrics-server-audit-profiles\") pod \"metrics-server-5699b5bd57-pjrgs\" (UID: \"c028b2a4-ac11-4827-9d86-889d7d19f609\") " pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:16.637216 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.637126    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c028b2a4-ac11-4827-9d86-889d7d19f609-client-ca-bundle\") pod \"metrics-server-5699b5bd57-pjrgs\" (UID: \"c028b2a4-ac11-4827-9d86-889d7d19f609\") " pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:16.637216 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.637153    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c028b2a4-ac11-4827-9d86-889d7d19f609-secret-metrics-server-client-certs\") pod \"metrics-server-5699b5bd57-pjrgs\" (UID: \"c028b2a4-ac11-4827-9d86-889d7d19f609\") " pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:16.637216 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.637207    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c028b2a4-ac11-4827-9d86-889d7d19f609-audit-log\") pod \"metrics-server-5699b5bd57-pjrgs\" (UID: \"c028b2a4-ac11-4827-9d86-889d7d19f609\") " pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:16.637433 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.637258    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtbvc\" (UniqueName: \"kubernetes.io/projected/c028b2a4-ac11-4827-9d86-889d7d19f609-kube-api-access-dtbvc\") pod \"metrics-server-5699b5bd57-pjrgs\" (UID: \"c028b2a4-ac11-4827-9d86-889d7d19f609\") " pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:16.637433 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.637295    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c028b2a4-ac11-4827-9d86-889d7d19f609-secret-metrics-server-tls\") pod \"metrics-server-5699b5bd57-pjrgs\" (UID: \"c028b2a4-ac11-4827-9d86-889d7d19f609\") " pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:16.637841 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.637803    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c028b2a4-ac11-4827-9d86-889d7d19f609-audit-log\") pod \"metrics-server-5699b5bd57-pjrgs\" (UID: \"c028b2a4-ac11-4827-9d86-889d7d19f609\") " pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:16.637926 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.637839    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c028b2a4-ac11-4827-9d86-889d7d19f609-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5699b5bd57-pjrgs\" (UID: \"c028b2a4-ac11-4827-9d86-889d7d19f609\") " pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:16.638405 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.638377    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c028b2a4-ac11-4827-9d86-889d7d19f609-metrics-server-audit-profiles\") pod \"metrics-server-5699b5bd57-pjrgs\" (UID: \"c028b2a4-ac11-4827-9d86-889d7d19f609\") " pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:16.639897 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.639877    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c028b2a4-ac11-4827-9d86-889d7d19f609-secret-metrics-server-tls\") pod \"metrics-server-5699b5bd57-pjrgs\" (UID: \"c028b2a4-ac11-4827-9d86-889d7d19f609\") " pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:16.639993 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.639953    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c028b2a4-ac11-4827-9d86-889d7d19f609-client-ca-bundle\") pod \"metrics-server-5699b5bd57-pjrgs\" (UID: \"c028b2a4-ac11-4827-9d86-889d7d19f609\") " pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:16.640771 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.640755    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c028b2a4-ac11-4827-9d86-889d7d19f609-secret-metrics-server-client-certs\") pod \"metrics-server-5699b5bd57-pjrgs\" (UID: \"c028b2a4-ac11-4827-9d86-889d7d19f609\") " pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:16.645334 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.645314    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtbvc\" (UniqueName: \"kubernetes.io/projected/c028b2a4-ac11-4827-9d86-889d7d19f609-kube-api-access-dtbvc\") pod \"metrics-server-5699b5bd57-pjrgs\" (UID: \"c028b2a4-ac11-4827-9d86-889d7d19f609\") " pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:16.703308 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.703150    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:16.838007 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.837860    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jq46v"]
Jul 18 00:42:16.859754 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.859705    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jq46v"]
Jul 18 00:42:16.859854 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.859837    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jq46v"
Jul 18 00:42:16.864451 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.864140    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 18 00:42:16.864451 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.864262    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-g59ps\""
Jul 18 00:42:16.908801 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.908770    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5699b5bd57-pjrgs"]
Jul 18 00:42:16.911581 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:42:16.911551    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc028b2a4_ac11_4827_9d86_889d7d19f609.slice/crio-1137f56f583f2d54e2dbd62b130bf2e99126f6cc77a869ddad69b7d7cf879035 WatchSource:0}: Error finding container 1137f56f583f2d54e2dbd62b130bf2e99126f6cc77a869ddad69b7d7cf879035: Status 404 returned error can't find the container with id 1137f56f583f2d54e2dbd62b130bf2e99126f6cc77a869ddad69b7d7cf879035
Jul 18 00:42:16.941104 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.941002    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e89a9052-a6b3-4428-b7d9-95812ad97769-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-jq46v\" (UID: \"e89a9052-a6b3-4428-b7d9-95812ad97769\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jq46v"
Jul 18 00:42:16.941104 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:16.941055    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc7fj\" (UniqueName: \"kubernetes.io/projected/e89a9052-a6b3-4428-b7d9-95812ad97769-kube-api-access-dc7fj\") pod \"monitoring-plugin-7b7b7bc8bf-jq46v\" (UID: \"e89a9052-a6b3-4428-b7d9-95812ad97769\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jq46v"
Jul 18 00:42:17.041778 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:17.041698    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc7fj\" (UniqueName: \"kubernetes.io/projected/e89a9052-a6b3-4428-b7d9-95812ad97769-kube-api-access-dc7fj\") pod \"monitoring-plugin-7b7b7bc8bf-jq46v\" (UID: \"e89a9052-a6b3-4428-b7d9-95812ad97769\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jq46v"
Jul 18 00:42:17.041931 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:17.041787    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e89a9052-a6b3-4428-b7d9-95812ad97769-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-jq46v\" (UID: \"e89a9052-a6b3-4428-b7d9-95812ad97769\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jq46v"
Jul 18 00:42:17.041931 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:42:17.041889    2575 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 18 00:42:17.042035 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:42:17.041951    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e89a9052-a6b3-4428-b7d9-95812ad97769-monitoring-plugin-cert podName:e89a9052-a6b3-4428-b7d9-95812ad97769 nodeName:}" failed. No retries permitted until 2026-07-18 00:42:17.541929658 +0000 UTC m=+105.331341697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e89a9052-a6b3-4428-b7d9-95812ad97769-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-jq46v" (UID: "e89a9052-a6b3-4428-b7d9-95812ad97769") : secret "monitoring-plugin-cert" not found
Jul 18 00:42:17.051493 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:17.051464    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc7fj\" (UniqueName: \"kubernetes.io/projected/e89a9052-a6b3-4428-b7d9-95812ad97769-kube-api-access-dc7fj\") pod \"monitoring-plugin-7b7b7bc8bf-jq46v\" (UID: \"e89a9052-a6b3-4428-b7d9-95812ad97769\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jq46v"
Jul 18 00:42:17.229795 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:17.229637    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-52zxk"
Jul 18 00:42:17.229795 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:17.229738    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-52zxk" event={"ID":"61a01215-46f4-4d8d-96e4-21a5f53b4e8e","Type":"ContainerStarted","Data":"3105cda55ca2243fe17fb3c6e4f643e6a75a6a7e0bdb626873835ddd65da67a0"}
Jul 18 00:42:17.239810 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:17.239663    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ml7pc" event={"ID":"8ba9a1c4-2b55-469d-b739-886d9af055b7","Type":"ContainerStarted","Data":"074b485bd4d15723323798e83fbec7ad21f4f4f5f2677683fae4639cac2b6a41"}
Jul 18 00:42:17.239810 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:17.239732    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ml7pc" event={"ID":"8ba9a1c4-2b55-469d-b739-886d9af055b7","Type":"ContainerStarted","Data":"7f1ad79f0d2a9fdd9eea7f1508c239a64e98cbfd51b9a38a7aa2094d21419b31"}
Jul 18 00:42:17.239810 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:17.239762    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ml7pc" event={"ID":"8ba9a1c4-2b55-469d-b739-886d9af055b7","Type":"ContainerStarted","Data":"88a4dd90b2ac42c267519a383976d967011c95dae513858a423b0889c6e9bc99"}
Jul 18 00:42:17.240465 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:17.240281    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-52zxk"
Jul 18 00:42:17.243320 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:17.242588    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2" event={"ID":"9ac13500-567a-4f83-b31c-c0a9b7ba674d","Type":"ContainerStarted","Data":"ff09ae549f705d85cf0c41c590e9835db19d15e2a11bdc37dd3825d8a8b6f075"}
Jul 18 00:42:17.248555 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:17.248529    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d","Type":"ContainerStarted","Data":"d44f559259899895be5e05e29db82ab1c4ae09a8fc0c6c847177416d7eae3772"}
Jul 18 00:42:17.253102 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:17.253077    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs" event={"ID":"c028b2a4-ac11-4827-9d86-889d7d19f609","Type":"ContainerStarted","Data":"1137f56f583f2d54e2dbd62b130bf2e99126f6cc77a869ddad69b7d7cf879035"}
Jul 18 00:42:17.256945 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:17.256890    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5bb22" event={"ID":"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59","Type":"ContainerStarted","Data":"a6ac9f4797c181a6851abe15175fa358360f135e8a2f2042b51963fc296d260e"}
Jul 18 00:42:17.259872 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:17.259853    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw" event={"ID":"7111db5e-d779-41fd-831f-55768cb56c59","Type":"ContainerStarted","Data":"a7320ac6cb5f851a5f0a61cead34a318d32f94f44680b013cfd6b9762d7f124e"}
Jul 18 00:42:17.265206 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:17.265140    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-52zxk" podStartSLOduration=1.688867235 podStartE2EDuration="18.265101412s" totalImagesPullingTime="16.576234177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:41:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:42:17.245780179 +0000 UTC m=+105.035192237" watchObservedRunningTime="2026-07-18 00:42:17.265101412 +0000 UTC m=+105.054513471"
Jul 18 00:42:17.550653 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:17.550607    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e89a9052-a6b3-4428-b7d9-95812ad97769-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-jq46v\" (UID: \"e89a9052-a6b3-4428-b7d9-95812ad97769\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jq46v"
Jul 18 00:42:17.563417 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:17.563354    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e89a9052-a6b3-4428-b7d9-95812ad97769-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-jq46v\" (UID: \"e89a9052-a6b3-4428-b7d9-95812ad97769\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jq46v"
Jul 18 00:42:17.773965 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:17.773693    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jq46v"
Jul 18 00:42:17.954075 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:17.953948    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jq46v"]
Jul 18 00:42:18.091387 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:42:18.091341    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode89a9052_a6b3_4428_b7d9_95812ad97769.slice/crio-b4f58061b44516892c46ef92a37a01dc21d40790eb136cc047e0657836d0f7ae WatchSource:0}: Error finding container b4f58061b44516892c46ef92a37a01dc21d40790eb136cc047e0657836d0f7ae: Status 404 returned error can't find the container with id b4f58061b44516892c46ef92a37a01dc21d40790eb136cc047e0657836d0f7ae
Jul 18 00:42:18.238208 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.236867    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 00:42:18.267270 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.266047    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 00:42:18.267270 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.266271    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.274829 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.273690    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 18 00:42:18.274829 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.273918    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 18 00:42:18.274829 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.274233    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 18 00:42:18.274829 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.274264    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dfhanm7nsptjd\""
Jul 18 00:42:18.274829 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.274445    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 18 00:42:18.274829 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.274475    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 18 00:42:18.274829 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.274578    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 18 00:42:18.274829 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.274602    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rbxql\""
Jul 18 00:42:18.275424 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.274885    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 18 00:42:18.275424 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.275042    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 18 00:42:18.278297 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.276414    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jq46v" event={"ID":"e89a9052-a6b3-4428-b7d9-95812ad97769","Type":"ContainerStarted","Data":"b4f58061b44516892c46ef92a37a01dc21d40790eb136cc047e0657836d0f7ae"}
Jul 18 00:42:18.278297 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.276651    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 18 00:42:18.278297 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.277083    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 18 00:42:18.278297 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.277332    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 18 00:42:18.278297 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.277731    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 18 00:42:18.279414 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.278728    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 18 00:42:18.284382 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.284174    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 18 00:42:18.361109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.360287    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.361109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.360335    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.361109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.360373    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-web-config\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.361109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.360396    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.361109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.360424    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.361109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.360451    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.361109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.360474    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjxww\" (UniqueName: \"kubernetes.io/projected/1e8c3176-9b62-4081-bbaf-21b60a57d639-kube-api-access-hjxww\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.361109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.360503    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.361109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.360527    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.361109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.360559    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.361109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.360624    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.361109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.360647    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.361109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.360680    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.361109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.360704    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.361109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.360747    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e8c3176-9b62-4081-bbaf-21b60a57d639-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.361109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.360768    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e8c3176-9b62-4081-bbaf-21b60a57d639-config-out\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.361925 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.360793    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-config\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.361925 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.360823    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.361925 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.360856    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.361925 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.360919    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.461957 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.461917    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.462150 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.461986    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.462150 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.462012    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.462150 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.462036    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.462150 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.462057    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-web-config\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.462150 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.462076    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.462150 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.462103    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.462150 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.462128    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.462534 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.462152    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjxww\" (UniqueName: \"kubernetes.io/projected/1e8c3176-9b62-4081-bbaf-21b60a57d639-kube-api-access-hjxww\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.462534 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.462199    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.462534 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.462225    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.462534 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.462263    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.462534 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.462311    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.462534 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.462338    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.462534 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.462371    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.462534 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.462393    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.462534 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.462437    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e8c3176-9b62-4081-bbaf-21b60a57d639-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.462534 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.462462    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e8c3176-9b62-4081-bbaf-21b60a57d639-config-out\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.462534 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.462488    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-config\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.462534 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.462523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.463355 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.463331    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.466569 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.465396    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.470407 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.469276    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e8c3176-9b62-4081-bbaf-21b60a57d639-config-out\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.470407 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.469835    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.473800 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.473780    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.474638 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.474618    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.483586 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.481351    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.483586 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.481846    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.483586 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.482362    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.484605 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.484587    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.485607 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.485566    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-config\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.492942 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.492862    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e8c3176-9b62-4081-bbaf-21b60a57d639-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.492942 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.492928    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.495759 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.495670    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.496137 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.496100    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-web-config\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.496618 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.496582    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.496857 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.496833    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjxww\" (UniqueName: \"kubernetes.io/projected/1e8c3176-9b62-4081-bbaf-21b60a57d639-kube-api-access-hjxww\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.502212 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.501778    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.502360 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.502173    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.503891 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.503847    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:18.591048 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:18.590734    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:21.835282 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:21.835240    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 00:42:22.301444 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:42:22.301405    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e8c3176_9b62_4081_bbaf_21b60a57d639.slice/crio-7a90e8bfd472f9b7e1d19d08ccc75351bb05faadc3a7ab8b648a6942f33e1849 WatchSource:0}: Error finding container 7a90e8bfd472f9b7e1d19d08ccc75351bb05faadc3a7ab8b648a6942f33e1849: Status 404 returned error can't find the container with id 7a90e8bfd472f9b7e1d19d08ccc75351bb05faadc3a7ab8b648a6942f33e1849
Jul 18 00:42:23.304361 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:23.304314    2575 generic.go:356] "Generic (PLEG): container finished" podID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerID="284f0596f66ad4fc848ff53aef39b32098973d8d2ae58e2018087ea2bd4187dc" exitCode=0
Jul 18 00:42:23.304921 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:23.304408    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d","Type":"ContainerDied","Data":"284f0596f66ad4fc848ff53aef39b32098973d8d2ae58e2018087ea2bd4187dc"}
Jul 18 00:42:23.307617 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:23.307099    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs" event={"ID":"c028b2a4-ac11-4827-9d86-889d7d19f609","Type":"ContainerStarted","Data":"712fda144a89cdae9489e8caaff6a12f6ae74a0f8e45bcaa2b3f9299902fc40c"}
Jul 18 00:42:23.310456 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:23.309556    2575 generic.go:356] "Generic (PLEG): container finished" podID="2e715093-02fc-4f5e-9ca5-9a49aeeb7b59" containerID="e9cd249aa0e904d0a0307036c0c95fcf6ff299472f36f477d5343e10d6245d7f" exitCode=0
Jul 18 00:42:23.310456 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:23.309643    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5bb22" event={"ID":"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59","Type":"ContainerDied","Data":"e9cd249aa0e904d0a0307036c0c95fcf6ff299472f36f477d5343e10d6245d7f"}
Jul 18 00:42:23.314858 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:23.314835    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw" event={"ID":"7111db5e-d779-41fd-831f-55768cb56c59","Type":"ContainerStarted","Data":"db4bf3339a21ae88c1358c2f4c51c9a813c2b2ba3dedf4724379a9256ef9675e"}
Jul 18 00:42:23.314959 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:23.314903    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw" event={"ID":"7111db5e-d779-41fd-831f-55768cb56c59","Type":"ContainerStarted","Data":"b6a0ee9fb87d55b7d9ad79be799fe612210773ee4fc78757b3f828c618a0de33"}
Jul 18 00:42:23.314959 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:23.314943    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw" event={"ID":"7111db5e-d779-41fd-831f-55768cb56c59","Type":"ContainerStarted","Data":"69b4debbfe11ceb61ace184ebc98395d260430b400a12772ab0e4aae805abfba"}
Jul 18 00:42:23.317580 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:23.317520    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ml7pc" event={"ID":"8ba9a1c4-2b55-469d-b739-886d9af055b7","Type":"ContainerStarted","Data":"6603d4bfc5f069b3272f0eb9199200a610a0e41d2c9f7ca114e9ea4d23e96638"}
Jul 18 00:42:23.319288 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:23.319262    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jq46v" event={"ID":"e89a9052-a6b3-4428-b7d9-95812ad97769","Type":"ContainerStarted","Data":"40f5e64fc64d6bc0ddf3b385aded40d0eb066a38eb26856d9abc5f7be6618d9a"}
Jul 18 00:42:23.319872 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:23.319854    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jq46v"
Jul 18 00:42:23.324255 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:23.324234    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2" event={"ID":"9ac13500-567a-4f83-b31c-c0a9b7ba674d","Type":"ContainerStarted","Data":"f48765a32bc62e521b763bd84015a8d4ddc6d4d6aa1b50ce5ed02f253ba82ad6"}
Jul 18 00:42:23.324376 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:23.324280    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2" event={"ID":"9ac13500-567a-4f83-b31c-c0a9b7ba674d","Type":"ContainerStarted","Data":"2fdc4fda2ffe5188baffac1665db831dc339088d703de58992fef77fa845e397"}
Jul 18 00:42:23.324376 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:23.324309    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2" event={"ID":"9ac13500-567a-4f83-b31c-c0a9b7ba674d","Type":"ContainerStarted","Data":"8112a0d8f12b626fd9e2c0a9ce46f5d3741f55b1ccfba449169487ea191ebdfe"}
Jul 18 00:42:23.326175 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:23.326158    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jq46v"
Jul 18 00:42:23.326372 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:23.326351    2575 generic.go:356] "Generic (PLEG): container finished" podID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerID="b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598" exitCode=0
Jul 18 00:42:23.326460 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:23.326399    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e8c3176-9b62-4081-bbaf-21b60a57d639","Type":"ContainerDied","Data":"b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598"}
Jul 18 00:42:23.326460 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:23.326455    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e8c3176-9b62-4081-bbaf-21b60a57d639","Type":"ContainerStarted","Data":"7a90e8bfd472f9b7e1d19d08ccc75351bb05faadc3a7ab8b648a6942f33e1849"}
Jul 18 00:42:23.371324 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:23.370327    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-hb2m2" podStartSLOduration=5.659848115 podStartE2EDuration="11.370301606s" totalImagesPullingTime="5.710453491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:42:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:42:23.369795347 +0000 UTC m=+111.159207406" watchObservedRunningTime="2026-07-18 00:42:23.370301606 +0000 UTC m=+111.159713664"
Jul 18 00:42:23.386527 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:23.386461    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ml7pc" podStartSLOduration=5.936484449 podStartE2EDuration="11.386444826s" totalImagesPullingTime="5.449960377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:42:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:42:23.385557154 +0000 UTC m=+111.174969212" watchObservedRunningTime="2026-07-18 00:42:23.386444826 +0000 UTC m=+111.175856884"
Jul 18 00:42:23.406320 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:23.406268    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jq46v" podStartSLOduration=2.891267006 podStartE2EDuration="7.406246151s" totalImagesPullingTime="4.514979145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:42:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:42:23.404567382 +0000 UTC m=+111.193979440" watchObservedRunningTime="2026-07-18 00:42:23.406246151 +0000 UTC m=+111.195658209"
Jul 18 00:42:23.427439 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:23.424599    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs" podStartSLOduration=2.034377809 podStartE2EDuration="7.424575251s" totalImagesPullingTime="5.390197442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:42:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:42:23.423591301 +0000 UTC m=+111.213003357" watchObservedRunningTime="2026-07-18 00:42:23.424575251 +0000 UTC m=+111.213987305"
Jul 18 00:42:23.528254 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:42:23.528205    2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e715093_02fc_4f5e_9ca5_9a49aeeb7b59.slice/crio-9c81aaf0a1933666b398ddf155e77522d52ab337814baecb3f09705d555da458.scope\": RecentStats: unable to find data in memory cache]"
Jul 18 00:42:24.340274 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:24.340242    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5bb22" event={"ID":"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59","Type":"ContainerStarted","Data":"9c81aaf0a1933666b398ddf155e77522d52ab337814baecb3f09705d555da458"}
Jul 18 00:42:24.340708 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:24.340300    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5bb22" event={"ID":"2e715093-02fc-4f5e-9ca5-9a49aeeb7b59","Type":"ContainerStarted","Data":"8a27971c79d19a05fb2323b28cdeb9565d2c3443a20182e01bf9b7042c58bc9a"}
Jul 18 00:42:25.350627 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:25.350533    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw" event={"ID":"7111db5e-d779-41fd-831f-55768cb56c59","Type":"ContainerStarted","Data":"eb2a9eed682f724c95413a52a26cd1ba433ba97f87cfdfbcecd4e2f5b7064463"}
Jul 18 00:42:25.351285 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:25.351215    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw" event={"ID":"7111db5e-d779-41fd-831f-55768cb56c59","Type":"ContainerStarted","Data":"8eebe8f7e15470e51b1d6149fe34520cc5a68513cc4c2a2c4cd0c81fb667719c"}
Jul 18 00:42:26.358475 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:26.358387    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d","Type":"ContainerStarted","Data":"7ef111d8ae40a8896a4005ffa2f88f4e760a90a8ca33c3eb6189aa9ce06ea7f9"}
Jul 18 00:42:26.358475 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:26.358474    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d","Type":"ContainerStarted","Data":"9cd9261b4401a93148f51f68d609fbe6f4a63feb00b85456b50f5a6582ee4d50"}
Jul 18 00:42:26.358953 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:26.358518    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d","Type":"ContainerStarted","Data":"1856e67eb67a3cdaaf1f5d54d5d89a2987092ad12e7456cb465b01155c9a9da5"}
Jul 18 00:42:26.361709 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:26.361682    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw" event={"ID":"7111db5e-d779-41fd-831f-55768cb56c59","Type":"ContainerStarted","Data":"65659d036d8b1ea77823f84ec8170990f4e998081b66e5092377be6945e14449"}
Jul 18 00:42:26.361898 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:26.361883    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:26.384705 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:26.384631    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5bb22" podStartSLOduration=8.883674956 podStartE2EDuration="14.384616475s" totalImagesPullingTime="5.30158454s" totalInitContainerRuntime="199.356979ms" isStatefulPod=true podCreationTimestamp="2026-07-18 00:42:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:42:24.36347806 +0000 UTC m=+112.152890118" watchObservedRunningTime="2026-07-18 00:42:26.384616475 +0000 UTC m=+114.174028531"
Jul 18 00:42:26.385205 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:26.385149    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw" podStartSLOduration=4.316841471 podStartE2EDuration="11.385136609s" totalImagesPullingTime="7.068295138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:42:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:42:26.382812381 +0000 UTC m=+114.172224439" watchObservedRunningTime="2026-07-18 00:42:26.385136609 +0000 UTC m=+114.174548667"
Jul 18 00:42:27.368567 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:27.368537    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d","Type":"ContainerStarted","Data":"af8c0da525c902d6def4aabef5e9deb3df0228fba98a3f242d41ff16698e46d6"}
Jul 18 00:42:27.374140 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:27.374122    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-847d574c6-mz4pw"
Jul 18 00:42:28.377591 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:28.377555    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e8c3176-9b62-4081-bbaf-21b60a57d639","Type":"ContainerStarted","Data":"abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7"}
Jul 18 00:42:28.378015 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:28.377665    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e8c3176-9b62-4081-bbaf-21b60a57d639","Type":"ContainerStarted","Data":"c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376"}
Jul 18 00:42:28.378015 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:28.377695    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e8c3176-9b62-4081-bbaf-21b60a57d639","Type":"ContainerStarted","Data":"1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060"}
Jul 18 00:42:28.378015 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:28.377723    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e8c3176-9b62-4081-bbaf-21b60a57d639","Type":"ContainerStarted","Data":"de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462"}
Jul 18 00:42:28.378015 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:28.377759    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e8c3176-9b62-4081-bbaf-21b60a57d639","Type":"ContainerStarted","Data":"4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830"}
Jul 18 00:42:28.378015 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:28.377783    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e8c3176-9b62-4081-bbaf-21b60a57d639","Type":"ContainerStarted","Data":"1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26"}
Jul 18 00:42:28.380867 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:28.380846    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d","Type":"ContainerStarted","Data":"b216258722daaf24067c84e826df6d1ce2d21108e8c60f740ef22838cd1dd979"}
Jul 18 00:42:28.380981 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:28.380902    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d","Type":"ContainerStarted","Data":"5a6d5bb09d44a99b539da48ade68e5bb2153439da86fcd2a1cbb25c1de312738"}
Jul 18 00:42:28.405622 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:28.405515    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.048410442 podStartE2EDuration="10.405496789s" totalImagesPullingTime="4.305443189s" totalInitContainerRuntime="51.643158ms" isStatefulPod=false podCreationTimestamp="2026-07-18 00:42:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:42:28.403701666 +0000 UTC m=+116.193113724" watchObservedRunningTime="2026-07-18 00:42:28.405496789 +0000 UTC m=+116.194908846"
Jul 18 00:42:28.431251 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:28.431194    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.824691917 podStartE2EDuration="15.431161193s" totalImagesPullingTime="7.585721682s" totalInitContainerRuntime="20.747594ms" isStatefulPod=false podCreationTimestamp="2026-07-18 00:42:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:42:28.429959986 +0000 UTC m=+116.219372080" watchObservedRunningTime="2026-07-18 00:42:28.431161193 +0000 UTC m=+116.220573250"
Jul 18 00:42:28.591819 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:28.591791    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:42:36.703738 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:36.703708    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:36.703738 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:36.703758    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:56.709408 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:56.709376    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:42:56.713403 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:42:56.713381    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5699b5bd57-pjrgs"
Jul 18 00:43:18.592213 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:18.592156    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:18.611386 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:18.611359    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:19.594658 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:19.594631    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:32.304952 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:32.304916    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 00:43:32.305485 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:32.305203    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="alertmanager" containerID="cri-o://1856e67eb67a3cdaaf1f5d54d5d89a2987092ad12e7456cb465b01155c9a9da5" gracePeriod=120
Jul 18 00:43:32.305485 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:32.305275    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="kube-rbac-proxy-metric" containerID="cri-o://5a6d5bb09d44a99b539da48ade68e5bb2153439da86fcd2a1cbb25c1de312738" gracePeriod=120
Jul 18 00:43:32.305485 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:32.305301    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="kube-rbac-proxy-web" containerID="cri-o://7ef111d8ae40a8896a4005ffa2f88f4e760a90a8ca33c3eb6189aa9ce06ea7f9" gracePeriod=120
Jul 18 00:43:32.305485 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:32.305339    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="config-reloader" containerID="cri-o://9cd9261b4401a93148f51f68d609fbe6f4a63feb00b85456b50f5a6582ee4d50" gracePeriod=120
Jul 18 00:43:32.305485 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:32.305310    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="kube-rbac-proxy" containerID="cri-o://af8c0da525c902d6def4aabef5e9deb3df0228fba98a3f242d41ff16698e46d6" gracePeriod=120
Jul 18 00:43:32.305485 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:32.305390    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="prom-label-proxy" containerID="cri-o://b216258722daaf24067c84e826df6d1ce2d21108e8c60f740ef22838cd1dd979" gracePeriod=120
Jul 18 00:43:32.631086 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:32.631053    2575 generic.go:356] "Generic (PLEG): container finished" podID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerID="b216258722daaf24067c84e826df6d1ce2d21108e8c60f740ef22838cd1dd979" exitCode=0
Jul 18 00:43:32.631086 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:32.631079    2575 generic.go:356] "Generic (PLEG): container finished" podID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerID="5a6d5bb09d44a99b539da48ade68e5bb2153439da86fcd2a1cbb25c1de312738" exitCode=0
Jul 18 00:43:32.631086 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:32.631085    2575 generic.go:356] "Generic (PLEG): container finished" podID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerID="af8c0da525c902d6def4aabef5e9deb3df0228fba98a3f242d41ff16698e46d6" exitCode=0
Jul 18 00:43:32.631086 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:32.631091    2575 generic.go:356] "Generic (PLEG): container finished" podID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerID="9cd9261b4401a93148f51f68d609fbe6f4a63feb00b85456b50f5a6582ee4d50" exitCode=0
Jul 18 00:43:32.631086 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:32.631095    2575 generic.go:356] "Generic (PLEG): container finished" podID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerID="1856e67eb67a3cdaaf1f5d54d5d89a2987092ad12e7456cb465b01155c9a9da5" exitCode=0
Jul 18 00:43:32.631387 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:32.631130    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d","Type":"ContainerDied","Data":"b216258722daaf24067c84e826df6d1ce2d21108e8c60f740ef22838cd1dd979"}
Jul 18 00:43:32.631387 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:32.631242    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d","Type":"ContainerDied","Data":"5a6d5bb09d44a99b539da48ade68e5bb2153439da86fcd2a1cbb25c1de312738"}
Jul 18 00:43:32.631387 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:32.631272    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d","Type":"ContainerDied","Data":"af8c0da525c902d6def4aabef5e9deb3df0228fba98a3f242d41ff16698e46d6"}
Jul 18 00:43:32.631387 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:32.631304    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d","Type":"ContainerDied","Data":"9cd9261b4401a93148f51f68d609fbe6f4a63feb00b85456b50f5a6582ee4d50"}
Jul 18 00:43:32.631387 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:32.631327    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d","Type":"ContainerDied","Data":"1856e67eb67a3cdaaf1f5d54d5d89a2987092ad12e7456cb465b01155c9a9da5"}
Jul 18 00:43:33.541390 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.541369    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.602866 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.602839    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4c4b\" (UniqueName: \"kubernetes.io/projected/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-kube-api-access-j4c4b\") pod \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") "
Jul 18 00:43:33.603056 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.602879    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-web-config\") pod \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") "
Jul 18 00:43:33.603056 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.602916    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-cluster-tls-config\") pod \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") "
Jul 18 00:43:33.603056 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.602952    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-tls-assets\") pod \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") "
Jul 18 00:43:33.603056 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.602978    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") "
Jul 18 00:43:33.603056 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.603006    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-metrics-client-ca\") pod \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") "
Jul 18 00:43:33.603056 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.603032    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-alertmanager-trusted-ca-bundle\") pod \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") "
Jul 18 00:43:33.603379 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.603079    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-kube-rbac-proxy-web\") pod \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") "
Jul 18 00:43:33.603379 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.603104    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-kube-rbac-proxy\") pod \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") "
Jul 18 00:43:33.603379 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.603142    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-alertmanager-main-db\") pod \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") "
Jul 18 00:43:33.603379 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.603212    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-config-volume\") pod \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") "
Jul 18 00:43:33.603379 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.603272    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-config-out\") pod \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") "
Jul 18 00:43:33.603379 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.603307    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-main-tls\") pod \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\" (UID: \"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d\") "
Jul 18 00:43:33.603646 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.603582    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" (UID: "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 00:43:33.603821 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.603790    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" (UID: "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 00:43:33.604879 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.604580    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" (UID: "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 00:43:33.606380 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.606342    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-kube-api-access-j4c4b" (OuterVolumeSpecName: "kube-api-access-j4c4b") pod "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" (UID: "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d"). InnerVolumeSpecName "kube-api-access-j4c4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 00:43:33.608692 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.608663    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" (UID: "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:43:33.609093 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.609054    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" (UID: "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:43:33.609177 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.609148    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" (UID: "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:43:33.609254 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.609229    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" (UID: "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:43:33.609853 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.609818    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-config-out" (OuterVolumeSpecName: "config-out") pod "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" (UID: "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 00:43:33.609941 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.609905    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-config-volume" (OuterVolumeSpecName: "config-volume") pod "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" (UID: "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:43:33.609941 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.609910    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" (UID: "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 00:43:33.613051 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.612987    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" (UID: "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:43:33.618522 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.618500    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-web-config" (OuterVolumeSpecName: "web-config") pod "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" (UID: "ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:43:33.637948 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.637920    2575 generic.go:356] "Generic (PLEG): container finished" podID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerID="7ef111d8ae40a8896a4005ffa2f88f4e760a90a8ca33c3eb6189aa9ce06ea7f9" exitCode=0
Jul 18 00:43:33.638074 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.637975    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d","Type":"ContainerDied","Data":"7ef111d8ae40a8896a4005ffa2f88f4e760a90a8ca33c3eb6189aa9ce06ea7f9"}
Jul 18 00:43:33.638074 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.638013    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.638074 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.638031    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d","Type":"ContainerDied","Data":"d44f559259899895be5e05e29db82ab1c4ae09a8fc0c6c847177416d7eae3772"}
Jul 18 00:43:33.638074 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.638063    2575 scope.go:117] "RemoveContainer" containerID="b216258722daaf24067c84e826df6d1ce2d21108e8c60f740ef22838cd1dd979"
Jul 18 00:43:33.645700 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.645683    2575 scope.go:117] "RemoveContainer" containerID="5a6d5bb09d44a99b539da48ade68e5bb2153439da86fcd2a1cbb25c1de312738"
Jul 18 00:43:33.653100 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.653086    2575 scope.go:117] "RemoveContainer" containerID="af8c0da525c902d6def4aabef5e9deb3df0228fba98a3f242d41ff16698e46d6"
Jul 18 00:43:33.661324 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.661294    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 00:43:33.661620 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.661607    2575 scope.go:117] "RemoveContainer" containerID="7ef111d8ae40a8896a4005ffa2f88f4e760a90a8ca33c3eb6189aa9ce06ea7f9"
Jul 18 00:43:33.667039 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.667015    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 00:43:33.669723 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.669708    2575 scope.go:117] "RemoveContainer" containerID="9cd9261b4401a93148f51f68d609fbe6f4a63feb00b85456b50f5a6582ee4d50"
Jul 18 00:43:33.677087 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.677071    2575 scope.go:117] "RemoveContainer" containerID="1856e67eb67a3cdaaf1f5d54d5d89a2987092ad12e7456cb465b01155c9a9da5"
Jul 18 00:43:33.684923 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.684908    2575 scope.go:117] "RemoveContainer" containerID="284f0596f66ad4fc848ff53aef39b32098973d8d2ae58e2018087ea2bd4187dc"
Jul 18 00:43:33.691374 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.691353    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 00:43:33.691705 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.691688    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="alertmanager"
Jul 18 00:43:33.691780 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.691707    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="alertmanager"
Jul 18 00:43:33.691780 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.691724    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="config-reloader"
Jul 18 00:43:33.691780 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.691732    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="config-reloader"
Jul 18 00:43:33.691780 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.691751    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="kube-rbac-proxy-web"
Jul 18 00:43:33.691780 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.691761    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="kube-rbac-proxy-web"
Jul 18 00:43:33.691780 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.691771    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="kube-rbac-proxy-metric"
Jul 18 00:43:33.691780 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.691780    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="kube-rbac-proxy-metric"
Jul 18 00:43:33.692113 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.691796    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="kube-rbac-proxy"
Jul 18 00:43:33.692113 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.691805    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="kube-rbac-proxy"
Jul 18 00:43:33.692113 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.691815    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="prom-label-proxy"
Jul 18 00:43:33.692113 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.691823    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="prom-label-proxy"
Jul 18 00:43:33.692113 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.691835    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="init-config-reloader"
Jul 18 00:43:33.692113 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.691842    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="init-config-reloader"
Jul 18 00:43:33.692113 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.691951    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="alertmanager"
Jul 18 00:43:33.692113 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.691965    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="config-reloader"
Jul 18 00:43:33.692113 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.691975    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="kube-rbac-proxy"
Jul 18 00:43:33.692113 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.691984    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="kube-rbac-proxy-metric"
Jul 18 00:43:33.692113 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.691994    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="kube-rbac-proxy-web"
Jul 18 00:43:33.692113 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.692003    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" containerName="prom-label-proxy"
Jul 18 00:43:33.692849 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.692828    2575 scope.go:117] "RemoveContainer" containerID="b216258722daaf24067c84e826df6d1ce2d21108e8c60f740ef22838cd1dd979"
Jul 18 00:43:33.693155 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:43:33.693133    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b216258722daaf24067c84e826df6d1ce2d21108e8c60f740ef22838cd1dd979\": container with ID starting with b216258722daaf24067c84e826df6d1ce2d21108e8c60f740ef22838cd1dd979 not found: ID does not exist" containerID="b216258722daaf24067c84e826df6d1ce2d21108e8c60f740ef22838cd1dd979"
Jul 18 00:43:33.693244 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.693165    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b216258722daaf24067c84e826df6d1ce2d21108e8c60f740ef22838cd1dd979"} err="failed to get container status \"b216258722daaf24067c84e826df6d1ce2d21108e8c60f740ef22838cd1dd979\": rpc error: code = NotFound desc = could not find container \"b216258722daaf24067c84e826df6d1ce2d21108e8c60f740ef22838cd1dd979\": container with ID starting with b216258722daaf24067c84e826df6d1ce2d21108e8c60f740ef22838cd1dd979 not found: ID does not exist"
Jul 18 00:43:33.693244 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.693201    2575 scope.go:117] "RemoveContainer" containerID="5a6d5bb09d44a99b539da48ade68e5bb2153439da86fcd2a1cbb25c1de312738"
Jul 18 00:43:33.693461 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:43:33.693443    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a6d5bb09d44a99b539da48ade68e5bb2153439da86fcd2a1cbb25c1de312738\": container with ID starting with 5a6d5bb09d44a99b539da48ade68e5bb2153439da86fcd2a1cbb25c1de312738 not found: ID does not exist" containerID="5a6d5bb09d44a99b539da48ade68e5bb2153439da86fcd2a1cbb25c1de312738"
Jul 18 00:43:33.693510 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.693470    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a6d5bb09d44a99b539da48ade68e5bb2153439da86fcd2a1cbb25c1de312738"} err="failed to get container status \"5a6d5bb09d44a99b539da48ade68e5bb2153439da86fcd2a1cbb25c1de312738\": rpc error: code = NotFound desc = could not find container \"5a6d5bb09d44a99b539da48ade68e5bb2153439da86fcd2a1cbb25c1de312738\": container with ID starting with 5a6d5bb09d44a99b539da48ade68e5bb2153439da86fcd2a1cbb25c1de312738 not found: ID does not exist"
Jul 18 00:43:33.693510 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.693486    2575 scope.go:117] "RemoveContainer" containerID="af8c0da525c902d6def4aabef5e9deb3df0228fba98a3f242d41ff16698e46d6"
Jul 18 00:43:33.693727 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:43:33.693709    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af8c0da525c902d6def4aabef5e9deb3df0228fba98a3f242d41ff16698e46d6\": container with ID starting with af8c0da525c902d6def4aabef5e9deb3df0228fba98a3f242d41ff16698e46d6 not found: ID does not exist" containerID="af8c0da525c902d6def4aabef5e9deb3df0228fba98a3f242d41ff16698e46d6"
Jul 18 00:43:33.693791 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.693736    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af8c0da525c902d6def4aabef5e9deb3df0228fba98a3f242d41ff16698e46d6"} err="failed to get container status \"af8c0da525c902d6def4aabef5e9deb3df0228fba98a3f242d41ff16698e46d6\": rpc error: code = NotFound desc = could not find container \"af8c0da525c902d6def4aabef5e9deb3df0228fba98a3f242d41ff16698e46d6\": container with ID starting with af8c0da525c902d6def4aabef5e9deb3df0228fba98a3f242d41ff16698e46d6 not found: ID does not exist"
Jul 18 00:43:33.693791 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.693757    2575 scope.go:117] "RemoveContainer" containerID="7ef111d8ae40a8896a4005ffa2f88f4e760a90a8ca33c3eb6189aa9ce06ea7f9"
Jul 18 00:43:33.694070 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:43:33.694050    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ef111d8ae40a8896a4005ffa2f88f4e760a90a8ca33c3eb6189aa9ce06ea7f9\": container with ID starting with 7ef111d8ae40a8896a4005ffa2f88f4e760a90a8ca33c3eb6189aa9ce06ea7f9 not found: ID does not exist" containerID="7ef111d8ae40a8896a4005ffa2f88f4e760a90a8ca33c3eb6189aa9ce06ea7f9"
Jul 18 00:43:33.694127 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.694078    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ef111d8ae40a8896a4005ffa2f88f4e760a90a8ca33c3eb6189aa9ce06ea7f9"} err="failed to get container status \"7ef111d8ae40a8896a4005ffa2f88f4e760a90a8ca33c3eb6189aa9ce06ea7f9\": rpc error: code = NotFound desc = could not find container \"7ef111d8ae40a8896a4005ffa2f88f4e760a90a8ca33c3eb6189aa9ce06ea7f9\": container with ID starting with 7ef111d8ae40a8896a4005ffa2f88f4e760a90a8ca33c3eb6189aa9ce06ea7f9 not found: ID does not exist"
Jul 18 00:43:33.694127 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.694099    2575 scope.go:117] "RemoveContainer" containerID="9cd9261b4401a93148f51f68d609fbe6f4a63feb00b85456b50f5a6582ee4d50"
Jul 18 00:43:33.694346 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:43:33.694328    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cd9261b4401a93148f51f68d609fbe6f4a63feb00b85456b50f5a6582ee4d50\": container with ID starting with 9cd9261b4401a93148f51f68d609fbe6f4a63feb00b85456b50f5a6582ee4d50 not found: ID does not exist" containerID="9cd9261b4401a93148f51f68d609fbe6f4a63feb00b85456b50f5a6582ee4d50"
Jul 18 00:43:33.694422 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.694352    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cd9261b4401a93148f51f68d609fbe6f4a63feb00b85456b50f5a6582ee4d50"} err="failed to get container status \"9cd9261b4401a93148f51f68d609fbe6f4a63feb00b85456b50f5a6582ee4d50\": rpc error: code = NotFound desc = could not find container \"9cd9261b4401a93148f51f68d609fbe6f4a63feb00b85456b50f5a6582ee4d50\": container with ID starting with 9cd9261b4401a93148f51f68d609fbe6f4a63feb00b85456b50f5a6582ee4d50 not found: ID does not exist"
Jul 18 00:43:33.694422 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.694371    2575 scope.go:117] "RemoveContainer" containerID="1856e67eb67a3cdaaf1f5d54d5d89a2987092ad12e7456cb465b01155c9a9da5"
Jul 18 00:43:33.694635 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:43:33.694619    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1856e67eb67a3cdaaf1f5d54d5d89a2987092ad12e7456cb465b01155c9a9da5\": container with ID starting with 1856e67eb67a3cdaaf1f5d54d5d89a2987092ad12e7456cb465b01155c9a9da5 not found: ID does not exist" containerID="1856e67eb67a3cdaaf1f5d54d5d89a2987092ad12e7456cb465b01155c9a9da5"
Jul 18 00:43:33.694677 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.694640    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1856e67eb67a3cdaaf1f5d54d5d89a2987092ad12e7456cb465b01155c9a9da5"} err="failed to get container status \"1856e67eb67a3cdaaf1f5d54d5d89a2987092ad12e7456cb465b01155c9a9da5\": rpc error: code = NotFound desc = could not find container \"1856e67eb67a3cdaaf1f5d54d5d89a2987092ad12e7456cb465b01155c9a9da5\": container with ID starting with 1856e67eb67a3cdaaf1f5d54d5d89a2987092ad12e7456cb465b01155c9a9da5 not found: ID does not exist"
Jul 18 00:43:33.694677 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.694655    2575 scope.go:117] "RemoveContainer" containerID="284f0596f66ad4fc848ff53aef39b32098973d8d2ae58e2018087ea2bd4187dc"
Jul 18 00:43:33.694886 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:43:33.694859    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"284f0596f66ad4fc848ff53aef39b32098973d8d2ae58e2018087ea2bd4187dc\": container with ID starting with 284f0596f66ad4fc848ff53aef39b32098973d8d2ae58e2018087ea2bd4187dc not found: ID does not exist" containerID="284f0596f66ad4fc848ff53aef39b32098973d8d2ae58e2018087ea2bd4187dc"
Jul 18 00:43:33.694943 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.694881    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"284f0596f66ad4fc848ff53aef39b32098973d8d2ae58e2018087ea2bd4187dc"} err="failed to get container status \"284f0596f66ad4fc848ff53aef39b32098973d8d2ae58e2018087ea2bd4187dc\": rpc error: code = NotFound desc = could not find container \"284f0596f66ad4fc848ff53aef39b32098973d8d2ae58e2018087ea2bd4187dc\": container with ID starting with 284f0596f66ad4fc848ff53aef39b32098973d8d2ae58e2018087ea2bd4187dc not found: ID does not exist"
Jul 18 00:43:33.695575 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.695561    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.698162 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.698145    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 18 00:43:33.698280 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.698238    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 18 00:43:33.698350 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.698243    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 18 00:43:33.698506 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.698485    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 18 00:43:33.698569 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.698551    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 18 00:43:33.698621 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.698601    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 18 00:43:33.698729 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.698710    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 18 00:43:33.698968 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.698953    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 18 00:43:33.699030 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.698953    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bxkkw\""
Jul 18 00:43:33.705821 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.704545    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-config-out\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:33.705821 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.704583    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-main-tls\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:33.705821 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.704599    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4c4b\" (UniqueName: \"kubernetes.io/projected/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-kube-api-access-j4c4b\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:33.705821 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.704634    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-web-config\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:33.705821 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.704648    2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-cluster-tls-config\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:33.705821 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.704668    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-tls-assets\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:33.705821 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.704685    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:33.705821 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.704699    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-metrics-client-ca\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:33.705821 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.704712    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:33.705821 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.704731    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:33.705821 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.704745    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:33.705821 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.704758    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-alertmanager-main-db\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:33.705821 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.704772    2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d-config-volume\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:33.707214 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.707171    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 18 00:43:33.711889 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.711868    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 00:43:33.805811 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.805772    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/59f77baa-3b12-4df5-8d69-522741752b37-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.805811 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.805819    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59f77baa-3b12-4df5-8d69-522741752b37-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.806068 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.805836    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59f77baa-3b12-4df5-8d69-522741752b37-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.806068 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.805927    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/59f77baa-3b12-4df5-8d69-522741752b37-config-volume\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.806068 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.805963    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59f77baa-3b12-4df5-8d69-522741752b37-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.806068 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.806021    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc8nc\" (UniqueName: \"kubernetes.io/projected/59f77baa-3b12-4df5-8d69-522741752b37-kube-api-access-mc8nc\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.806068 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.806056    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/59f77baa-3b12-4df5-8d69-522741752b37-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.806303 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.806080    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59f77baa-3b12-4df5-8d69-522741752b37-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.806303 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.806107    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/59f77baa-3b12-4df5-8d69-522741752b37-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.806303 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.806139    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/59f77baa-3b12-4df5-8d69-522741752b37-tls-assets\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.806303 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.806155    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/59f77baa-3b12-4df5-8d69-522741752b37-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.806303 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.806202    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/59f77baa-3b12-4df5-8d69-522741752b37-config-out\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.806303 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.806217    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/59f77baa-3b12-4df5-8d69-522741752b37-web-config\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.907105 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.907014    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc8nc\" (UniqueName: \"kubernetes.io/projected/59f77baa-3b12-4df5-8d69-522741752b37-kube-api-access-mc8nc\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.907105 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.907053    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/59f77baa-3b12-4df5-8d69-522741752b37-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.907105 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.907070    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59f77baa-3b12-4df5-8d69-522741752b37-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.907105 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.907088    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/59f77baa-3b12-4df5-8d69-522741752b37-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.907105 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.907107    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/59f77baa-3b12-4df5-8d69-522741752b37-tls-assets\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.907487 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.907131    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/59f77baa-3b12-4df5-8d69-522741752b37-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.907487 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.907172    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/59f77baa-3b12-4df5-8d69-522741752b37-config-out\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.907487 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.907221    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/59f77baa-3b12-4df5-8d69-522741752b37-web-config\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.907487 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.907257    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/59f77baa-3b12-4df5-8d69-522741752b37-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.907487 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.907292    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59f77baa-3b12-4df5-8d69-522741752b37-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.907487 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.907312    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59f77baa-3b12-4df5-8d69-522741752b37-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.907487 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.907342    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/59f77baa-3b12-4df5-8d69-522741752b37-config-volume\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.907487 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.907367    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59f77baa-3b12-4df5-8d69-522741752b37-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.907939 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.907564    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/59f77baa-3b12-4df5-8d69-522741752b37-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.907939 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.907827    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59f77baa-3b12-4df5-8d69-522741752b37-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.910501 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.910475    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/59f77baa-3b12-4df5-8d69-522741752b37-config-out\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.910501 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.910488    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/59f77baa-3b12-4df5-8d69-522741752b37-tls-assets\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.910687 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.910538    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/59f77baa-3b12-4df5-8d69-522741752b37-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.910687 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.910596    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59f77baa-3b12-4df5-8d69-522741752b37-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.910780 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.910702    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59f77baa-3b12-4df5-8d69-522741752b37-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.910842 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.910773    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/59f77baa-3b12-4df5-8d69-522741752b37-web-config\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.910972 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.910946    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/59f77baa-3b12-4df5-8d69-522741752b37-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.911039 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.911018    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/59f77baa-3b12-4df5-8d69-522741752b37-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.911206 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.911169    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59f77baa-3b12-4df5-8d69-522741752b37-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.912511 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.912486    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/59f77baa-3b12-4df5-8d69-522741752b37-config-volume\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:33.915436 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:33.915419    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc8nc\" (UniqueName: \"kubernetes.io/projected/59f77baa-3b12-4df5-8d69-522741752b37-kube-api-access-mc8nc\") pod \"alertmanager-main-0\" (UID: \"59f77baa-3b12-4df5-8d69-522741752b37\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:34.007799 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:34.007760    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 18 00:43:34.138831 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:34.138802    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 00:43:34.143670 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:43:34.143634    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f77baa_3b12_4df5_8d69_522741752b37.slice/crio-e5117c3cf1496ea7abf8e3f6fbe98b0544fc6d2df603793c88675a4a7b763f3a WatchSource:0}: Error finding container e5117c3cf1496ea7abf8e3f6fbe98b0544fc6d2df603793c88675a4a7b763f3a: Status 404 returned error can't find the container with id e5117c3cf1496ea7abf8e3f6fbe98b0544fc6d2df603793c88675a4a7b763f3a
Jul 18 00:43:34.643424 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:34.643387    2575 generic.go:356] "Generic (PLEG): container finished" podID="59f77baa-3b12-4df5-8d69-522741752b37" containerID="393c1d74c22475e70a0d4fed68a5703510ae7d3912555606370a1784a2a15c13" exitCode=0
Jul 18 00:43:34.643846 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:34.643468    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59f77baa-3b12-4df5-8d69-522741752b37","Type":"ContainerDied","Data":"393c1d74c22475e70a0d4fed68a5703510ae7d3912555606370a1784a2a15c13"}
Jul 18 00:43:34.643846 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:34.643534    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59f77baa-3b12-4df5-8d69-522741752b37","Type":"ContainerStarted","Data":"e5117c3cf1496ea7abf8e3f6fbe98b0544fc6d2df603793c88675a4a7b763f3a"}
Jul 18 00:43:34.679048 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:34.679022    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d" path="/var/lib/kubelet/pods/ca1a1e6e-b27c-4ab4-ba6e-e40d5dfa503d/volumes"
Jul 18 00:43:35.652039 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:35.651997    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59f77baa-3b12-4df5-8d69-522741752b37","Type":"ContainerStarted","Data":"1be8c6870eb09c8e7920cb1e5e5d9179d649e862dd2f3e7d35666a8b8e1530bb"}
Jul 18 00:43:35.652427 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:35.652089    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59f77baa-3b12-4df5-8d69-522741752b37","Type":"ContainerStarted","Data":"d6b485d71f2c7d263e736e87ddab3c561cb91752fb81a5c6e73aa89ef1a25f85"}
Jul 18 00:43:35.652427 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:35.652134    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59f77baa-3b12-4df5-8d69-522741752b37","Type":"ContainerStarted","Data":"dc10f0a5b3eb91d9d485f5fe181059019c3bc39f5db233bd36d76370bd25c06f"}
Jul 18 00:43:35.652427 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:35.652168    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59f77baa-3b12-4df5-8d69-522741752b37","Type":"ContainerStarted","Data":"301c776ea433f17eff6a8e9cb2197a63106bf937c3d80082c0ce0fb481c7d061"}
Jul 18 00:43:35.652427 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:35.652227    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59f77baa-3b12-4df5-8d69-522741752b37","Type":"ContainerStarted","Data":"33526b240c13c253106d556b2a3b8bdacf0fe3e67ca873b18a68b71290a3c90b"}
Jul 18 00:43:35.652427 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:35.652261    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"59f77baa-3b12-4df5-8d69-522741752b37","Type":"ContainerStarted","Data":"0fe05e1c566df0c06ad35b91e207ba8f8b76f73bafcee2042cdf3b1193e912e3"}
Jul 18 00:43:35.694215 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:35.693523    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.678825492 podStartE2EDuration="2.693504257s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.678765ms" isStatefulPod=false podCreationTimestamp="2026-07-18 00:43:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:43:35.693081859 +0000 UTC m=+183.482493937" watchObservedRunningTime="2026-07-18 00:43:35.693504257 +0000 UTC m=+183.482916315"
Jul 18 00:43:36.651961 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.650252    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 00:43:36.651961 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.650779    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="prometheus" containerID="cri-o://1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26" gracePeriod=600
Jul 18 00:43:36.651961 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.651006    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="kube-rbac-proxy" containerID="cri-o://c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376" gracePeriod=600
Jul 18 00:43:36.651961 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.651174    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="kube-rbac-proxy-web" containerID="cri-o://1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060" gracePeriod=600
Jul 18 00:43:36.651961 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.651233    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="config-reloader" containerID="cri-o://4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830" gracePeriod=600
Jul 18 00:43:36.651961 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.651230    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="kube-rbac-proxy-thanos" containerID="cri-o://abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7" gracePeriod=600
Jul 18 00:43:36.651961 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.651356    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="thanos-sidecar" containerID="cri-o://de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462" gracePeriod=600
Jul 18 00:43:36.888290 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.888268    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:36.935859 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.935774    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e8c3176-9b62-4081-bbaf-21b60a57d639-config-out\") pod \"1e8c3176-9b62-4081-bbaf-21b60a57d639\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") "
Jul 18 00:43:36.935859 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.935813    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1e8c3176-9b62-4081-bbaf-21b60a57d639\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") "
Jul 18 00:43:36.936078 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.935860    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-thanos-prometheus-http-client-file\") pod \"1e8c3176-9b62-4081-bbaf-21b60a57d639\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") "
Jul 18 00:43:36.936078 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.935896    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-kube-rbac-proxy\") pod \"1e8c3176-9b62-4081-bbaf-21b60a57d639\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") "
Jul 18 00:43:36.936078 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.935920    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-prometheus-k8s-tls\") pod \"1e8c3176-9b62-4081-bbaf-21b60a57d639\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") "
Jul 18 00:43:36.936078 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.935942    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e8c3176-9b62-4081-bbaf-21b60a57d639-tls-assets\") pod \"1e8c3176-9b62-4081-bbaf-21b60a57d639\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") "
Jul 18 00:43:36.936078 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.935970    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-trusted-ca-bundle\") pod \"1e8c3176-9b62-4081-bbaf-21b60a57d639\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") "
Jul 18 00:43:36.936404 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.936364    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-web-config\") pod \"1e8c3176-9b62-4081-bbaf-21b60a57d639\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") "
Jul 18 00:43:36.936461 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.936411    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-configmap-kubelet-serving-ca-bundle\") pod \"1e8c3176-9b62-4081-bbaf-21b60a57d639\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") "
Jul 18 00:43:36.936461 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.936410    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1e8c3176-9b62-4081-bbaf-21b60a57d639" (UID: "1e8c3176-9b62-4081-bbaf-21b60a57d639"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 00:43:36.936461 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.936442    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-configmap-serving-certs-ca-bundle\") pod \"1e8c3176-9b62-4081-bbaf-21b60a57d639\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") "
Jul 18 00:43:36.936607 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.936477    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-configmap-metrics-client-ca\") pod \"1e8c3176-9b62-4081-bbaf-21b60a57d639\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") "
Jul 18 00:43:36.936607 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.936534    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-rulefiles-0\") pod \"1e8c3176-9b62-4081-bbaf-21b60a57d639\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") "
Jul 18 00:43:36.936757 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.936736    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-rulefiles-1\") pod \"1e8c3176-9b62-4081-bbaf-21b60a57d639\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") "
Jul 18 00:43:36.936816 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.936777    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-config\") pod \"1e8c3176-9b62-4081-bbaf-21b60a57d639\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") "
Jul 18 00:43:36.936816 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.936810    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1e8c3176-9b62-4081-bbaf-21b60a57d639\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") "
Jul 18 00:43:36.936919 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.936842    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-grpc-tls\") pod \"1e8c3176-9b62-4081-bbaf-21b60a57d639\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") "
Jul 18 00:43:36.936919 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.936873    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-db\") pod \"1e8c3176-9b62-4081-bbaf-21b60a57d639\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") "
Jul 18 00:43:36.936919 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.936898    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-rulefiles-2\") pod \"1e8c3176-9b62-4081-bbaf-21b60a57d639\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") "
Jul 18 00:43:36.937063 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.936936    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-metrics-client-certs\") pod \"1e8c3176-9b62-4081-bbaf-21b60a57d639\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") "
Jul 18 00:43:36.937063 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.936949    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1e8c3176-9b62-4081-bbaf-21b60a57d639" (UID: "1e8c3176-9b62-4081-bbaf-21b60a57d639"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 00:43:36.937063 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.936957    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1e8c3176-9b62-4081-bbaf-21b60a57d639" (UID: "1e8c3176-9b62-4081-bbaf-21b60a57d639"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 00:43:36.937063 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.936963    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjxww\" (UniqueName: \"kubernetes.io/projected/1e8c3176-9b62-4081-bbaf-21b60a57d639-kube-api-access-hjxww\") pod \"1e8c3176-9b62-4081-bbaf-21b60a57d639\" (UID: \"1e8c3176-9b62-4081-bbaf-21b60a57d639\") "
Jul 18 00:43:36.937456 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.937342    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:36.937456 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.937368    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:36.937456 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.937384    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-configmap-metrics-client-ca\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:36.938365 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.937774    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1e8c3176-9b62-4081-bbaf-21b60a57d639" (UID: "1e8c3176-9b62-4081-bbaf-21b60a57d639"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 00:43:36.938365 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.937924    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1e8c3176-9b62-4081-bbaf-21b60a57d639" (UID: "1e8c3176-9b62-4081-bbaf-21b60a57d639"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 00:43:36.938365 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.937999    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1e8c3176-9b62-4081-bbaf-21b60a57d639" (UID: "1e8c3176-9b62-4081-bbaf-21b60a57d639"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 00:43:36.939703 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.939673    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1e8c3176-9b62-4081-bbaf-21b60a57d639" (UID: "1e8c3176-9b62-4081-bbaf-21b60a57d639"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 00:43:36.940778 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.940753    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1e8c3176-9b62-4081-bbaf-21b60a57d639" (UID: "1e8c3176-9b62-4081-bbaf-21b60a57d639"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 00:43:36.941434 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.941382    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1e8c3176-9b62-4081-bbaf-21b60a57d639" (UID: "1e8c3176-9b62-4081-bbaf-21b60a57d639"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:43:36.941434 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.941408    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1e8c3176-9b62-4081-bbaf-21b60a57d639" (UID: "1e8c3176-9b62-4081-bbaf-21b60a57d639"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:43:36.941711 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.941449    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1e8c3176-9b62-4081-bbaf-21b60a57d639" (UID: "1e8c3176-9b62-4081-bbaf-21b60a57d639"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:43:36.941993 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.941870    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-config" (OuterVolumeSpecName: "config") pod "1e8c3176-9b62-4081-bbaf-21b60a57d639" (UID: "1e8c3176-9b62-4081-bbaf-21b60a57d639"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:43:36.941993 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.941958    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e8c3176-9b62-4081-bbaf-21b60a57d639-config-out" (OuterVolumeSpecName: "config-out") pod "1e8c3176-9b62-4081-bbaf-21b60a57d639" (UID: "1e8c3176-9b62-4081-bbaf-21b60a57d639"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 00:43:36.941993 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.941975    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1e8c3176-9b62-4081-bbaf-21b60a57d639" (UID: "1e8c3176-9b62-4081-bbaf-21b60a57d639"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:43:36.942426 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.942382    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1e8c3176-9b62-4081-bbaf-21b60a57d639" (UID: "1e8c3176-9b62-4081-bbaf-21b60a57d639"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:43:36.942524 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.942460    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e8c3176-9b62-4081-bbaf-21b60a57d639-kube-api-access-hjxww" (OuterVolumeSpecName: "kube-api-access-hjxww") pod "1e8c3176-9b62-4081-bbaf-21b60a57d639" (UID: "1e8c3176-9b62-4081-bbaf-21b60a57d639"). InnerVolumeSpecName "kube-api-access-hjxww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 00:43:36.942524 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.942470    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1e8c3176-9b62-4081-bbaf-21b60a57d639" (UID: "1e8c3176-9b62-4081-bbaf-21b60a57d639"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:43:36.942639 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.942538    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e8c3176-9b62-4081-bbaf-21b60a57d639-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1e8c3176-9b62-4081-bbaf-21b60a57d639" (UID: "1e8c3176-9b62-4081-bbaf-21b60a57d639"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 00:43:36.943255 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.943164    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1e8c3176-9b62-4081-bbaf-21b60a57d639" (UID: "1e8c3176-9b62-4081-bbaf-21b60a57d639"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:43:36.952022 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:36.951996    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-web-config" (OuterVolumeSpecName: "web-config") pod "1e8c3176-9b62-4081-bbaf-21b60a57d639" (UID: "1e8c3176-9b62-4081-bbaf-21b60a57d639"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:43:37.038590 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.038560    2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:37.038590 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.038586    2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-kube-rbac-proxy\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:37.038590 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.038596    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:37.038774 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.038605    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e8c3176-9b62-4081-bbaf-21b60a57d639-tls-assets\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:37.038774 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.038614    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-web-config\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:37.038774 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.038622    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:37.038774 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.038630    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:37.038774 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.038638    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:37.038774 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.038645    2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-config\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:37.038774 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.038655    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:37.038774 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.038664    2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-grpc-tls\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:37.038774 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.038672    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-db\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:37.038774 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.038680    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1e8c3176-9b62-4081-bbaf-21b60a57d639-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:37.038774 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.038688    2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-metrics-client-certs\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:37.038774 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.038695    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjxww\" (UniqueName: \"kubernetes.io/projected/1e8c3176-9b62-4081-bbaf-21b60a57d639-kube-api-access-hjxww\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:37.038774 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.038703    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e8c3176-9b62-4081-bbaf-21b60a57d639-config-out\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:37.038774 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.038711    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1e8c3176-9b62-4081-bbaf-21b60a57d639-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:43:37.672349 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.672321    2575 generic.go:356] "Generic (PLEG): container finished" podID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerID="abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7" exitCode=0
Jul 18 00:43:37.672349 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.672346    2575 generic.go:356] "Generic (PLEG): container finished" podID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerID="c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376" exitCode=0
Jul 18 00:43:37.672796 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.672355    2575 generic.go:356] "Generic (PLEG): container finished" podID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerID="1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060" exitCode=0
Jul 18 00:43:37.672796 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.672363    2575 generic.go:356] "Generic (PLEG): container finished" podID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerID="de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462" exitCode=0
Jul 18 00:43:37.672796 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.672370    2575 generic.go:356] "Generic (PLEG): container finished" podID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerID="4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830" exitCode=0
Jul 18 00:43:37.672796 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.672378    2575 generic.go:356] "Generic (PLEG): container finished" podID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerID="1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26" exitCode=0
Jul 18 00:43:37.672796 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.672408    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e8c3176-9b62-4081-bbaf-21b60a57d639","Type":"ContainerDied","Data":"abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7"}
Jul 18 00:43:37.672796 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.672468    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e8c3176-9b62-4081-bbaf-21b60a57d639","Type":"ContainerDied","Data":"c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376"}
Jul 18 00:43:37.672796 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.672419    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.672796 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.672494    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e8c3176-9b62-4081-bbaf-21b60a57d639","Type":"ContainerDied","Data":"1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060"}
Jul 18 00:43:37.672796 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.672522    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e8c3176-9b62-4081-bbaf-21b60a57d639","Type":"ContainerDied","Data":"de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462"}
Jul 18 00:43:37.672796 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.672546    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e8c3176-9b62-4081-bbaf-21b60a57d639","Type":"ContainerDied","Data":"4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830"}
Jul 18 00:43:37.672796 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.672571    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e8c3176-9b62-4081-bbaf-21b60a57d639","Type":"ContainerDied","Data":"1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26"}
Jul 18 00:43:37.672796 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.672585    2575 scope.go:117] "RemoveContainer" containerID="abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7"
Jul 18 00:43:37.672796 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.672602    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e8c3176-9b62-4081-bbaf-21b60a57d639","Type":"ContainerDied","Data":"7a90e8bfd472f9b7e1d19d08ccc75351bb05faadc3a7ab8b648a6942f33e1849"}
Jul 18 00:43:37.680559 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.680390    2575 scope.go:117] "RemoveContainer" containerID="c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376"
Jul 18 00:43:37.687823 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.687805    2575 scope.go:117] "RemoveContainer" containerID="1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060"
Jul 18 00:43:37.694903 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.694886    2575 scope.go:117] "RemoveContainer" containerID="de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462"
Jul 18 00:43:37.695832 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.695713    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 00:43:37.701101 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.701078    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 00:43:37.702865 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.702851    2575 scope.go:117] "RemoveContainer" containerID="4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830"
Jul 18 00:43:37.709700 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.709685    2575 scope.go:117] "RemoveContainer" containerID="1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26"
Jul 18 00:43:37.717078 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.717058    2575 scope.go:117] "RemoveContainer" containerID="b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598"
Jul 18 00:43:37.723906 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.723884    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 00:43:37.724359 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.724342    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="config-reloader"
Jul 18 00:43:37.724398 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.724365    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="config-reloader"
Jul 18 00:43:37.724398 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.724386    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="prometheus"
Jul 18 00:43:37.724398 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.724397    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="prometheus"
Jul 18 00:43:37.724495 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.724409    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="kube-rbac-proxy"
Jul 18 00:43:37.724495 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.724418    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="kube-rbac-proxy"
Jul 18 00:43:37.724495 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.724430    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="init-config-reloader"
Jul 18 00:43:37.724495 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.724438    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="init-config-reloader"
Jul 18 00:43:37.724495 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.724450    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="thanos-sidecar"
Jul 18 00:43:37.724495 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.724459    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="thanos-sidecar"
Jul 18 00:43:37.724495 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.724493    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="kube-rbac-proxy-thanos"
Jul 18 00:43:37.724684 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.724503    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="kube-rbac-proxy-thanos"
Jul 18 00:43:37.724684 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.724515    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="kube-rbac-proxy-web"
Jul 18 00:43:37.724684 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.724524    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="kube-rbac-proxy-web"
Jul 18 00:43:37.724684 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.724597    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="prometheus"
Jul 18 00:43:37.724684 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.724609    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="thanos-sidecar"
Jul 18 00:43:37.724684 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.724619    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="kube-rbac-proxy"
Jul 18 00:43:37.724684 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.724629    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="kube-rbac-proxy-thanos"
Jul 18 00:43:37.724684 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.724640    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="kube-rbac-proxy-web"
Jul 18 00:43:37.724684 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.724653    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" containerName="config-reloader"
Jul 18 00:43:37.725372 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.725350    2575 scope.go:117] "RemoveContainer" containerID="abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7"
Jul 18 00:43:37.725648 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:43:37.725630    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7\": container with ID starting with abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7 not found: ID does not exist" containerID="abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7"
Jul 18 00:43:37.725721 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.725658    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7"} err="failed to get container status \"abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7\": rpc error: code = NotFound desc = could not find container \"abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7\": container with ID starting with abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7 not found: ID does not exist"
Jul 18 00:43:37.725721 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.725678    2575 scope.go:117] "RemoveContainer" containerID="c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376"
Jul 18 00:43:37.725930 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:43:37.725916    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376\": container with ID starting with c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376 not found: ID does not exist" containerID="c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376"
Jul 18 00:43:37.725974 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.725933    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376"} err="failed to get container status \"c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376\": rpc error: code = NotFound desc = could not find container \"c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376\": container with ID starting with c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376 not found: ID does not exist"
Jul 18 00:43:37.725974 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.725946    2575 scope.go:117] "RemoveContainer" containerID="1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060"
Jul 18 00:43:37.726210 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:43:37.726173    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060\": container with ID starting with 1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060 not found: ID does not exist" containerID="1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060"
Jul 18 00:43:37.726287 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.726217    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060"} err="failed to get container status \"1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060\": rpc error: code = NotFound desc = could not find container \"1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060\": container with ID starting with 1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060 not found: ID does not exist"
Jul 18 00:43:37.726287 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.726239    2575 scope.go:117] "RemoveContainer" containerID="de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462"
Jul 18 00:43:37.726483 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:43:37.726466    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462\": container with ID starting with de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462 not found: ID does not exist" containerID="de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462"
Jul 18 00:43:37.726547 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.726490    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462"} err="failed to get container status \"de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462\": rpc error: code = NotFound desc = could not find container \"de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462\": container with ID starting with de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462 not found: ID does not exist"
Jul 18 00:43:37.726547 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.726508    2575 scope.go:117] "RemoveContainer" containerID="4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830"
Jul 18 00:43:37.726718 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:43:37.726696    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830\": container with ID starting with 4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830 not found: ID does not exist" containerID="4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830"
Jul 18 00:43:37.726768 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.726724    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830"} err="failed to get container status \"4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830\": rpc error: code = NotFound desc = could not find container \"4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830\": container with ID starting with 4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830 not found: ID does not exist"
Jul 18 00:43:37.726768 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.726748    2575 scope.go:117] "RemoveContainer" containerID="1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26"
Jul 18 00:43:37.726983 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:43:37.726964    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26\": container with ID starting with 1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26 not found: ID does not exist" containerID="1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26"
Jul 18 00:43:37.727049 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.726989    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26"} err="failed to get container status \"1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26\": rpc error: code = NotFound desc = could not find container \"1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26\": container with ID starting with 1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26 not found: ID does not exist"
Jul 18 00:43:37.727049 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.727003    2575 scope.go:117] "RemoveContainer" containerID="b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598"
Jul 18 00:43:37.727356 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:43:37.727336    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598\": container with ID starting with b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598 not found: ID does not exist" containerID="b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598"
Jul 18 00:43:37.727440 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.727359    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598"} err="failed to get container status \"b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598\": rpc error: code = NotFound desc = could not find container \"b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598\": container with ID starting with b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598 not found: ID does not exist"
Jul 18 00:43:37.727440 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.727372    2575 scope.go:117] "RemoveContainer" containerID="abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7"
Jul 18 00:43:37.727636 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.727618    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7"} err="failed to get container status \"abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7\": rpc error: code = NotFound desc = could not find container \"abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7\": container with ID starting with abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7 not found: ID does not exist"
Jul 18 00:43:37.727680 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.727638    2575 scope.go:117] "RemoveContainer" containerID="c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376"
Jul 18 00:43:37.727871 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.727852    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376"} err="failed to get container status \"c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376\": rpc error: code = NotFound desc = could not find container \"c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376\": container with ID starting with c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376 not found: ID does not exist"
Jul 18 00:43:37.727871 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.727870    2575 scope.go:117] "RemoveContainer" containerID="1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060"
Jul 18 00:43:37.728093 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.728076    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060"} err="failed to get container status \"1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060\": rpc error: code = NotFound desc = could not find container \"1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060\": container with ID starting with 1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060 not found: ID does not exist"
Jul 18 00:43:37.728141 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.728094    2575 scope.go:117] "RemoveContainer" containerID="de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462"
Jul 18 00:43:37.728321 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.728305    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462"} err="failed to get container status \"de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462\": rpc error: code = NotFound desc = could not find container \"de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462\": container with ID starting with de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462 not found: ID does not exist"
Jul 18 00:43:37.728321 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.728322    2575 scope.go:117] "RemoveContainer" containerID="4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830"
Jul 18 00:43:37.728544 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.728529    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830"} err="failed to get container status \"4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830\": rpc error: code = NotFound desc = could not find container \"4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830\": container with ID starting with 4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830 not found: ID does not exist"
Jul 18 00:43:37.728592 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.728546    2575 scope.go:117] "RemoveContainer" containerID="1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26"
Jul 18 00:43:37.728676 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.728656    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.728750 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.728738    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26"} err="failed to get container status \"1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26\": rpc error: code = NotFound desc = could not find container \"1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26\": container with ID starting with 1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26 not found: ID does not exist"
Jul 18 00:43:37.728789 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.728754    2575 scope.go:117] "RemoveContainer" containerID="b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598"
Jul 18 00:43:37.729009 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.728979    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598"} err="failed to get container status \"b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598\": rpc error: code = NotFound desc = could not find container \"b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598\": container with ID starting with b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598 not found: ID does not exist"
Jul 18 00:43:37.729096 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.729010    2575 scope.go:117] "RemoveContainer" containerID="abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7"
Jul 18 00:43:37.729380 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.729354    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7"} err="failed to get container status \"abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7\": rpc error: code = NotFound desc = could not find container \"abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7\": container with ID starting with abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7 not found: ID does not exist"
Jul 18 00:43:37.729461 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.729383    2575 scope.go:117] "RemoveContainer" containerID="c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376"
Jul 18 00:43:37.729633 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.729615    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376"} err="failed to get container status \"c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376\": rpc error: code = NotFound desc = could not find container \"c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376\": container with ID starting with c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376 not found: ID does not exist"
Jul 18 00:43:37.729705 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.729636    2575 scope.go:117] "RemoveContainer" containerID="1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060"
Jul 18 00:43:37.729874 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.729857    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060"} err="failed to get container status \"1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060\": rpc error: code = NotFound desc = could not find container \"1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060\": container with ID starting with 1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060 not found: ID does not exist"
Jul 18 00:43:37.729921 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.729875    2575 scope.go:117] "RemoveContainer" containerID="de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462"
Jul 18 00:43:37.730093 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.730070    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462"} err="failed to get container status \"de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462\": rpc error: code = NotFound desc = could not find container \"de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462\": container with ID starting with de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462 not found: ID does not exist"
Jul 18 00:43:37.730093 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.730092    2575 scope.go:117] "RemoveContainer" containerID="4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830"
Jul 18 00:43:37.730387 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.730370    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830"} err="failed to get container status \"4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830\": rpc error: code = NotFound desc = could not find container \"4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830\": container with ID starting with 4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830 not found: ID does not exist"
Jul 18 00:43:37.730441 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.730390    2575 scope.go:117] "RemoveContainer" containerID="1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26"
Jul 18 00:43:37.730635 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.730614    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26"} err="failed to get container status \"1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26\": rpc error: code = NotFound desc = could not find container \"1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26\": container with ID starting with 1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26 not found: ID does not exist"
Jul 18 00:43:37.730674 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.730638    2575 scope.go:117] "RemoveContainer" containerID="b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598"
Jul 18 00:43:37.730867 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.730850    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598"} err="failed to get container status \"b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598\": rpc error: code = NotFound desc = could not find container \"b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598\": container with ID starting with b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598 not found: ID does not exist"
Jul 18 00:43:37.730923 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.730869    2575 scope.go:117] "RemoveContainer" containerID="abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7"
Jul 18 00:43:37.731127 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.731102    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7"} err="failed to get container status \"abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7\": rpc error: code = NotFound desc = could not find container \"abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7\": container with ID starting with abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7 not found: ID does not exist"
Jul 18 00:43:37.731240 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.731213    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dfhanm7nsptjd\""
Jul 18 00:43:37.731315 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.731239    2575 scope.go:117] "RemoveContainer" containerID="c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376"
Jul 18 00:43:37.731491 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.731405    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 18 00:43:37.731491 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.731443    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 18 00:43:37.731491 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.731466    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 18 00:43:37.731666 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.731509    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 18 00:43:37.731718 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.731685    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 18 00:43:37.731718 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.731707    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 18 00:43:37.731829 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.731742    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 18 00:43:37.731829 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.731742    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 18 00:43:37.731829 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.731783    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 18 00:43:37.732109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.731902    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376"} err="failed to get container status \"c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376\": rpc error: code = NotFound desc = could not find container \"c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376\": container with ID starting with c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376 not found: ID does not exist"
Jul 18 00:43:37.732109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.731950    2575 scope.go:117] "RemoveContainer" containerID="1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060"
Jul 18 00:43:37.732109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.732044    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 18 00:43:37.732109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.732080    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 18 00:43:37.732314 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.732084    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 18 00:43:37.732314 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.732087    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rbxql\""
Jul 18 00:43:37.732574 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.732552    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060"} err="failed to get container status \"1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060\": rpc error: code = NotFound desc = could not find container \"1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060\": container with ID starting with 1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060 not found: ID does not exist"
Jul 18 00:43:37.732574 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.732574    2575 scope.go:117] "RemoveContainer" containerID="de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462"
Jul 18 00:43:37.732844 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.732822    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462"} err="failed to get container status \"de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462\": rpc error: code = NotFound desc = could not find container \"de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462\": container with ID starting with de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462 not found: ID does not exist"
Jul 18 00:43:37.732917 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.732846    2575 scope.go:117] "RemoveContainer" containerID="4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830"
Jul 18 00:43:37.733051 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.733032    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830"} err="failed to get container status \"4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830\": rpc error: code = NotFound desc = could not find container \"4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830\": container with ID starting with 4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830 not found: ID does not exist"
Jul 18 00:43:37.733051 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.733052    2575 scope.go:117] "RemoveContainer" containerID="1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26"
Jul 18 00:43:37.733342 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.733318    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26"} err="failed to get container status \"1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26\": rpc error: code = NotFound desc = could not find container \"1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26\": container with ID starting with 1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26 not found: ID does not exist"
Jul 18 00:43:37.733429 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.733343    2575 scope.go:117] "RemoveContainer" containerID="b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598"
Jul 18 00:43:37.733603 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.733573    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598"} err="failed to get container status \"b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598\": rpc error: code = NotFound desc = could not find container \"b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598\": container with ID starting with b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598 not found: ID does not exist"
Jul 18 00:43:37.733603 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.733597    2575 scope.go:117] "RemoveContainer" containerID="abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7"
Jul 18 00:43:37.734163 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.734137    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7"} err="failed to get container status \"abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7\": rpc error: code = NotFound desc = could not find container \"abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7\": container with ID starting with abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7 not found: ID does not exist"
Jul 18 00:43:37.734307 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.734164    2575 scope.go:117] "RemoveContainer" containerID="c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376"
Jul 18 00:43:37.734477 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.734455    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376"} err="failed to get container status \"c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376\": rpc error: code = NotFound desc = could not find container \"c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376\": container with ID starting with c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376 not found: ID does not exist"
Jul 18 00:43:37.734530 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.734482    2575 scope.go:117] "RemoveContainer" containerID="1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060"
Jul 18 00:43:37.734845 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.734727    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 18 00:43:37.734845 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.734721    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060"} err="failed to get container status \"1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060\": rpc error: code = NotFound desc = could not find container \"1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060\": container with ID starting with 1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060 not found: ID does not exist"
Jul 18 00:43:37.734845 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.734756    2575 scope.go:117] "RemoveContainer" containerID="de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462"
Jul 18 00:43:37.735076 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.735007    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462"} err="failed to get container status \"de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462\": rpc error: code = NotFound desc = could not find container \"de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462\": container with ID starting with de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462 not found: ID does not exist"
Jul 18 00:43:37.735076 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.735029    2575 scope.go:117] "RemoveContainer" containerID="4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830"
Jul 18 00:43:37.735322 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.735284    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830"} err="failed to get container status \"4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830\": rpc error: code = NotFound desc = could not find container \"4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830\": container with ID starting with 4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830 not found: ID does not exist"
Jul 18 00:43:37.735322 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.735313    2575 scope.go:117] "RemoveContainer" containerID="1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26"
Jul 18 00:43:37.735521 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.735489    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26"} err="failed to get container status \"1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26\": rpc error: code = NotFound desc = could not find container \"1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26\": container with ID starting with 1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26 not found: ID does not exist"
Jul 18 00:43:37.735521 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.735511    2575 scope.go:117] "RemoveContainer" containerID="b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598"
Jul 18 00:43:37.735828 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.735782    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598"} err="failed to get container status \"b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598\": rpc error: code = NotFound desc = could not find container \"b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598\": container with ID starting with b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598 not found: ID does not exist"
Jul 18 00:43:37.735828 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.735808    2575 scope.go:117] "RemoveContainer" containerID="abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7"
Jul 18 00:43:37.736112 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.736093    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7"} err="failed to get container status \"abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7\": rpc error: code = NotFound desc = could not find container \"abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7\": container with ID starting with abee21bab189916d0e985cac31cb140b0e7b24711b7989ff8fce7b51c3dd92e7 not found: ID does not exist"
Jul 18 00:43:37.736211 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.736114    2575 scope.go:117] "RemoveContainer" containerID="c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376"
Jul 18 00:43:37.736395 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.736370    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376"} err="failed to get container status \"c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376\": rpc error: code = NotFound desc = could not find container \"c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376\": container with ID starting with c1016af6dc1bf02548f2f8f7e79996a41710272c623d2f2e768ccf1afd1a3376 not found: ID does not exist"
Jul 18 00:43:37.736395 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.736393    2575 scope.go:117] "RemoveContainer" containerID="1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060"
Jul 18 00:43:37.736632 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.736610    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060"} err="failed to get container status \"1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060\": rpc error: code = NotFound desc = could not find container \"1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060\": container with ID starting with 1b633f9fe8c3f857ef09a19acfadd654dd272e0301929c7acca7988e4598f060 not found: ID does not exist"
Jul 18 00:43:37.736632 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.736632    2575 scope.go:117] "RemoveContainer" containerID="de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462"
Jul 18 00:43:37.736810 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.736777    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 18 00:43:37.737002 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.736888    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462"} err="failed to get container status \"de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462\": rpc error: code = NotFound desc = could not find container \"de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462\": container with ID starting with de0fa141500f43c2137293eea57cd1c7d352bdd1e38abe47752a94bde0e31462 not found: ID does not exist"
Jul 18 00:43:37.737002 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.736911    2575 scope.go:117] "RemoveContainer" containerID="4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830"
Jul 18 00:43:37.737370 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.737336    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830"} err="failed to get container status \"4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830\": rpc error: code = NotFound desc = could not find container \"4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830\": container with ID starting with 4f15e6672bce921db104d2c8edb7b9f0b7184d1f651062bf877ad930ba113830 not found: ID does not exist"
Jul 18 00:43:37.737370 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.737360    2575 scope.go:117] "RemoveContainer" containerID="1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26"
Jul 18 00:43:37.737616 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.737597    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26"} err="failed to get container status \"1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26\": rpc error: code = NotFound desc = could not find container \"1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26\": container with ID starting with 1ed558ebda8cd4f2631ea5e4bae22873d09bca5cf9a58aa844386a30f16b0c26 not found: ID does not exist"
Jul 18 00:43:37.737668 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.737618    2575 scope.go:117] "RemoveContainer" containerID="b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598"
Jul 18 00:43:37.737889 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.737871    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598"} err="failed to get container status \"b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598\": rpc error: code = NotFound desc = could not find container \"b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598\": container with ID starting with b510e07950fa718cd0f27063fd9d4a6c2e38bb98edc0de5c3198c69ead192598 not found: ID does not exist"
Jul 18 00:43:37.747100 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.747075    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 00:43:37.847853 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.847818    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bf31fd8-2f99-4e22-a70d-199fe4c89789-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.848063 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.847861    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bf31fd8-2f99-4e22-a70d-199fe4c89789-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.848063 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.847885    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.848063 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.847900    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.848063 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.847957    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bf31fd8-2f99-4e22-a70d-199fe4c89789-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.848063 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.848016    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-config\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.848063 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.848043    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bf31fd8-2f99-4e22-a70d-199fe4c89789-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.848388 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.848073    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bf31fd8-2f99-4e22-a70d-199fe4c89789-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.848388 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.848099    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf31fd8-2f99-4e22-a70d-199fe4c89789-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.848388 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.848157    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bf31fd8-2f99-4e22-a70d-199fe4c89789-config-out\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.848388 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.848221    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmv59\" (UniqueName: \"kubernetes.io/projected/8bf31fd8-2f99-4e22-a70d-199fe4c89789-kube-api-access-zmv59\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.848388 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.848254    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-web-config\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.848388 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.848278    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.848388 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.848305    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf31fd8-2f99-4e22-a70d-199fe4c89789-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.848388 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.848329    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf31fd8-2f99-4e22-a70d-199fe4c89789-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.848388 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.848351    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.848708 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.848399    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.848708 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.848427    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bf31fd8-2f99-4e22-a70d-199fe4c89789-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.848708 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.848457    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.848708 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.848479    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.949244 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.949157    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bf31fd8-2f99-4e22-a70d-199fe4c89789-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.949357 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.949313    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.949357 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.949333    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.949357 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.949348    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bf31fd8-2f99-4e22-a70d-199fe4c89789-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.949484 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.949372    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-config\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.949484 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.949387    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bf31fd8-2f99-4e22-a70d-199fe4c89789-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.949484 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.949401    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bf31fd8-2f99-4e22-a70d-199fe4c89789-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.949484 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.949418    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf31fd8-2f99-4e22-a70d-199fe4c89789-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.949930 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.949870    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bf31fd8-2f99-4e22-a70d-199fe4c89789-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.950130 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.949971    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bf31fd8-2f99-4e22-a70d-199fe4c89789-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.950130 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.950020    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bf31fd8-2f99-4e22-a70d-199fe4c89789-config-out\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.950130 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.950057    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmv59\" (UniqueName: \"kubernetes.io/projected/8bf31fd8-2f99-4e22-a70d-199fe4c89789-kube-api-access-zmv59\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.950130 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.950088    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-web-config\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.950130 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.950109    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bf31fd8-2f99-4e22-a70d-199fe4c89789-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.952677 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.950111    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.952677 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.950474    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf31fd8-2f99-4e22-a70d-199fe4c89789-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.952677 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.950540    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf31fd8-2f99-4e22-a70d-199fe4c89789-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.952677 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.950580    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf31fd8-2f99-4e22-a70d-199fe4c89789-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.952677 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.950617    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.952677 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.950652    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.952677 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.950681    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bf31fd8-2f99-4e22-a70d-199fe4c89789-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.952677 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.950819    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.952677 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.950893    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.952677 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.950932    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bf31fd8-2f99-4e22-a70d-199fe4c89789-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.952677 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.951268    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bf31fd8-2f99-4e22-a70d-199fe4c89789-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.952677 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.952634    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf31fd8-2f99-4e22-a70d-199fe4c89789-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.953415 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.952782    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-config\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.953415 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.953226    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.953415 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.953365    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.953565 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.953539    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf31fd8-2f99-4e22-a70d-199fe4c89789-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.953616 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.953571    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.954059 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.954006    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bf31fd8-2f99-4e22-a70d-199fe4c89789-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.954574 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.954550    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-web-config\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.954800 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.954758    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bf31fd8-2f99-4e22-a70d-199fe4c89789-config-out\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.955024 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.955001    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bf31fd8-2f99-4e22-a70d-199fe4c89789-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.955402 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.955377    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.955712 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.955693    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.956000 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.955980    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.956478 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.956459    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bf31fd8-2f99-4e22-a70d-199fe4c89789-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:37.957931 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:37.957916    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmv59\" (UniqueName: \"kubernetes.io/projected/8bf31fd8-2f99-4e22-a70d-199fe4c89789-kube-api-access-zmv59\") pod \"prometheus-k8s-0\" (UID: \"8bf31fd8-2f99-4e22-a70d-199fe4c89789\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:38.047795 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:38.047759    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:43:38.202472 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:38.202448    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 00:43:38.206060 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:43:38.205228    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bf31fd8_2f99_4e22_a70d_199fe4c89789.slice/crio-59cec9b5f80952df0822d2dc729a7003b5d303062ce895d8e68b73eba610d180 WatchSource:0}: Error finding container 59cec9b5f80952df0822d2dc729a7003b5d303062ce895d8e68b73eba610d180: Status 404 returned error can't find the container with id 59cec9b5f80952df0822d2dc729a7003b5d303062ce895d8e68b73eba610d180
Jul 18 00:43:38.678663 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:38.678619    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e8c3176-9b62-4081-bbaf-21b60a57d639" path="/var/lib/kubelet/pods/1e8c3176-9b62-4081-bbaf-21b60a57d639/volumes"
Jul 18 00:43:38.679493 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:38.679475    2575 generic.go:356] "Generic (PLEG): container finished" podID="8bf31fd8-2f99-4e22-a70d-199fe4c89789" containerID="fbdda237271629c9a652954d42e4792492cc27c1bc63d0fdebbe312d5ca89241" exitCode=0
Jul 18 00:43:38.679556 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:38.679513    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bf31fd8-2f99-4e22-a70d-199fe4c89789","Type":"ContainerDied","Data":"fbdda237271629c9a652954d42e4792492cc27c1bc63d0fdebbe312d5ca89241"}
Jul 18 00:43:38.679592 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:38.679562    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bf31fd8-2f99-4e22-a70d-199fe4c89789","Type":"ContainerStarted","Data":"59cec9b5f80952df0822d2dc729a7003b5d303062ce895d8e68b73eba610d180"}
Jul 18 00:43:39.686805 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:39.686768    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bf31fd8-2f99-4e22-a70d-199fe4c89789","Type":"ContainerStarted","Data":"dbf5245e2f0c436ae6eff930046f22072e3acacbb60630b4619eee74e9d09265"}
Jul 18 00:43:39.687167 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:39.686865    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bf31fd8-2f99-4e22-a70d-199fe4c89789","Type":"ContainerStarted","Data":"838e3d9c0e3ef6dbe0ccb71c09437c775cdf31a98efb8d992fca1f2fe7e35f84"}
Jul 18 00:43:39.687167 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:39.686908    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bf31fd8-2f99-4e22-a70d-199fe4c89789","Type":"ContainerStarted","Data":"6070f647424357703547c4daa8537edd8fd92b2dfae3af544693e33ec9b405f7"}
Jul 18 00:43:39.687167 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:39.686938    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bf31fd8-2f99-4e22-a70d-199fe4c89789","Type":"ContainerStarted","Data":"2187ef5d7744a5ae3c177762eba991bcf6c72fae5970e8458d6aca9ae16d3eb5"}
Jul 18 00:43:39.687167 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:39.686962    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bf31fd8-2f99-4e22-a70d-199fe4c89789","Type":"ContainerStarted","Data":"53b40cffa4316aba4dc84a8e6ee07f1f7e68bcdd2d0567f0b8eccce0fa586887"}
Jul 18 00:43:39.687167 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:39.687004    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bf31fd8-2f99-4e22-a70d-199fe4c89789","Type":"ContainerStarted","Data":"36f5b6660b8be9132488755943178ed795a68507e7e242899e9c29f267e6a202"}
Jul 18 00:43:39.714584 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:39.714526    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.696646936 podStartE2EDuration="2.714509541s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.862605ms" isStatefulPod=false podCreationTimestamp="2026-07-18 00:43:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:43:39.71199792 +0000 UTC m=+187.501410017" watchObservedRunningTime="2026-07-18 00:43:39.714509541 +0000 UTC m=+187.503921598"
Jul 18 00:43:43.048232 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:43:43.048159    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:44:38.048286 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:44:38.048224    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:44:38.064392 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:44:38.064367    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:44:38.937031 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:44:38.937003    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 00:45:32.523461 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:45:32.523430    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 00:45:32.525806 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:45:32.525780    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 00:45:32.529932 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:45:32.529906    2575 kubelet.go:1648] "Image garbage collection succeeded"
Jul 18 00:46:14.726426 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:14.726391    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mb86d"]
Jul 18 00:46:14.729518 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:14.729502    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mb86d"
Jul 18 00:46:14.732242 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:14.732218    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 18 00:46:14.733176 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:14.733152    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ctw2p\""
Jul 18 00:46:14.733291 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:14.733210    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 18 00:46:14.738953 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:14.738931    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mb86d"]
Jul 18 00:46:14.785108 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:14.785074    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2d2l\" (UniqueName: \"kubernetes.io/projected/63781e6b-b40d-436b-98fe-fbed9662fa45-kube-api-access-h2d2l\") pod \"cert-manager-55b4d954d5-mb86d\" (UID: \"63781e6b-b40d-436b-98fe-fbed9662fa45\") " pod="cert-manager/cert-manager-55b4d954d5-mb86d"
Jul 18 00:46:14.785293 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:14.785120    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63781e6b-b40d-436b-98fe-fbed9662fa45-bound-sa-token\") pod \"cert-manager-55b4d954d5-mb86d\" (UID: \"63781e6b-b40d-436b-98fe-fbed9662fa45\") " pod="cert-manager/cert-manager-55b4d954d5-mb86d"
Jul 18 00:46:14.885921 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:14.885885    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2d2l\" (UniqueName: \"kubernetes.io/projected/63781e6b-b40d-436b-98fe-fbed9662fa45-kube-api-access-h2d2l\") pod \"cert-manager-55b4d954d5-mb86d\" (UID: \"63781e6b-b40d-436b-98fe-fbed9662fa45\") " pod="cert-manager/cert-manager-55b4d954d5-mb86d"
Jul 18 00:46:14.886082 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:14.885948    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63781e6b-b40d-436b-98fe-fbed9662fa45-bound-sa-token\") pod \"cert-manager-55b4d954d5-mb86d\" (UID: \"63781e6b-b40d-436b-98fe-fbed9662fa45\") " pod="cert-manager/cert-manager-55b4d954d5-mb86d"
Jul 18 00:46:14.894150 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:14.894121    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2d2l\" (UniqueName: \"kubernetes.io/projected/63781e6b-b40d-436b-98fe-fbed9662fa45-kube-api-access-h2d2l\") pod \"cert-manager-55b4d954d5-mb86d\" (UID: \"63781e6b-b40d-436b-98fe-fbed9662fa45\") " pod="cert-manager/cert-manager-55b4d954d5-mb86d"
Jul 18 00:46:14.894315 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:14.894211    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63781e6b-b40d-436b-98fe-fbed9662fa45-bound-sa-token\") pod \"cert-manager-55b4d954d5-mb86d\" (UID: \"63781e6b-b40d-436b-98fe-fbed9662fa45\") " pod="cert-manager/cert-manager-55b4d954d5-mb86d"
Jul 18 00:46:15.054945 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:15.054861    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mb86d"
Jul 18 00:46:15.185096 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:15.185076    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mb86d"]
Jul 18 00:46:15.187791 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:46:15.187765    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63781e6b_b40d_436b_98fe_fbed9662fa45.slice/crio-28e3bcebc76a2321728dd82514d53811cc77a711ec27e30d6f96d15391b368fe WatchSource:0}: Error finding container 28e3bcebc76a2321728dd82514d53811cc77a711ec27e30d6f96d15391b368fe: Status 404 returned error can't find the container with id 28e3bcebc76a2321728dd82514d53811cc77a711ec27e30d6f96d15391b368fe
Jul 18 00:46:15.189911 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:15.189896    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 00:46:15.297079 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:15.297044    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mb86d" event={"ID":"63781e6b-b40d-436b-98fe-fbed9662fa45","Type":"ContainerStarted","Data":"28e3bcebc76a2321728dd82514d53811cc77a711ec27e30d6f96d15391b368fe"}
Jul 18 00:46:18.311415 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:18.311329    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mb86d" event={"ID":"63781e6b-b40d-436b-98fe-fbed9662fa45","Type":"ContainerStarted","Data":"95bc125d75c5592ee6308c51e3ce663a47f89af8b87ae626ec153c0abe36fcae"}
Jul 18 00:46:18.332674 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:18.332628    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-mb86d" podStartSLOduration=1.5482118219999998 podStartE2EDuration="4.33260143s" totalImagesPullingTime="2.784389608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:46:18.332106176 +0000 UTC m=+346.121518249" watchObservedRunningTime="2026-07-18 00:46:18.33260143 +0000 UTC m=+346.122013487"
Jul 18 00:46:39.184805 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.184760    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9"]
Jul 18 00:46:39.191037 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.191019    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9"
Jul 18 00:46:39.195936 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.195917    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 18 00:46:39.197493 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.197429    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 18 00:46:39.197674 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.197657    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 18 00:46:39.197749 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.197733    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jk4rp\""
Jul 18 00:46:39.197788 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.197657    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 18 00:46:39.219134 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.219099    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9"]
Jul 18 00:46:39.304199 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.304149    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f521625b-6b5e-4f09-8901-ee3e65c39990-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9\" (UID: \"f521625b-6b5e-4f09-8901-ee3e65c39990\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9"
Jul 18 00:46:39.304374 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.304264    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f521625b-6b5e-4f09-8901-ee3e65c39990-tmp\") pod \"opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9\" (UID: \"f521625b-6b5e-4f09-8901-ee3e65c39990\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9"
Jul 18 00:46:39.304374 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.304293    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f521625b-6b5e-4f09-8901-ee3e65c39990-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9\" (UID: \"f521625b-6b5e-4f09-8901-ee3e65c39990\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9"
Jul 18 00:46:39.304374 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.304314    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bbp6\" (UniqueName: \"kubernetes.io/projected/f521625b-6b5e-4f09-8901-ee3e65c39990-kube-api-access-5bbp6\") pod \"opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9\" (UID: \"f521625b-6b5e-4f09-8901-ee3e65c39990\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9"
Jul 18 00:46:39.304481 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.304419    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f521625b-6b5e-4f09-8901-ee3e65c39990-manifests\") pod \"opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9\" (UID: \"f521625b-6b5e-4f09-8901-ee3e65c39990\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9"
Jul 18 00:46:39.405634 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.405605    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f521625b-6b5e-4f09-8901-ee3e65c39990-manifests\") pod \"opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9\" (UID: \"f521625b-6b5e-4f09-8901-ee3e65c39990\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9"
Jul 18 00:46:39.405820 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.405655    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f521625b-6b5e-4f09-8901-ee3e65c39990-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9\" (UID: \"f521625b-6b5e-4f09-8901-ee3e65c39990\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9"
Jul 18 00:46:39.405820 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.405685    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f521625b-6b5e-4f09-8901-ee3e65c39990-tmp\") pod \"opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9\" (UID: \"f521625b-6b5e-4f09-8901-ee3e65c39990\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9"
Jul 18 00:46:39.405820 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.405703    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f521625b-6b5e-4f09-8901-ee3e65c39990-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9\" (UID: \"f521625b-6b5e-4f09-8901-ee3e65c39990\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9"
Jul 18 00:46:39.405820 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.405719    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bbp6\" (UniqueName: \"kubernetes.io/projected/f521625b-6b5e-4f09-8901-ee3e65c39990-kube-api-access-5bbp6\") pod \"opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9\" (UID: \"f521625b-6b5e-4f09-8901-ee3e65c39990\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9"
Jul 18 00:46:39.406032 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.405960    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f521625b-6b5e-4f09-8901-ee3e65c39990-manifests\") pod \"opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9\" (UID: \"f521625b-6b5e-4f09-8901-ee3e65c39990\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9"
Jul 18 00:46:39.408243 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.408215    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f521625b-6b5e-4f09-8901-ee3e65c39990-tmp\") pod \"opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9\" (UID: \"f521625b-6b5e-4f09-8901-ee3e65c39990\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9"
Jul 18 00:46:39.408353 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.408336    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f521625b-6b5e-4f09-8901-ee3e65c39990-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9\" (UID: \"f521625b-6b5e-4f09-8901-ee3e65c39990\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9"
Jul 18 00:46:39.408353 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.408344    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f521625b-6b5e-4f09-8901-ee3e65c39990-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9\" (UID: \"f521625b-6b5e-4f09-8901-ee3e65c39990\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9"
Jul 18 00:46:39.422607 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.422588    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bbp6\" (UniqueName: \"kubernetes.io/projected/f521625b-6b5e-4f09-8901-ee3e65c39990-kube-api-access-5bbp6\") pod \"opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9\" (UID: \"f521625b-6b5e-4f09-8901-ee3e65c39990\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9"
Jul 18 00:46:39.501451 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.501363    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9"
Jul 18 00:46:39.644290 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:39.644230    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9"]
Jul 18 00:46:39.647477 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:46:39.647450    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf521625b_6b5e_4f09_8901_ee3e65c39990.slice/crio-547eb5091e848450bc29357324b5c6837c100b640a0d81154e17fb1b555dd46e WatchSource:0}: Error finding container 547eb5091e848450bc29357324b5c6837c100b640a0d81154e17fb1b555dd46e: Status 404 returned error can't find the container with id 547eb5091e848450bc29357324b5c6837c100b640a0d81154e17fb1b555dd46e
Jul 18 00:46:40.398953 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:40.398915    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9" event={"ID":"f521625b-6b5e-4f09-8901-ee3e65c39990","Type":"ContainerStarted","Data":"547eb5091e848450bc29357324b5c6837c100b640a0d81154e17fb1b555dd46e"}
Jul 18 00:46:43.415313 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:43.415278    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9" event={"ID":"f521625b-6b5e-4f09-8901-ee3e65c39990","Type":"ContainerStarted","Data":"0c422fe83062e6ddd2a5fdfa5ca6df771d5f645b048a8e735bee00c49be6dd6d"}
Jul 18 00:46:44.420674 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:44.420641    2575 generic.go:356] "Generic (PLEG): container finished" podID="f521625b-6b5e-4f09-8901-ee3e65c39990" containerID="0c422fe83062e6ddd2a5fdfa5ca6df771d5f645b048a8e735bee00c49be6dd6d" exitCode=0
Jul 18 00:46:44.421071 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:44.420728    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9" event={"ID":"f521625b-6b5e-4f09-8901-ee3e65c39990","Type":"ContainerDied","Data":"0c422fe83062e6ddd2a5fdfa5ca6df771d5f645b048a8e735bee00c49be6dd6d"}
Jul 18 00:46:45.426621 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:45.426584    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9" event={"ID":"f521625b-6b5e-4f09-8901-ee3e65c39990","Type":"ContainerStarted","Data":"4cc00e57e0e49ca4718dc543e2eb1aa4f93ae34318f65ec78b829a671be186b1"}
Jul 18 00:46:45.427099 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:45.426688    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9"
Jul 18 00:46:45.450906 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:45.450867    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9" podStartSLOduration=2.140298912 podStartE2EDuration="6.450852937s" totalImagesPullingTime="3.227933941s" totalInitContainerRuntime="1.082620084s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:46:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:46:45.449578448 +0000 UTC m=+373.238990505" watchObservedRunningTime="2026-07-18 00:46:45.450852937 +0000 UTC m=+373.240264993"
Jul 18 00:46:56.116935 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.116896    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-845f554b8f-99zj8"]
Jul 18 00:46:56.120143 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.120119    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-845f554b8f-99zj8"
Jul 18 00:46:56.124274 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.124247    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 18 00:46:56.124457 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.124440    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 18 00:46:56.124556 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.124473    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-j8jws\""
Jul 18 00:46:56.124556 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.124447    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 18 00:46:56.124556 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.124511    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 18 00:46:56.124726 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.124443    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 18 00:46:56.134903 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.134877    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-845f554b8f-99zj8"]
Jul 18 00:46:56.154963 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.154921    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1add44ca-eec5-4cf7-9c02-7296b84a21b1-cert\") pod \"lws-controller-manager-845f554b8f-99zj8\" (UID: \"1add44ca-eec5-4cf7-9c02-7296b84a21b1\") " pod="openshift-lws-operator/lws-controller-manager-845f554b8f-99zj8"
Jul 18 00:46:56.155152 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.155018    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1add44ca-eec5-4cf7-9c02-7296b84a21b1-metrics-cert\") pod \"lws-controller-manager-845f554b8f-99zj8\" (UID: \"1add44ca-eec5-4cf7-9c02-7296b84a21b1\") " pod="openshift-lws-operator/lws-controller-manager-845f554b8f-99zj8"
Jul 18 00:46:56.155152 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.155044    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1add44ca-eec5-4cf7-9c02-7296b84a21b1-manager-config\") pod \"lws-controller-manager-845f554b8f-99zj8\" (UID: \"1add44ca-eec5-4cf7-9c02-7296b84a21b1\") " pod="openshift-lws-operator/lws-controller-manager-845f554b8f-99zj8"
Jul 18 00:46:56.155152 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.155073    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7tpx\" (UniqueName: \"kubernetes.io/projected/1add44ca-eec5-4cf7-9c02-7296b84a21b1-kube-api-access-z7tpx\") pod \"lws-controller-manager-845f554b8f-99zj8\" (UID: \"1add44ca-eec5-4cf7-9c02-7296b84a21b1\") " pod="openshift-lws-operator/lws-controller-manager-845f554b8f-99zj8"
Jul 18 00:46:56.256497 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.256446    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7tpx\" (UniqueName: \"kubernetes.io/projected/1add44ca-eec5-4cf7-9c02-7296b84a21b1-kube-api-access-z7tpx\") pod \"lws-controller-manager-845f554b8f-99zj8\" (UID: \"1add44ca-eec5-4cf7-9c02-7296b84a21b1\") " pod="openshift-lws-operator/lws-controller-manager-845f554b8f-99zj8"
Jul 18 00:46:56.256692 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.256523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1add44ca-eec5-4cf7-9c02-7296b84a21b1-cert\") pod \"lws-controller-manager-845f554b8f-99zj8\" (UID: \"1add44ca-eec5-4cf7-9c02-7296b84a21b1\") " pod="openshift-lws-operator/lws-controller-manager-845f554b8f-99zj8"
Jul 18 00:46:56.256692 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.256577    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1add44ca-eec5-4cf7-9c02-7296b84a21b1-metrics-cert\") pod \"lws-controller-manager-845f554b8f-99zj8\" (UID: \"1add44ca-eec5-4cf7-9c02-7296b84a21b1\") " pod="openshift-lws-operator/lws-controller-manager-845f554b8f-99zj8"
Jul 18 00:46:56.256692 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.256607    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1add44ca-eec5-4cf7-9c02-7296b84a21b1-manager-config\") pod \"lws-controller-manager-845f554b8f-99zj8\" (UID: \"1add44ca-eec5-4cf7-9c02-7296b84a21b1\") " pod="openshift-lws-operator/lws-controller-manager-845f554b8f-99zj8"
Jul 18 00:46:56.257351 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.257332    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1add44ca-eec5-4cf7-9c02-7296b84a21b1-manager-config\") pod \"lws-controller-manager-845f554b8f-99zj8\" (UID: \"1add44ca-eec5-4cf7-9c02-7296b84a21b1\") " pod="openshift-lws-operator/lws-controller-manager-845f554b8f-99zj8"
Jul 18 00:46:56.259151 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.259131    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1add44ca-eec5-4cf7-9c02-7296b84a21b1-cert\") pod \"lws-controller-manager-845f554b8f-99zj8\" (UID: \"1add44ca-eec5-4cf7-9c02-7296b84a21b1\") " pod="openshift-lws-operator/lws-controller-manager-845f554b8f-99zj8"
Jul 18 00:46:56.259226 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.259209    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1add44ca-eec5-4cf7-9c02-7296b84a21b1-metrics-cert\") pod \"lws-controller-manager-845f554b8f-99zj8\" (UID: \"1add44ca-eec5-4cf7-9c02-7296b84a21b1\") " pod="openshift-lws-operator/lws-controller-manager-845f554b8f-99zj8"
Jul 18 00:46:56.267451 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.267428    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7tpx\" (UniqueName: \"kubernetes.io/projected/1add44ca-eec5-4cf7-9c02-7296b84a21b1-kube-api-access-z7tpx\") pod \"lws-controller-manager-845f554b8f-99zj8\" (UID: \"1add44ca-eec5-4cf7-9c02-7296b84a21b1\") " pod="openshift-lws-operator/lws-controller-manager-845f554b8f-99zj8"
Jul 18 00:46:56.429723 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.429636    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-845f554b8f-99zj8"
Jul 18 00:46:56.433735 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.433716    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9"
Jul 18 00:46:56.579870 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:56.579708    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-845f554b8f-99zj8"]
Jul 18 00:46:56.582542 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:46:56.582516    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1add44ca_eec5_4cf7_9c02_7296b84a21b1.slice/crio-5945479472e48fb511f952021d3135c01b180b484d40f7602d1b38a59fceeb0f WatchSource:0}: Error finding container 5945479472e48fb511f952021d3135c01b180b484d40f7602d1b38a59fceeb0f: Status 404 returned error can't find the container with id 5945479472e48fb511f952021d3135c01b180b484d40f7602d1b38a59fceeb0f
Jul 18 00:46:57.483993 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:57.483955    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-845f554b8f-99zj8" event={"ID":"1add44ca-eec5-4cf7-9c02-7296b84a21b1","Type":"ContainerStarted","Data":"5945479472e48fb511f952021d3135c01b180b484d40f7602d1b38a59fceeb0f"}
Jul 18 00:46:59.493949 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:59.493913    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-845f554b8f-99zj8" event={"ID":"1add44ca-eec5-4cf7-9c02-7296b84a21b1","Type":"ContainerStarted","Data":"e180dd4702b352ff51ce73d41ecab714031b88bdef6c4e796ace53cf4b6484a3"}
Jul 18 00:46:59.494448 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:59.493981    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-845f554b8f-99zj8"
Jul 18 00:46:59.539744 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:59.539675    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-845f554b8f-99zj8" podStartSLOduration=1.216879856 podStartE2EDuration="3.539652868s" totalImagesPullingTime="2.322773012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:46:59.535775278 +0000 UTC m=+387.325187334" watchObservedRunningTime="2026-07-18 00:46:59.539652868 +0000 UTC m=+387.329064925"
Jul 18 00:46:59.617263 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:59.617231    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7569c6bc9b-pllps"]
Jul 18 00:46:59.620555 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:59.620540    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7569c6bc9b-pllps"
Jul 18 00:46:59.623338 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:59.623316    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 18 00:46:59.623447 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:59.623355    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-l5n8l\""
Jul 18 00:46:59.623664 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:59.623649    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 18 00:46:59.623747 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:59.623698    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 18 00:46:59.623919 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:59.623901    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 18 00:46:59.642024 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:59.641993    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7569c6bc9b-pllps"]
Jul 18 00:46:59.691108 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:59.691074    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9fc45c4-958e-4d5a-87d7-254816a2bdcb-tls-certs\") pod \"kube-auth-proxy-7569c6bc9b-pllps\" (UID: \"a9fc45c4-958e-4d5a-87d7-254816a2bdcb\") " pod="openshift-ingress/kube-auth-proxy-7569c6bc9b-pllps"
Jul 18 00:46:59.691108 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:59.691113    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwrvk\" (UniqueName: \"kubernetes.io/projected/a9fc45c4-958e-4d5a-87d7-254816a2bdcb-kube-api-access-fwrvk\") pod \"kube-auth-proxy-7569c6bc9b-pllps\" (UID: \"a9fc45c4-958e-4d5a-87d7-254816a2bdcb\") " pod="openshift-ingress/kube-auth-proxy-7569c6bc9b-pllps"
Jul 18 00:46:59.691342 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:59.691212    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9fc45c4-958e-4d5a-87d7-254816a2bdcb-tmp\") pod \"kube-auth-proxy-7569c6bc9b-pllps\" (UID: \"a9fc45c4-958e-4d5a-87d7-254816a2bdcb\") " pod="openshift-ingress/kube-auth-proxy-7569c6bc9b-pllps"
Jul 18 00:46:59.792617 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:59.792528    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9fc45c4-958e-4d5a-87d7-254816a2bdcb-tmp\") pod \"kube-auth-proxy-7569c6bc9b-pllps\" (UID: \"a9fc45c4-958e-4d5a-87d7-254816a2bdcb\") " pod="openshift-ingress/kube-auth-proxy-7569c6bc9b-pllps"
Jul 18 00:46:59.792617 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:59.792572    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9fc45c4-958e-4d5a-87d7-254816a2bdcb-tls-certs\") pod \"kube-auth-proxy-7569c6bc9b-pllps\" (UID: \"a9fc45c4-958e-4d5a-87d7-254816a2bdcb\") " pod="openshift-ingress/kube-auth-proxy-7569c6bc9b-pllps"
Jul 18 00:46:59.792617 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:59.792595    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwrvk\" (UniqueName: \"kubernetes.io/projected/a9fc45c4-958e-4d5a-87d7-254816a2bdcb-kube-api-access-fwrvk\") pod \"kube-auth-proxy-7569c6bc9b-pllps\" (UID: \"a9fc45c4-958e-4d5a-87d7-254816a2bdcb\") " pod="openshift-ingress/kube-auth-proxy-7569c6bc9b-pllps"
Jul 18 00:46:59.794975 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:59.794949    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9fc45c4-958e-4d5a-87d7-254816a2bdcb-tmp\") pod \"kube-auth-proxy-7569c6bc9b-pllps\" (UID: \"a9fc45c4-958e-4d5a-87d7-254816a2bdcb\") " pod="openshift-ingress/kube-auth-proxy-7569c6bc9b-pllps"
Jul 18 00:46:59.795212 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:59.795172    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9fc45c4-958e-4d5a-87d7-254816a2bdcb-tls-certs\") pod \"kube-auth-proxy-7569c6bc9b-pllps\" (UID: \"a9fc45c4-958e-4d5a-87d7-254816a2bdcb\") " pod="openshift-ingress/kube-auth-proxy-7569c6bc9b-pllps"
Jul 18 00:46:59.809304 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:59.809283    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwrvk\" (UniqueName: \"kubernetes.io/projected/a9fc45c4-958e-4d5a-87d7-254816a2bdcb-kube-api-access-fwrvk\") pod \"kube-auth-proxy-7569c6bc9b-pllps\" (UID: \"a9fc45c4-958e-4d5a-87d7-254816a2bdcb\") " pod="openshift-ingress/kube-auth-proxy-7569c6bc9b-pllps"
Jul 18 00:46:59.929999 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:46:59.929969    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7569c6bc9b-pllps"
Jul 18 00:47:00.076100 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:47:00.076007    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7569c6bc9b-pllps"]
Jul 18 00:47:00.078677 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:47:00.078652    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9fc45c4_958e_4d5a_87d7_254816a2bdcb.slice/crio-9f73beb90091343c04aa482ff0961399b748b46c5cdc51ce4a9db715d5a5cc2e WatchSource:0}: Error finding container 9f73beb90091343c04aa482ff0961399b748b46c5cdc51ce4a9db715d5a5cc2e: Status 404 returned error can't find the container with id 9f73beb90091343c04aa482ff0961399b748b46c5cdc51ce4a9db715d5a5cc2e
Jul 18 00:47:00.499322 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:47:00.499291    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7569c6bc9b-pllps" event={"ID":"a9fc45c4-958e-4d5a-87d7-254816a2bdcb","Type":"ContainerStarted","Data":"9f73beb90091343c04aa482ff0961399b748b46c5cdc51ce4a9db715d5a5cc2e"}
Jul 18 00:47:02.509401 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:47:02.509314    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7569c6bc9b-pllps" event={"ID":"a9fc45c4-958e-4d5a-87d7-254816a2bdcb","Type":"ContainerStarted","Data":"adc6bfec41416d407b8d16d2841dcd5be7eea32d28a5e56d5c8774a66fb7d27a"}
Jul 18 00:47:02.542678 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:47:02.542623    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7569c6bc9b-pllps" podStartSLOduration=1.382693562 podStartE2EDuration="3.542607167s" totalImagesPullingTime="2.159913605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:47:02.541500945 +0000 UTC m=+390.330913002" watchObservedRunningTime="2026-07-18 00:47:02.542607167 +0000 UTC m=+390.332019223"
Jul 18 00:47:10.501839 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:47:10.501808    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-845f554b8f-99zj8"
Jul 18 00:47:11.242272 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:47:11.242237    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gbdrr"]
Jul 18 00:47:11.245839 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:47:11.245816    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbdrr"
Jul 18 00:47:11.248398 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:47:11.248374    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-bspvc\""
Jul 18 00:47:11.248569 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:47:11.248548    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 18 00:47:11.262693 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:47:11.262667    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gbdrr"]
Jul 18 00:47:11.397433 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:47:11.397398    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4101cfb-ded6-4617-b332-239e741d7deb-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gbdrr\" (UID: \"d4101cfb-ded6-4617-b332-239e741d7deb\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbdrr"
Jul 18 00:47:11.397433 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:47:11.397441    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sp5m\" (UniqueName: \"kubernetes.io/projected/d4101cfb-ded6-4617-b332-239e741d7deb-kube-api-access-6sp5m\") pod \"llmisvc-controller-manager-777c6bd7d5-gbdrr\" (UID: \"d4101cfb-ded6-4617-b332-239e741d7deb\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbdrr"
Jul 18 00:47:11.498456 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:47:11.498371    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4101cfb-ded6-4617-b332-239e741d7deb-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gbdrr\" (UID: \"d4101cfb-ded6-4617-b332-239e741d7deb\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbdrr"
Jul 18 00:47:11.498456 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:47:11.498413    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sp5m\" (UniqueName: \"kubernetes.io/projected/d4101cfb-ded6-4617-b332-239e741d7deb-kube-api-access-6sp5m\") pod \"llmisvc-controller-manager-777c6bd7d5-gbdrr\" (UID: \"d4101cfb-ded6-4617-b332-239e741d7deb\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbdrr"
Jul 18 00:47:11.500936 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:47:11.500912    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4101cfb-ded6-4617-b332-239e741d7deb-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gbdrr\" (UID: \"d4101cfb-ded6-4617-b332-239e741d7deb\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbdrr"
Jul 18 00:47:11.514299 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:47:11.514274    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sp5m\" (UniqueName: \"kubernetes.io/projected/d4101cfb-ded6-4617-b332-239e741d7deb-kube-api-access-6sp5m\") pod \"llmisvc-controller-manager-777c6bd7d5-gbdrr\" (UID: \"d4101cfb-ded6-4617-b332-239e741d7deb\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbdrr"
Jul 18 00:47:11.556004 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:47:11.555973    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbdrr"
Jul 18 00:47:11.688680 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:47:11.688655    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gbdrr"]
Jul 18 00:47:11.690835 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:47:11.690808    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd4101cfb_ded6_4617_b332_239e741d7deb.slice/crio-326bc6e73eb9f2325a563f559844fa7aabbd73345679ad335ad75b9379fff708 WatchSource:0}: Error finding container 326bc6e73eb9f2325a563f559844fa7aabbd73345679ad335ad75b9379fff708: Status 404 returned error can't find the container with id 326bc6e73eb9f2325a563f559844fa7aabbd73345679ad335ad75b9379fff708
Jul 18 00:47:12.555742 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:47:12.555708    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbdrr" event={"ID":"d4101cfb-ded6-4617-b332-239e741d7deb","Type":"ContainerStarted","Data":"326bc6e73eb9f2325a563f559844fa7aabbd73345679ad335ad75b9379fff708"}
Jul 18 00:47:14.568170 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:47:14.568091    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbdrr" event={"ID":"d4101cfb-ded6-4617-b332-239e741d7deb","Type":"ContainerStarted","Data":"2fd2bf4d9374668e027995ab8a30bfb5234322ef421c4d30884cc87050f749b7"}
Jul 18 00:47:14.568559 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:47:14.568216    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbdrr"
Jul 18 00:47:45.574746 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:47:45.574711    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbdrr"
Jul 18 00:47:45.593451 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:47:45.593400    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbdrr" podStartSLOduration=32.148791364 podStartE2EDuration="34.593385772s" totalImagesPullingTime="2.444594408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:47:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:47:14.593747523 +0000 UTC m=+402.383159580" watchObservedRunningTime="2026-07-18 00:47:45.593385772 +0000 UTC m=+433.382797829"
Jul 18 00:48:42.353246 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:48:42.353210    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9mvvm"]
Jul 18 00:48:42.356597 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:48:42.356580    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9mvvm"
Jul 18 00:48:42.359665 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:48:42.359642    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-2rcfs\""
Jul 18 00:48:42.359768 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:48:42.359736    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 18 00:48:42.360944 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:48:42.360923    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 18 00:48:42.367482 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:48:42.367459    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9mvvm"]
Jul 18 00:48:42.496257 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:48:42.496203    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-669sg\" (UniqueName: \"kubernetes.io/projected/73a9ad61-7a6e-490d-8f44-4721a97e38e0-kube-api-access-669sg\") pod \"authorino-operator-75cc8d5cb7-9mvvm\" (UID: \"73a9ad61-7a6e-490d-8f44-4721a97e38e0\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9mvvm"
Jul 18 00:48:42.597542 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:48:42.597501    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-669sg\" (UniqueName: \"kubernetes.io/projected/73a9ad61-7a6e-490d-8f44-4721a97e38e0-kube-api-access-669sg\") pod \"authorino-operator-75cc8d5cb7-9mvvm\" (UID: \"73a9ad61-7a6e-490d-8f44-4721a97e38e0\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9mvvm"
Jul 18 00:48:42.606809 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:48:42.606759    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-669sg\" (UniqueName: \"kubernetes.io/projected/73a9ad61-7a6e-490d-8f44-4721a97e38e0-kube-api-access-669sg\") pod \"authorino-operator-75cc8d5cb7-9mvvm\" (UID: \"73a9ad61-7a6e-490d-8f44-4721a97e38e0\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9mvvm"
Jul 18 00:48:42.667271 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:48:42.667239    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9mvvm"
Jul 18 00:48:42.802047 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:48:42.802025    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9mvvm"]
Jul 18 00:48:42.803851 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:48:42.803823    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73a9ad61_7a6e_490d_8f44_4721a97e38e0.slice/crio-b31aa3d3e1c973ec558bbacad5d7bb97e6ed53c8478ef5bfbc0a09fd6fb31626 WatchSource:0}: Error finding container b31aa3d3e1c973ec558bbacad5d7bb97e6ed53c8478ef5bfbc0a09fd6fb31626: Status 404 returned error can't find the container with id b31aa3d3e1c973ec558bbacad5d7bb97e6ed53c8478ef5bfbc0a09fd6fb31626
Jul 18 00:48:42.947619 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:48:42.947584    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9mvvm" event={"ID":"73a9ad61-7a6e-490d-8f44-4721a97e38e0","Type":"ContainerStarted","Data":"b31aa3d3e1c973ec558bbacad5d7bb97e6ed53c8478ef5bfbc0a09fd6fb31626"}
Jul 18 00:48:45.964198 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:48:45.964159    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9mvvm" event={"ID":"73a9ad61-7a6e-490d-8f44-4721a97e38e0","Type":"ContainerStarted","Data":"11c3cd064bd7b033c60b7971cffdc18d3e051701b0baf12617abd8dfd0a4920e"}
Jul 18 00:48:45.964586 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:48:45.964258    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9mvvm"
Jul 18 00:48:45.982854 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:48:45.982803    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9mvvm" podStartSLOduration=1.867498643 podStartE2EDuration="3.982788376s" totalImagesPullingTime="2.115289733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:48:45.981003778 +0000 UTC m=+493.770415835" watchObservedRunningTime="2026-07-18 00:48:45.982788376 +0000 UTC m=+493.772200433"
Jul 18 00:48:56.971085 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:48:56.971055    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9mvvm"
Jul 18 00:49:37.479643 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:37.479611    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-8st58"]
Jul 18 00:49:37.483028 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:37.483011    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8st58"
Jul 18 00:49:37.485595 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:37.485566    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ncmsc\""
Jul 18 00:49:37.490120 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:37.490095    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8st58"]
Jul 18 00:49:37.582254 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:37.582218    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8mnf\" (UniqueName: \"kubernetes.io/projected/f4ecc28d-2f21-46f4-96f1-c5762c2acec5-kube-api-access-w8mnf\") pod \"authorino-58cd955675-8st58\" (UID: \"f4ecc28d-2f21-46f4-96f1-c5762c2acec5\") " pod="kuadrant-system/authorino-58cd955675-8st58"
Jul 18 00:49:37.682950 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:37.682915    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8mnf\" (UniqueName: \"kubernetes.io/projected/f4ecc28d-2f21-46f4-96f1-c5762c2acec5-kube-api-access-w8mnf\") pod \"authorino-58cd955675-8st58\" (UID: \"f4ecc28d-2f21-46f4-96f1-c5762c2acec5\") " pod="kuadrant-system/authorino-58cd955675-8st58"
Jul 18 00:49:37.693396 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:37.693364    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8mnf\" (UniqueName: \"kubernetes.io/projected/f4ecc28d-2f21-46f4-96f1-c5762c2acec5-kube-api-access-w8mnf\") pod \"authorino-58cd955675-8st58\" (UID: \"f4ecc28d-2f21-46f4-96f1-c5762c2acec5\") " pod="kuadrant-system/authorino-58cd955675-8st58"
Jul 18 00:49:37.712428 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:37.712399    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-4x8zs"]
Jul 18 00:49:37.715774 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:37.715758    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4x8zs"
Jul 18 00:49:37.723459 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:37.723435    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4x8zs"]
Jul 18 00:49:37.794064 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:37.793988    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8st58"
Jul 18 00:49:37.885375 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:37.885345    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkk74\" (UniqueName: \"kubernetes.io/projected/9f4a9808-2461-4e76-ac14-fd8490b62bd4-kube-api-access-nkk74\") pod \"authorino-75d556bd77-4x8zs\" (UID: \"9f4a9808-2461-4e76-ac14-fd8490b62bd4\") " pod="kuadrant-system/authorino-75d556bd77-4x8zs"
Jul 18 00:49:37.922347 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:37.922313    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8st58"]
Jul 18 00:49:37.925555 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:49:37.925530    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4ecc28d_2f21_46f4_96f1_c5762c2acec5.slice/crio-60edfafa2891b983d75fa152065558895d9dcd6ae3edde53392d46a8ae98bba9 WatchSource:0}: Error finding container 60edfafa2891b983d75fa152065558895d9dcd6ae3edde53392d46a8ae98bba9: Status 404 returned error can't find the container with id 60edfafa2891b983d75fa152065558895d9dcd6ae3edde53392d46a8ae98bba9
Jul 18 00:49:37.986314 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:37.986274    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkk74\" (UniqueName: \"kubernetes.io/projected/9f4a9808-2461-4e76-ac14-fd8490b62bd4-kube-api-access-nkk74\") pod \"authorino-75d556bd77-4x8zs\" (UID: \"9f4a9808-2461-4e76-ac14-fd8490b62bd4\") " pod="kuadrant-system/authorino-75d556bd77-4x8zs"
Jul 18 00:49:37.994621 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:37.994587    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkk74\" (UniqueName: \"kubernetes.io/projected/9f4a9808-2461-4e76-ac14-fd8490b62bd4-kube-api-access-nkk74\") pod \"authorino-75d556bd77-4x8zs\" (UID: \"9f4a9808-2461-4e76-ac14-fd8490b62bd4\") " pod="kuadrant-system/authorino-75d556bd77-4x8zs"
Jul 18 00:49:38.025296 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:38.025262    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4x8zs"
Jul 18 00:49:38.154972 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:38.154933    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4x8zs"]
Jul 18 00:49:38.157764 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:49:38.157734    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f4a9808_2461_4e76_ac14_fd8490b62bd4.slice/crio-a5afe8ca91b672c1d4930e2e20b4a7060ec92a19078d002287b032e56907a75a WatchSource:0}: Error finding container a5afe8ca91b672c1d4930e2e20b4a7060ec92a19078d002287b032e56907a75a: Status 404 returned error can't find the container with id a5afe8ca91b672c1d4930e2e20b4a7060ec92a19078d002287b032e56907a75a
Jul 18 00:49:38.198815 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:38.198781    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8st58" event={"ID":"f4ecc28d-2f21-46f4-96f1-c5762c2acec5","Type":"ContainerStarted","Data":"60edfafa2891b983d75fa152065558895d9dcd6ae3edde53392d46a8ae98bba9"}
Jul 18 00:49:38.199871 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:38.199845    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4x8zs" event={"ID":"9f4a9808-2461-4e76-ac14-fd8490b62bd4","Type":"ContainerStarted","Data":"a5afe8ca91b672c1d4930e2e20b4a7060ec92a19078d002287b032e56907a75a"}
Jul 18 00:49:42.232784 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:42.232744    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4x8zs" event={"ID":"9f4a9808-2461-4e76-ac14-fd8490b62bd4","Type":"ContainerStarted","Data":"e54456c11f606aa548ba74f46dab5fe516c9bdb9bfc29f0bc636dd3253c08541"}
Jul 18 00:49:42.234199 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:42.234162    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8st58" event={"ID":"f4ecc28d-2f21-46f4-96f1-c5762c2acec5","Type":"ContainerStarted","Data":"855fcc91732cd01e949a878cf3c5221ab57e837ef5fb031b6f526bfccc9138b3"}
Jul 18 00:49:42.246284 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:42.246239    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-4x8zs" podStartSLOduration=1.916328155 podStartE2EDuration="5.246225194s" totalImagesPullingTime="3.329897039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:49:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:49:42.245601871 +0000 UTC m=+550.035013931" watchObservedRunningTime="2026-07-18 00:49:42.246225194 +0000 UTC m=+550.035637229"
Jul 18 00:49:42.260500 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:42.260451    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-8st58" podStartSLOduration=1.684867225 podStartE2EDuration="5.260435187s" totalImagesPullingTime="3.575567962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:49:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:49:42.258415731 +0000 UTC m=+550.047827786" watchObservedRunningTime="2026-07-18 00:49:42.260435187 +0000 UTC m=+550.049847245"
Jul 18 00:49:42.284895 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:42.284866    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8st58"]
Jul 18 00:49:44.244596 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:44.244554    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-8st58" podUID="f4ecc28d-2f21-46f4-96f1-c5762c2acec5" containerName="authorino" containerID="cri-o://855fcc91732cd01e949a878cf3c5221ab57e837ef5fb031b6f526bfccc9138b3" gracePeriod=30
Jul 18 00:49:44.495675 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:44.495614    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8st58"
Jul 18 00:49:44.648792 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:44.648758    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8mnf\" (UniqueName: \"kubernetes.io/projected/f4ecc28d-2f21-46f4-96f1-c5762c2acec5-kube-api-access-w8mnf\") pod \"f4ecc28d-2f21-46f4-96f1-c5762c2acec5\" (UID: \"f4ecc28d-2f21-46f4-96f1-c5762c2acec5\") "
Jul 18 00:49:44.651058 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:44.651019    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4ecc28d-2f21-46f4-96f1-c5762c2acec5-kube-api-access-w8mnf" (OuterVolumeSpecName: "kube-api-access-w8mnf") pod "f4ecc28d-2f21-46f4-96f1-c5762c2acec5" (UID: "f4ecc28d-2f21-46f4-96f1-c5762c2acec5"). InnerVolumeSpecName "kube-api-access-w8mnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 00:49:44.750291 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:44.750208    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8mnf\" (UniqueName: \"kubernetes.io/projected/f4ecc28d-2f21-46f4-96f1-c5762c2acec5-kube-api-access-w8mnf\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:49:45.253337 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:45.253304    2575 generic.go:356] "Generic (PLEG): container finished" podID="f4ecc28d-2f21-46f4-96f1-c5762c2acec5" containerID="855fcc91732cd01e949a878cf3c5221ab57e837ef5fb031b6f526bfccc9138b3" exitCode=0
Jul 18 00:49:45.253780 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:45.253344    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8st58"
Jul 18 00:49:45.253780 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:45.253389    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8st58" event={"ID":"f4ecc28d-2f21-46f4-96f1-c5762c2acec5","Type":"ContainerDied","Data":"855fcc91732cd01e949a878cf3c5221ab57e837ef5fb031b6f526bfccc9138b3"}
Jul 18 00:49:45.253780 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:45.253435    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8st58" event={"ID":"f4ecc28d-2f21-46f4-96f1-c5762c2acec5","Type":"ContainerDied","Data":"60edfafa2891b983d75fa152065558895d9dcd6ae3edde53392d46a8ae98bba9"}
Jul 18 00:49:45.253780 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:45.253455    2575 scope.go:117] "RemoveContainer" containerID="855fcc91732cd01e949a878cf3c5221ab57e837ef5fb031b6f526bfccc9138b3"
Jul 18 00:49:45.261808 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:45.261789    2575 scope.go:117] "RemoveContainer" containerID="855fcc91732cd01e949a878cf3c5221ab57e837ef5fb031b6f526bfccc9138b3"
Jul 18 00:49:45.262048 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:49:45.262030    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"855fcc91732cd01e949a878cf3c5221ab57e837ef5fb031b6f526bfccc9138b3\": container with ID starting with 855fcc91732cd01e949a878cf3c5221ab57e837ef5fb031b6f526bfccc9138b3 not found: ID does not exist" containerID="855fcc91732cd01e949a878cf3c5221ab57e837ef5fb031b6f526bfccc9138b3"
Jul 18 00:49:45.262092 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:45.262059    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"855fcc91732cd01e949a878cf3c5221ab57e837ef5fb031b6f526bfccc9138b3"} err="failed to get container status \"855fcc91732cd01e949a878cf3c5221ab57e837ef5fb031b6f526bfccc9138b3\": rpc error: code = NotFound desc = could not find container \"855fcc91732cd01e949a878cf3c5221ab57e837ef5fb031b6f526bfccc9138b3\": container with ID starting with 855fcc91732cd01e949a878cf3c5221ab57e837ef5fb031b6f526bfccc9138b3 not found: ID does not exist"
Jul 18 00:49:45.268999 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:45.268970    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8st58"]
Jul 18 00:49:45.272250 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:45.272231    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-8st58"]
Jul 18 00:49:46.678577 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:49:46.678545    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4ecc28d-2f21-46f4-96f1-c5762c2acec5" path="/var/lib/kubelet/pods/f4ecc28d-2f21-46f4-96f1-c5762c2acec5/volumes"
Jul 18 00:50:05.240598 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.240562    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-c2z85"]
Jul 18 00:50:05.240986 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.240902    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ecc28d-2f21-46f4-96f1-c5762c2acec5" containerName="authorino"
Jul 18 00:50:05.240986 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.240912    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ecc28d-2f21-46f4-96f1-c5762c2acec5" containerName="authorino"
Jul 18 00:50:05.241079 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.240990    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4ecc28d-2f21-46f4-96f1-c5762c2acec5" containerName="authorino"
Jul 18 00:50:05.244871 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.244855    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-c2z85"
Jul 18 00:50:05.253381 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.253356    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-c2z85"]
Jul 18 00:50:05.331178 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.331141    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfxnv\" (UniqueName: \"kubernetes.io/projected/e062f992-c429-4af0-9a79-1ffb716603cc-kube-api-access-dfxnv\") pod \"authorino-5d4b67c446-c2z85\" (UID: \"e062f992-c429-4af0-9a79-1ffb716603cc\") " pod="kuadrant-system/authorino-5d4b67c446-c2z85"
Jul 18 00:50:05.421803 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.421770    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-c2z85"]
Jul 18 00:50:05.422046 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:50:05.422028    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-dfxnv], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-c2z85" podUID="e062f992-c429-4af0-9a79-1ffb716603cc"
Jul 18 00:50:05.432510 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.432478    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfxnv\" (UniqueName: \"kubernetes.io/projected/e062f992-c429-4af0-9a79-1ffb716603cc-kube-api-access-dfxnv\") pod \"authorino-5d4b67c446-c2z85\" (UID: \"e062f992-c429-4af0-9a79-1ffb716603cc\") " pod="kuadrant-system/authorino-5d4b67c446-c2z85"
Jul 18 00:50:05.445509 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.445479    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-74czh"]
Jul 18 00:50:05.447630 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.447613    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-74czh"
Jul 18 00:50:05.449959 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.449938    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 18 00:50:05.450359 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.450343    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfxnv\" (UniqueName: \"kubernetes.io/projected/e062f992-c429-4af0-9a79-1ffb716603cc-kube-api-access-dfxnv\") pod \"authorino-5d4b67c446-c2z85\" (UID: \"e062f992-c429-4af0-9a79-1ffb716603cc\") " pod="kuadrant-system/authorino-5d4b67c446-c2z85"
Jul 18 00:50:05.454516 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.454496    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-74czh"]
Jul 18 00:50:05.491272 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.491207    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-74czh"]
Jul 18 00:50:05.491460 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:50:05.491443    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-x4q5h tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-x4q5h tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-74czh" podUID="faf83dbe-3f2b-4df2-afad-5b8d62b79256"
Jul 18 00:50:05.517034 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.517006    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d984fbcf-msrdj"]
Jul 18 00:50:05.519150 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.519122    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d984fbcf-msrdj"
Jul 18 00:50:05.527205 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.527158    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d984fbcf-msrdj"]
Jul 18 00:50:05.533411 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.533378    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4q5h\" (UniqueName: \"kubernetes.io/projected/faf83dbe-3f2b-4df2-afad-5b8d62b79256-kube-api-access-x4q5h\") pod \"authorino-76877994-74czh\" (UID: \"faf83dbe-3f2b-4df2-afad-5b8d62b79256\") " pod="kuadrant-system/authorino-76877994-74czh"
Jul 18 00:50:05.533534 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.533427    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/faf83dbe-3f2b-4df2-afad-5b8d62b79256-tls-cert\") pod \"authorino-76877994-74czh\" (UID: \"faf83dbe-3f2b-4df2-afad-5b8d62b79256\") " pod="kuadrant-system/authorino-76877994-74czh"
Jul 18 00:50:05.634085 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.634054    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/faf83dbe-3f2b-4df2-afad-5b8d62b79256-tls-cert\") pod \"authorino-76877994-74czh\" (UID: \"faf83dbe-3f2b-4df2-afad-5b8d62b79256\") " pod="kuadrant-system/authorino-76877994-74czh"
Jul 18 00:50:05.634352 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.634114    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/af211d31-0bd6-4f08-a04a-b3cd00812926-tls-cert\") pod \"authorino-5d984fbcf-msrdj\" (UID: \"af211d31-0bd6-4f08-a04a-b3cd00812926\") " pod="kuadrant-system/authorino-5d984fbcf-msrdj"
Jul 18 00:50:05.634352 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.634136    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k4nf\" (UniqueName: \"kubernetes.io/projected/af211d31-0bd6-4f08-a04a-b3cd00812926-kube-api-access-4k4nf\") pod \"authorino-5d984fbcf-msrdj\" (UID: \"af211d31-0bd6-4f08-a04a-b3cd00812926\") " pod="kuadrant-system/authorino-5d984fbcf-msrdj"
Jul 18 00:50:05.634352 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.634177    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4q5h\" (UniqueName: \"kubernetes.io/projected/faf83dbe-3f2b-4df2-afad-5b8d62b79256-kube-api-access-x4q5h\") pod \"authorino-76877994-74czh\" (UID: \"faf83dbe-3f2b-4df2-afad-5b8d62b79256\") " pod="kuadrant-system/authorino-76877994-74czh"
Jul 18 00:50:05.636834 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.636811    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/faf83dbe-3f2b-4df2-afad-5b8d62b79256-tls-cert\") pod \"authorino-76877994-74czh\" (UID: \"faf83dbe-3f2b-4df2-afad-5b8d62b79256\") " pod="kuadrant-system/authorino-76877994-74czh"
Jul 18 00:50:05.642067 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.642042    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4q5h\" (UniqueName: \"kubernetes.io/projected/faf83dbe-3f2b-4df2-afad-5b8d62b79256-kube-api-access-x4q5h\") pod \"authorino-76877994-74czh\" (UID: \"faf83dbe-3f2b-4df2-afad-5b8d62b79256\") " pod="kuadrant-system/authorino-76877994-74czh"
Jul 18 00:50:05.735243 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.735208    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k4nf\" (UniqueName: \"kubernetes.io/projected/af211d31-0bd6-4f08-a04a-b3cd00812926-kube-api-access-4k4nf\") pod \"authorino-5d984fbcf-msrdj\" (UID: \"af211d31-0bd6-4f08-a04a-b3cd00812926\") " pod="kuadrant-system/authorino-5d984fbcf-msrdj"
Jul 18 00:50:05.735416 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.735323    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/af211d31-0bd6-4f08-a04a-b3cd00812926-tls-cert\") pod \"authorino-5d984fbcf-msrdj\" (UID: \"af211d31-0bd6-4f08-a04a-b3cd00812926\") " pod="kuadrant-system/authorino-5d984fbcf-msrdj"
Jul 18 00:50:05.737891 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.737866    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/af211d31-0bd6-4f08-a04a-b3cd00812926-tls-cert\") pod \"authorino-5d984fbcf-msrdj\" (UID: \"af211d31-0bd6-4f08-a04a-b3cd00812926\") " pod="kuadrant-system/authorino-5d984fbcf-msrdj"
Jul 18 00:50:05.742768 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.742711    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k4nf\" (UniqueName: \"kubernetes.io/projected/af211d31-0bd6-4f08-a04a-b3cd00812926-kube-api-access-4k4nf\") pod \"authorino-5d984fbcf-msrdj\" (UID: \"af211d31-0bd6-4f08-a04a-b3cd00812926\") " pod="kuadrant-system/authorino-5d984fbcf-msrdj"
Jul 18 00:50:05.828816 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.828780    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d984fbcf-msrdj"
Jul 18 00:50:05.962075 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:05.962055    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d984fbcf-msrdj"]
Jul 18 00:50:05.964824 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:50:05.964797    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf211d31_0bd6_4f08_a04a_b3cd00812926.slice/crio-90243717be611454cf683e5592ad786d97657c2dbb8ca4dc70d93e9765c8778f WatchSource:0}: Error finding container 90243717be611454cf683e5592ad786d97657c2dbb8ca4dc70d93e9765c8778f: Status 404 returned error can't find the container with id 90243717be611454cf683e5592ad786d97657c2dbb8ca4dc70d93e9765c8778f
Jul 18 00:50:06.349981 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:06.349953    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d984fbcf-msrdj" event={"ID":"af211d31-0bd6-4f08-a04a-b3cd00812926","Type":"ContainerStarted","Data":"90243717be611454cf683e5592ad786d97657c2dbb8ca4dc70d93e9765c8778f"}
Jul 18 00:50:06.349981 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:06.349975    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-74czh"
Jul 18 00:50:06.350336 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:06.350126    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-c2z85"
Jul 18 00:50:06.355633 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:06.355616    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-74czh"
Jul 18 00:50:06.359007 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:06.358992    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-c2z85"
Jul 18 00:50:06.441932 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:06.441899    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfxnv\" (UniqueName: \"kubernetes.io/projected/e062f992-c429-4af0-9a79-1ffb716603cc-kube-api-access-dfxnv\") pod \"e062f992-c429-4af0-9a79-1ffb716603cc\" (UID: \"e062f992-c429-4af0-9a79-1ffb716603cc\") "
Jul 18 00:50:06.442116 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:06.441947    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4q5h\" (UniqueName: \"kubernetes.io/projected/faf83dbe-3f2b-4df2-afad-5b8d62b79256-kube-api-access-x4q5h\") pod \"faf83dbe-3f2b-4df2-afad-5b8d62b79256\" (UID: \"faf83dbe-3f2b-4df2-afad-5b8d62b79256\") "
Jul 18 00:50:06.442116 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:06.441984    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/faf83dbe-3f2b-4df2-afad-5b8d62b79256-tls-cert\") pod \"faf83dbe-3f2b-4df2-afad-5b8d62b79256\" (UID: \"faf83dbe-3f2b-4df2-afad-5b8d62b79256\") "
Jul 18 00:50:06.444690 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:06.444653    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e062f992-c429-4af0-9a79-1ffb716603cc-kube-api-access-dfxnv" (OuterVolumeSpecName: "kube-api-access-dfxnv") pod "e062f992-c429-4af0-9a79-1ffb716603cc" (UID: "e062f992-c429-4af0-9a79-1ffb716603cc"). InnerVolumeSpecName "kube-api-access-dfxnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 00:50:06.444797 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:06.444769    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faf83dbe-3f2b-4df2-afad-5b8d62b79256-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "faf83dbe-3f2b-4df2-afad-5b8d62b79256" (UID: "faf83dbe-3f2b-4df2-afad-5b8d62b79256"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:50:06.444893 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:06.444819    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faf83dbe-3f2b-4df2-afad-5b8d62b79256-kube-api-access-x4q5h" (OuterVolumeSpecName: "kube-api-access-x4q5h") pod "faf83dbe-3f2b-4df2-afad-5b8d62b79256" (UID: "faf83dbe-3f2b-4df2-afad-5b8d62b79256"). InnerVolumeSpecName "kube-api-access-x4q5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 00:50:06.543340 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:06.543301    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfxnv\" (UniqueName: \"kubernetes.io/projected/e062f992-c429-4af0-9a79-1ffb716603cc-kube-api-access-dfxnv\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:50:06.543340 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:06.543329    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4q5h\" (UniqueName: \"kubernetes.io/projected/faf83dbe-3f2b-4df2-afad-5b8d62b79256-kube-api-access-x4q5h\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:50:06.543340 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:06.543339    2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/faf83dbe-3f2b-4df2-afad-5b8d62b79256-tls-cert\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:50:07.355630 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:07.355591    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d984fbcf-msrdj" event={"ID":"af211d31-0bd6-4f08-a04a-b3cd00812926","Type":"ContainerStarted","Data":"250eb1bb006d8ce92b4dda673090fcecd910e0ce169edddc7289c78ba611e91a"}
Jul 18 00:50:07.356052 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:07.355724    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-74czh"
Jul 18 00:50:07.356052 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:07.355835    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-c2z85"
Jul 18 00:50:07.371690 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:07.371646    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d984fbcf-msrdj" podStartSLOduration=2.032536121 podStartE2EDuration="2.371632503s" totalImagesPullingTime="339.096382ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:50:07.370766473 +0000 UTC m=+575.160178531" watchObservedRunningTime="2026-07-18 00:50:07.371632503 +0000 UTC m=+575.161044580"
Jul 18 00:50:07.392701 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:07.392670    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-c2z85"]
Jul 18 00:50:07.403928 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:07.403895    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4x8zs"]
Jul 18 00:50:07.404363 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:07.404330    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-4x8zs" podUID="9f4a9808-2461-4e76-ac14-fd8490b62bd4" containerName="authorino" containerID="cri-o://e54456c11f606aa548ba74f46dab5fe516c9bdb9bfc29f0bc636dd3253c08541" gracePeriod=30
Jul 18 00:50:07.408614 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:07.408591    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-c2z85"]
Jul 18 00:50:07.427760 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:07.427732    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-74czh"]
Jul 18 00:50:07.432602 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:07.432577    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-74czh"]
Jul 18 00:50:07.665378 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:07.665350    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4x8zs"
Jul 18 00:50:07.754468 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:07.754434    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkk74\" (UniqueName: \"kubernetes.io/projected/9f4a9808-2461-4e76-ac14-fd8490b62bd4-kube-api-access-nkk74\") pod \"9f4a9808-2461-4e76-ac14-fd8490b62bd4\" (UID: \"9f4a9808-2461-4e76-ac14-fd8490b62bd4\") "
Jul 18 00:50:07.756780 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:07.756755    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f4a9808-2461-4e76-ac14-fd8490b62bd4-kube-api-access-nkk74" (OuterVolumeSpecName: "kube-api-access-nkk74") pod "9f4a9808-2461-4e76-ac14-fd8490b62bd4" (UID: "9f4a9808-2461-4e76-ac14-fd8490b62bd4"). InnerVolumeSpecName "kube-api-access-nkk74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 00:50:07.855581 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:07.855544    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkk74\" (UniqueName: \"kubernetes.io/projected/9f4a9808-2461-4e76-ac14-fd8490b62bd4-kube-api-access-nkk74\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:50:08.362277 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:08.362239    2575 generic.go:356] "Generic (PLEG): container finished" podID="9f4a9808-2461-4e76-ac14-fd8490b62bd4" containerID="e54456c11f606aa548ba74f46dab5fe516c9bdb9bfc29f0bc636dd3253c08541" exitCode=0
Jul 18 00:50:08.362277 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:08.362280    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4x8zs"
Jul 18 00:50:08.362843 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:08.362312    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4x8zs" event={"ID":"9f4a9808-2461-4e76-ac14-fd8490b62bd4","Type":"ContainerDied","Data":"e54456c11f606aa548ba74f46dab5fe516c9bdb9bfc29f0bc636dd3253c08541"}
Jul 18 00:50:08.362843 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:08.362348    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4x8zs" event={"ID":"9f4a9808-2461-4e76-ac14-fd8490b62bd4","Type":"ContainerDied","Data":"a5afe8ca91b672c1d4930e2e20b4a7060ec92a19078d002287b032e56907a75a"}
Jul 18 00:50:08.362843 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:08.362369    2575 scope.go:117] "RemoveContainer" containerID="e54456c11f606aa548ba74f46dab5fe516c9bdb9bfc29f0bc636dd3253c08541"
Jul 18 00:50:08.371405 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:08.371382    2575 scope.go:117] "RemoveContainer" containerID="e54456c11f606aa548ba74f46dab5fe516c9bdb9bfc29f0bc636dd3253c08541"
Jul 18 00:50:08.371717 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:50:08.371697    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e54456c11f606aa548ba74f46dab5fe516c9bdb9bfc29f0bc636dd3253c08541\": container with ID starting with e54456c11f606aa548ba74f46dab5fe516c9bdb9bfc29f0bc636dd3253c08541 not found: ID does not exist" containerID="e54456c11f606aa548ba74f46dab5fe516c9bdb9bfc29f0bc636dd3253c08541"
Jul 18 00:50:08.371765 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:08.371727    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e54456c11f606aa548ba74f46dab5fe516c9bdb9bfc29f0bc636dd3253c08541"} err="failed to get container status \"e54456c11f606aa548ba74f46dab5fe516c9bdb9bfc29f0bc636dd3253c08541\": rpc error: code = NotFound desc = could not find container \"e54456c11f606aa548ba74f46dab5fe516c9bdb9bfc29f0bc636dd3253c08541\": container with ID starting with e54456c11f606aa548ba74f46dab5fe516c9bdb9bfc29f0bc636dd3253c08541 not found: ID does not exist"
Jul 18 00:50:08.383050 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:08.383025    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4x8zs"]
Jul 18 00:50:08.386560 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:08.386540    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4x8zs"]
Jul 18 00:50:08.678719 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:08.678643    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f4a9808-2461-4e76-ac14-fd8490b62bd4" path="/var/lib/kubelet/pods/9f4a9808-2461-4e76-ac14-fd8490b62bd4/volumes"
Jul 18 00:50:08.678963 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:08.678950    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e062f992-c429-4af0-9a79-1ffb716603cc" path="/var/lib/kubelet/pods/e062f992-c429-4af0-9a79-1ffb716603cc/volumes"
Jul 18 00:50:08.679167 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:08.679156    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faf83dbe-3f2b-4df2-afad-5b8d62b79256" path="/var/lib/kubelet/pods/faf83dbe-3f2b-4df2-afad-5b8d62b79256/volumes"
Jul 18 00:50:32.559354 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:32.559324    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 00:50:32.560171 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:32.560151    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 00:50:49.125228 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:49.125176    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-6jjvv"]
Jul 18 00:50:49.125701 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:49.125552    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f4a9808-2461-4e76-ac14-fd8490b62bd4" containerName="authorino"
Jul 18 00:50:49.125701 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:49.125563    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f4a9808-2461-4e76-ac14-fd8490b62bd4" containerName="authorino"
Jul 18 00:50:49.125701 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:49.125627    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f4a9808-2461-4e76-ac14-fd8490b62bd4" containerName="authorino"
Jul 18 00:50:49.129832 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:49.129812    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-6jjvv"
Jul 18 00:50:49.132269 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:49.132242    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 18 00:50:49.139243 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:49.139225    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-6jjvv"]
Jul 18 00:50:49.217270 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:49.217235    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24291311-d822-4982-821b-410efb0066e3-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-6jjvv\" (UID: \"24291311-d822-4982-821b-410efb0066e3\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-6jjvv"
Jul 18 00:50:49.217270 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:49.217269    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrgbz\" (UniqueName: \"kubernetes.io/projected/24291311-d822-4982-821b-410efb0066e3-kube-api-access-vrgbz\") pod \"payload-pre-processing-7677b774bb-6jjvv\" (UID: \"24291311-d822-4982-821b-410efb0066e3\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-6jjvv"
Jul 18 00:50:49.317908 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:49.317858    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24291311-d822-4982-821b-410efb0066e3-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-6jjvv\" (UID: \"24291311-d822-4982-821b-410efb0066e3\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-6jjvv"
Jul 18 00:50:49.317908 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:49.317906    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrgbz\" (UniqueName: \"kubernetes.io/projected/24291311-d822-4982-821b-410efb0066e3-kube-api-access-vrgbz\") pod \"payload-pre-processing-7677b774bb-6jjvv\" (UID: \"24291311-d822-4982-821b-410efb0066e3\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-6jjvv"
Jul 18 00:50:49.318605 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:49.318580    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24291311-d822-4982-821b-410efb0066e3-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-6jjvv\" (UID: \"24291311-d822-4982-821b-410efb0066e3\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-6jjvv"
Jul 18 00:50:49.333245 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:49.333222    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrgbz\" (UniqueName: \"kubernetes.io/projected/24291311-d822-4982-821b-410efb0066e3-kube-api-access-vrgbz\") pod \"payload-pre-processing-7677b774bb-6jjvv\" (UID: \"24291311-d822-4982-821b-410efb0066e3\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-6jjvv"
Jul 18 00:50:49.441390 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:49.441308    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-6jjvv"
Jul 18 00:50:49.570873 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:49.570849    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-6jjvv"]
Jul 18 00:50:49.573263 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:50:49.573226    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24291311_d822_4982_821b_410efb0066e3.slice/crio-3b18e311642b897052edc2ce53066f8506a7e6eb9aff7b2b428081a405840e17 WatchSource:0}: Error finding container 3b18e311642b897052edc2ce53066f8506a7e6eb9aff7b2b428081a405840e17: Status 404 returned error can't find the container with id 3b18e311642b897052edc2ce53066f8506a7e6eb9aff7b2b428081a405840e17
Jul 18 00:50:50.567724 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:50.567685    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-6jjvv" event={"ID":"24291311-d822-4982-821b-410efb0066e3","Type":"ContainerStarted","Data":"3b18e311642b897052edc2ce53066f8506a7e6eb9aff7b2b428081a405840e17"}
Jul 18 00:50:51.573583 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:51.573550    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-6jjvv" event={"ID":"24291311-d822-4982-821b-410efb0066e3","Type":"ContainerStarted","Data":"a2876021f8096581be7f76e7c047371d93be8f28a8e813eed10be4fc83e73e7c"}
Jul 18 00:50:51.574014 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:51.573622    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-6jjvv"
Jul 18 00:50:51.590350 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:50:51.590299    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-6jjvv" podStartSLOduration=1.088465718 podStartE2EDuration="2.590283724s" totalImagesPullingTime="1.501818006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:50:51.589506841 +0000 UTC m=+619.378918900" watchObservedRunningTime="2026-07-18 00:50:51.590283724 +0000 UTC m=+619.379695780"
Jul 18 00:51:02.580407 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:02.580326    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-6jjvv"
Jul 18 00:51:22.330804 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.330771    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"]
Jul 18 00:51:22.334323 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.334307    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:22.337176 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.337143    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 18 00:51:22.338423 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.338404    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cdtw4\""
Jul 18 00:51:22.338423 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.338415    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 18 00:51:22.338587 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.338440    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 18 00:51:22.343571 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.343550    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"]
Jul 18 00:51:22.404710 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.404681    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90fa3261-cfbe-406a-b1ab-8b6850663af8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr87q\" (UID: \"90fa3261-cfbe-406a-b1ab-8b6850663af8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:22.404864 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.404720    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90fa3261-cfbe-406a-b1ab-8b6850663af8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr87q\" (UID: \"90fa3261-cfbe-406a-b1ab-8b6850663af8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:22.404864 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.404782    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90fa3261-cfbe-406a-b1ab-8b6850663af8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr87q\" (UID: \"90fa3261-cfbe-406a-b1ab-8b6850663af8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:22.404864 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.404798    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90fa3261-cfbe-406a-b1ab-8b6850663af8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr87q\" (UID: \"90fa3261-cfbe-406a-b1ab-8b6850663af8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:22.404864 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.404823    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90fa3261-cfbe-406a-b1ab-8b6850663af8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr87q\" (UID: \"90fa3261-cfbe-406a-b1ab-8b6850663af8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:22.404864 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.404843    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcjc8\" (UniqueName: \"kubernetes.io/projected/90fa3261-cfbe-406a-b1ab-8b6850663af8-kube-api-access-xcjc8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr87q\" (UID: \"90fa3261-cfbe-406a-b1ab-8b6850663af8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:22.505720 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.505685    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90fa3261-cfbe-406a-b1ab-8b6850663af8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr87q\" (UID: \"90fa3261-cfbe-406a-b1ab-8b6850663af8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:22.505720 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.505725    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90fa3261-cfbe-406a-b1ab-8b6850663af8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr87q\" (UID: \"90fa3261-cfbe-406a-b1ab-8b6850663af8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:22.505974 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.505755    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90fa3261-cfbe-406a-b1ab-8b6850663af8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr87q\" (UID: \"90fa3261-cfbe-406a-b1ab-8b6850663af8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:22.505974 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.505771    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcjc8\" (UniqueName: \"kubernetes.io/projected/90fa3261-cfbe-406a-b1ab-8b6850663af8-kube-api-access-xcjc8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr87q\" (UID: \"90fa3261-cfbe-406a-b1ab-8b6850663af8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:22.505974 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.505795    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90fa3261-cfbe-406a-b1ab-8b6850663af8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr87q\" (UID: \"90fa3261-cfbe-406a-b1ab-8b6850663af8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:22.505974 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.505821    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90fa3261-cfbe-406a-b1ab-8b6850663af8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr87q\" (UID: \"90fa3261-cfbe-406a-b1ab-8b6850663af8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:22.506244 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.506152    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90fa3261-cfbe-406a-b1ab-8b6850663af8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr87q\" (UID: \"90fa3261-cfbe-406a-b1ab-8b6850663af8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:22.506294 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.506238    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90fa3261-cfbe-406a-b1ab-8b6850663af8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr87q\" (UID: \"90fa3261-cfbe-406a-b1ab-8b6850663af8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:22.506294 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.506257    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90fa3261-cfbe-406a-b1ab-8b6850663af8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr87q\" (UID: \"90fa3261-cfbe-406a-b1ab-8b6850663af8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:22.508232 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.508177    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90fa3261-cfbe-406a-b1ab-8b6850663af8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr87q\" (UID: \"90fa3261-cfbe-406a-b1ab-8b6850663af8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:22.508438 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.508418    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90fa3261-cfbe-406a-b1ab-8b6850663af8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr87q\" (UID: \"90fa3261-cfbe-406a-b1ab-8b6850663af8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:22.514462 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.514440    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcjc8\" (UniqueName: \"kubernetes.io/projected/90fa3261-cfbe-406a-b1ab-8b6850663af8-kube-api-access-xcjc8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wr87q\" (UID: \"90fa3261-cfbe-406a-b1ab-8b6850663af8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:22.645734 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.645700    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:22.797972 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.797942    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"]
Jul 18 00:51:22.800517 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:51:22.800492    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90fa3261_cfbe_406a_b1ab_8b6850663af8.slice/crio-67166bba9522cf99f3ae3e6780044490eb790f08292bce0804f706e5ef9b4e3d WatchSource:0}: Error finding container 67166bba9522cf99f3ae3e6780044490eb790f08292bce0804f706e5ef9b4e3d: Status 404 returned error can't find the container with id 67166bba9522cf99f3ae3e6780044490eb790f08292bce0804f706e5ef9b4e3d
Jul 18 00:51:22.802112 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:22.802092    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 00:51:23.727552 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:23.727507    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q" event={"ID":"90fa3261-cfbe-406a-b1ab-8b6850663af8","Type":"ContainerStarted","Data":"67166bba9522cf99f3ae3e6780044490eb790f08292bce0804f706e5ef9b4e3d"}
Jul 18 00:51:24.733014 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:24.732973    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q" event={"ID":"90fa3261-cfbe-406a-b1ab-8b6850663af8","Type":"ContainerStarted","Data":"1c06fe7a1f09698d9b2615a60d67f483c01cf90363658b74bb3ea28aed08c782"}
Jul 18 00:51:24.750385 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:24.750337    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q" podStartSLOduration=1.677107999 podStartE2EDuration="2.750321215s" totalImagesPullingTime="1.073213216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:51:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:51:24.748568678 +0000 UTC m=+652.537980734" watchObservedRunningTime="2026-07-18 00:51:24.750321215 +0000 UTC m=+652.539733272"
Jul 18 00:51:32.646352 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:32.646313    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:32.646801 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:32.646371    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:32.658803 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:32.658780    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:32.788546 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:32.788514    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wr87q"
Jul 18 00:51:57.214136 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.214103    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"]
Jul 18 00:51:57.221295 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.221266    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:51:57.224099 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.224070    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 18 00:51:57.228374 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.228341    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"]
Jul 18 00:51:57.320365 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.320333    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c554feeb-8a1d-4a3f-bd3c-2aead365ad1f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p\" (UID: \"c554feeb-8a1d-4a3f-bd3c-2aead365ad1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:51:57.320539 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.320378    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c554feeb-8a1d-4a3f-bd3c-2aead365ad1f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p\" (UID: \"c554feeb-8a1d-4a3f-bd3c-2aead365ad1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:51:57.320539 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.320406    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfzpl\" (UniqueName: \"kubernetes.io/projected/c554feeb-8a1d-4a3f-bd3c-2aead365ad1f-kube-api-access-vfzpl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p\" (UID: \"c554feeb-8a1d-4a3f-bd3c-2aead365ad1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:51:57.320539 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.320517    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c554feeb-8a1d-4a3f-bd3c-2aead365ad1f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p\" (UID: \"c554feeb-8a1d-4a3f-bd3c-2aead365ad1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:51:57.320647 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.320569    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c554feeb-8a1d-4a3f-bd3c-2aead365ad1f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p\" (UID: \"c554feeb-8a1d-4a3f-bd3c-2aead365ad1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:51:57.320647 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.320591    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c554feeb-8a1d-4a3f-bd3c-2aead365ad1f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p\" (UID: \"c554feeb-8a1d-4a3f-bd3c-2aead365ad1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:51:57.421930 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.421890    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c554feeb-8a1d-4a3f-bd3c-2aead365ad1f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p\" (UID: \"c554feeb-8a1d-4a3f-bd3c-2aead365ad1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:51:57.422109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.421934    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c554feeb-8a1d-4a3f-bd3c-2aead365ad1f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p\" (UID: \"c554feeb-8a1d-4a3f-bd3c-2aead365ad1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:51:57.422109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.421971    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfzpl\" (UniqueName: \"kubernetes.io/projected/c554feeb-8a1d-4a3f-bd3c-2aead365ad1f-kube-api-access-vfzpl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p\" (UID: \"c554feeb-8a1d-4a3f-bd3c-2aead365ad1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:51:57.422109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.422012    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c554feeb-8a1d-4a3f-bd3c-2aead365ad1f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p\" (UID: \"c554feeb-8a1d-4a3f-bd3c-2aead365ad1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:51:57.422109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.422042    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c554feeb-8a1d-4a3f-bd3c-2aead365ad1f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p\" (UID: \"c554feeb-8a1d-4a3f-bd3c-2aead365ad1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:51:57.422109 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.422059    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c554feeb-8a1d-4a3f-bd3c-2aead365ad1f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p\" (UID: \"c554feeb-8a1d-4a3f-bd3c-2aead365ad1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:51:57.422418 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.422396    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c554feeb-8a1d-4a3f-bd3c-2aead365ad1f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p\" (UID: \"c554feeb-8a1d-4a3f-bd3c-2aead365ad1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:51:57.422479 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.422418    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c554feeb-8a1d-4a3f-bd3c-2aead365ad1f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p\" (UID: \"c554feeb-8a1d-4a3f-bd3c-2aead365ad1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:51:57.422530 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.422469    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c554feeb-8a1d-4a3f-bd3c-2aead365ad1f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p\" (UID: \"c554feeb-8a1d-4a3f-bd3c-2aead365ad1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:51:57.424487 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.424463    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c554feeb-8a1d-4a3f-bd3c-2aead365ad1f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p\" (UID: \"c554feeb-8a1d-4a3f-bd3c-2aead365ad1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:51:57.424721 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.424705    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c554feeb-8a1d-4a3f-bd3c-2aead365ad1f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p\" (UID: \"c554feeb-8a1d-4a3f-bd3c-2aead365ad1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:51:57.429759 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.429733    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfzpl\" (UniqueName: \"kubernetes.io/projected/c554feeb-8a1d-4a3f-bd3c-2aead365ad1f-kube-api-access-vfzpl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p\" (UID: \"c554feeb-8a1d-4a3f-bd3c-2aead365ad1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:51:57.542256 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.542142    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:51:57.674501 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.674467    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"]
Jul 18 00:51:57.677983 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:51:57.677944    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc554feeb_8a1d_4a3f_bd3c_2aead365ad1f.slice/crio-92e0352243f75a192855c35401b0f9aad732b1916e74b9b053b4df330b2e4a36 WatchSource:0}: Error finding container 92e0352243f75a192855c35401b0f9aad732b1916e74b9b053b4df330b2e4a36: Status 404 returned error can't find the container with id 92e0352243f75a192855c35401b0f9aad732b1916e74b9b053b4df330b2e4a36
Jul 18 00:51:57.896542 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:57.896514    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p" event={"ID":"c554feeb-8a1d-4a3f-bd3c-2aead365ad1f","Type":"ContainerStarted","Data":"92e0352243f75a192855c35401b0f9aad732b1916e74b9b053b4df330b2e4a36"}
Jul 18 00:51:58.904999 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:58.904963    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p" event={"ID":"c554feeb-8a1d-4a3f-bd3c-2aead365ad1f","Type":"ContainerStarted","Data":"e87c8f0dda96d1e8c7bdf0eec5e625689b51be5bd54a1c5f0b64f35032e42610"}
Jul 18 00:51:58.924468 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:51:58.924400    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p" podStartSLOduration=1.7650803229999998 podStartE2EDuration="1.924374754s" totalImagesPullingTime="159.294431ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:51:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:51:58.921676013 +0000 UTC m=+686.711088070" watchObservedRunningTime="2026-07-18 00:51:58.924374754 +0000 UTC m=+686.713786812"
Jul 18 00:52:07.543410 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:07.543371    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:52:07.543887 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:07.543439    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:52:07.555951 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:07.555927    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:52:07.959411 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:07.959377    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p"
Jul 18 00:52:20.028079 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.028043    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"]
Jul 18 00:52:20.031622 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.031606    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:52:20.034108 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.034089    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 18 00:52:20.040154 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.040132    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"]
Jul 18 00:52:20.133560 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.133525    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgwmq\" (UniqueName: \"kubernetes.io/projected/af335c44-5d42-454b-bc3e-cf30a216b2a5-kube-api-access-zgwmq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr\" (UID: \"af335c44-5d42-454b-bc3e-cf30a216b2a5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:52:20.133758 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.133571    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af335c44-5d42-454b-bc3e-cf30a216b2a5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr\" (UID: \"af335c44-5d42-454b-bc3e-cf30a216b2a5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:52:20.133758 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.133624    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af335c44-5d42-454b-bc3e-cf30a216b2a5-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr\" (UID: \"af335c44-5d42-454b-bc3e-cf30a216b2a5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:52:20.133758 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.133639    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af335c44-5d42-454b-bc3e-cf30a216b2a5-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr\" (UID: \"af335c44-5d42-454b-bc3e-cf30a216b2a5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:52:20.133758 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.133655    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af335c44-5d42-454b-bc3e-cf30a216b2a5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr\" (UID: \"af335c44-5d42-454b-bc3e-cf30a216b2a5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:52:20.133929 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.133760    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af335c44-5d42-454b-bc3e-cf30a216b2a5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr\" (UID: \"af335c44-5d42-454b-bc3e-cf30a216b2a5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:52:20.235079 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.235042    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgwmq\" (UniqueName: \"kubernetes.io/projected/af335c44-5d42-454b-bc3e-cf30a216b2a5-kube-api-access-zgwmq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr\" (UID: \"af335c44-5d42-454b-bc3e-cf30a216b2a5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:52:20.235299 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.235095    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af335c44-5d42-454b-bc3e-cf30a216b2a5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr\" (UID: \"af335c44-5d42-454b-bc3e-cf30a216b2a5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:52:20.235299 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.235140    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af335c44-5d42-454b-bc3e-cf30a216b2a5-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr\" (UID: \"af335c44-5d42-454b-bc3e-cf30a216b2a5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:52:20.235299 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.235161    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af335c44-5d42-454b-bc3e-cf30a216b2a5-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr\" (UID: \"af335c44-5d42-454b-bc3e-cf30a216b2a5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:52:20.235299 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.235207    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af335c44-5d42-454b-bc3e-cf30a216b2a5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr\" (UID: \"af335c44-5d42-454b-bc3e-cf30a216b2a5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:52:20.235299 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.235274    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af335c44-5d42-454b-bc3e-cf30a216b2a5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr\" (UID: \"af335c44-5d42-454b-bc3e-cf30a216b2a5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:52:20.235542 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.235504    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af335c44-5d42-454b-bc3e-cf30a216b2a5-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr\" (UID: \"af335c44-5d42-454b-bc3e-cf30a216b2a5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:52:20.235690 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.235670    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af335c44-5d42-454b-bc3e-cf30a216b2a5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr\" (UID: \"af335c44-5d42-454b-bc3e-cf30a216b2a5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:52:20.235751 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.235690    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af335c44-5d42-454b-bc3e-cf30a216b2a5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr\" (UID: \"af335c44-5d42-454b-bc3e-cf30a216b2a5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:52:20.237754 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.237730    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af335c44-5d42-454b-bc3e-cf30a216b2a5-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr\" (UID: \"af335c44-5d42-454b-bc3e-cf30a216b2a5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:52:20.237807 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.237760    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af335c44-5d42-454b-bc3e-cf30a216b2a5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr\" (UID: \"af335c44-5d42-454b-bc3e-cf30a216b2a5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:52:20.242439 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.242417    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgwmq\" (UniqueName: \"kubernetes.io/projected/af335c44-5d42-454b-bc3e-cf30a216b2a5-kube-api-access-zgwmq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr\" (UID: \"af335c44-5d42-454b-bc3e-cf30a216b2a5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:52:20.342255 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.342139    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:52:20.474608 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:20.474581    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"]
Jul 18 00:52:20.476057 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:52:20.476033    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf335c44_5d42_454b_bc3e_cf30a216b2a5.slice/crio-16ce0994223a2cff36a4bd99f9d30314072a15579a65bca3ad423af2717fc526 WatchSource:0}: Error finding container 16ce0994223a2cff36a4bd99f9d30314072a15579a65bca3ad423af2717fc526: Status 404 returned error can't find the container with id 16ce0994223a2cff36a4bd99f9d30314072a15579a65bca3ad423af2717fc526
Jul 18 00:52:21.017076 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:21.016984    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr" event={"ID":"af335c44-5d42-454b-bc3e-cf30a216b2a5","Type":"ContainerStarted","Data":"ebf00420cdf9771d719bb4fd213bcce80e132d01d20060516439d11378e3e7ef"}
Jul 18 00:52:21.017076 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:21.017029    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr" event={"ID":"af335c44-5d42-454b-bc3e-cf30a216b2a5","Type":"ContainerStarted","Data":"16ce0994223a2cff36a4bd99f9d30314072a15579a65bca3ad423af2717fc526"}
Jul 18 00:52:21.033035 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:21.032986    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr" podStartSLOduration=0.851361037 podStartE2EDuration="1.032972865s" totalImagesPullingTime="181.611828ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:52:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:52:21.032124621 +0000 UTC m=+708.821536681" watchObservedRunningTime="2026-07-18 00:52:21.032972865 +0000 UTC m=+708.822384922"
Jul 18 00:52:30.342497 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:30.342399    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:52:30.342497 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:30.342457    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:52:30.355027 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:30.355007    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:52:31.077238 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:52:31.077206    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr"
Jul 18 00:53:35.175650 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:35.175618    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5cb64f9966-8zkfq"]
Jul 18 00:53:35.179135 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:35.179115    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cb64f9966-8zkfq"
Jul 18 00:53:35.186079 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:35.186056    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cb64f9966-8zkfq"]
Jul 18 00:53:35.225414 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:35.225380    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckdqd\" (UniqueName: \"kubernetes.io/projected/cbd82392-c091-42cb-b359-c83e12bc5c9e-kube-api-access-ckdqd\") pod \"authorino-5cb64f9966-8zkfq\" (UID: \"cbd82392-c091-42cb-b359-c83e12bc5c9e\") " pod="kuadrant-system/authorino-5cb64f9966-8zkfq"
Jul 18 00:53:35.225601 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:35.225439    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cbd82392-c091-42cb-b359-c83e12bc5c9e-tls-cert\") pod \"authorino-5cb64f9966-8zkfq\" (UID: \"cbd82392-c091-42cb-b359-c83e12bc5c9e\") " pod="kuadrant-system/authorino-5cb64f9966-8zkfq"
Jul 18 00:53:35.326479 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:35.326442    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cbd82392-c091-42cb-b359-c83e12bc5c9e-tls-cert\") pod \"authorino-5cb64f9966-8zkfq\" (UID: \"cbd82392-c091-42cb-b359-c83e12bc5c9e\") " pod="kuadrant-system/authorino-5cb64f9966-8zkfq"
Jul 18 00:53:35.326630 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:35.326536    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckdqd\" (UniqueName: \"kubernetes.io/projected/cbd82392-c091-42cb-b359-c83e12bc5c9e-kube-api-access-ckdqd\") pod \"authorino-5cb64f9966-8zkfq\" (UID: \"cbd82392-c091-42cb-b359-c83e12bc5c9e\") " pod="kuadrant-system/authorino-5cb64f9966-8zkfq"
Jul 18 00:53:35.329001 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:35.328969    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cbd82392-c091-42cb-b359-c83e12bc5c9e-tls-cert\") pod \"authorino-5cb64f9966-8zkfq\" (UID: \"cbd82392-c091-42cb-b359-c83e12bc5c9e\") " pod="kuadrant-system/authorino-5cb64f9966-8zkfq"
Jul 18 00:53:35.334126 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:35.334095    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckdqd\" (UniqueName: \"kubernetes.io/projected/cbd82392-c091-42cb-b359-c83e12bc5c9e-kube-api-access-ckdqd\") pod \"authorino-5cb64f9966-8zkfq\" (UID: \"cbd82392-c091-42cb-b359-c83e12bc5c9e\") " pod="kuadrant-system/authorino-5cb64f9966-8zkfq"
Jul 18 00:53:35.489095 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:35.489019    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cb64f9966-8zkfq"
Jul 18 00:53:35.621956 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:35.621934    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cb64f9966-8zkfq"]
Jul 18 00:53:35.624598 ip-10-0-130-166 kubenswrapper[2575]: W0718 00:53:35.624568    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbd82392_c091_42cb_b359_c83e12bc5c9e.slice/crio-0beaf0ad2d96816548cfa2e3645ed05d523865dffbe71c58de1479358537665b WatchSource:0}: Error finding container 0beaf0ad2d96816548cfa2e3645ed05d523865dffbe71c58de1479358537665b: Status 404 returned error can't find the container with id 0beaf0ad2d96816548cfa2e3645ed05d523865dffbe71c58de1479358537665b
Jul 18 00:53:36.380447 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:36.380397    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cb64f9966-8zkfq" event={"ID":"cbd82392-c091-42cb-b359-c83e12bc5c9e","Type":"ContainerStarted","Data":"ad6c4d545b41fb9c188f13ba838660af5631542702ea020033d4d08d099ec471"}
Jul 18 00:53:36.380900 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:36.380461    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cb64f9966-8zkfq" event={"ID":"cbd82392-c091-42cb-b359-c83e12bc5c9e","Type":"ContainerStarted","Data":"0beaf0ad2d96816548cfa2e3645ed05d523865dffbe71c58de1479358537665b"}
Jul 18 00:53:36.491209 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:36.490272    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5cb64f9966-8zkfq" podStartSLOduration=1.209953745 podStartE2EDuration="1.490246884s" totalImagesPullingTime="280.293139ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:53:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:53:36.436543938 +0000 UTC m=+784.225955995" watchObservedRunningTime="2026-07-18 00:53:36.490246884 +0000 UTC m=+784.279658937"
Jul 18 00:53:36.492163 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:36.492131    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d984fbcf-msrdj"]
Jul 18 00:53:36.492404 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:36.492371    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d984fbcf-msrdj" podUID="af211d31-0bd6-4f08-a04a-b3cd00812926" containerName="authorino" containerID="cri-o://250eb1bb006d8ce92b4dda673090fcecd910e0ce169edddc7289c78ba611e91a" gracePeriod=30
Jul 18 00:53:36.759023 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:36.758994    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d984fbcf-msrdj"
Jul 18 00:53:36.842074 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:36.842039    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4k4nf\" (UniqueName: \"kubernetes.io/projected/af211d31-0bd6-4f08-a04a-b3cd00812926-kube-api-access-4k4nf\") pod \"af211d31-0bd6-4f08-a04a-b3cd00812926\" (UID: \"af211d31-0bd6-4f08-a04a-b3cd00812926\") "
Jul 18 00:53:36.842074 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:36.842091    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/af211d31-0bd6-4f08-a04a-b3cd00812926-tls-cert\") pod \"af211d31-0bd6-4f08-a04a-b3cd00812926\" (UID: \"af211d31-0bd6-4f08-a04a-b3cd00812926\") "
Jul 18 00:53:36.844912 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:36.844879    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af211d31-0bd6-4f08-a04a-b3cd00812926-kube-api-access-4k4nf" (OuterVolumeSpecName: "kube-api-access-4k4nf") pod "af211d31-0bd6-4f08-a04a-b3cd00812926" (UID: "af211d31-0bd6-4f08-a04a-b3cd00812926"). InnerVolumeSpecName "kube-api-access-4k4nf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 00:53:36.854750 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:36.854719    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af211d31-0bd6-4f08-a04a-b3cd00812926-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "af211d31-0bd6-4f08-a04a-b3cd00812926" (UID: "af211d31-0bd6-4f08-a04a-b3cd00812926"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 00:53:36.943586 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:36.943510    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4k4nf\" (UniqueName: \"kubernetes.io/projected/af211d31-0bd6-4f08-a04a-b3cd00812926-kube-api-access-4k4nf\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:53:36.943586 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:36.943537    2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/af211d31-0bd6-4f08-a04a-b3cd00812926-tls-cert\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 00:53:37.387758 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:37.387722    2575 generic.go:356] "Generic (PLEG): container finished" podID="af211d31-0bd6-4f08-a04a-b3cd00812926" containerID="250eb1bb006d8ce92b4dda673090fcecd910e0ce169edddc7289c78ba611e91a" exitCode=0
Jul 18 00:53:37.388250 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:37.387768    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d984fbcf-msrdj"
Jul 18 00:53:37.388250 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:37.387816    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d984fbcf-msrdj" event={"ID":"af211d31-0bd6-4f08-a04a-b3cd00812926","Type":"ContainerDied","Data":"250eb1bb006d8ce92b4dda673090fcecd910e0ce169edddc7289c78ba611e91a"}
Jul 18 00:53:37.388250 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:37.387885    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d984fbcf-msrdj" event={"ID":"af211d31-0bd6-4f08-a04a-b3cd00812926","Type":"ContainerDied","Data":"90243717be611454cf683e5592ad786d97657c2dbb8ca4dc70d93e9765c8778f"}
Jul 18 00:53:37.388250 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:37.387911    2575 scope.go:117] "RemoveContainer" containerID="250eb1bb006d8ce92b4dda673090fcecd910e0ce169edddc7289c78ba611e91a"
Jul 18 00:53:37.400364 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:37.400311    2575 scope.go:117] "RemoveContainer" containerID="250eb1bb006d8ce92b4dda673090fcecd910e0ce169edddc7289c78ba611e91a"
Jul 18 00:53:37.400932 ip-10-0-130-166 kubenswrapper[2575]: E0718 00:53:37.400908    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"250eb1bb006d8ce92b4dda673090fcecd910e0ce169edddc7289c78ba611e91a\": container with ID starting with 250eb1bb006d8ce92b4dda673090fcecd910e0ce169edddc7289c78ba611e91a not found: ID does not exist" containerID="250eb1bb006d8ce92b4dda673090fcecd910e0ce169edddc7289c78ba611e91a"
Jul 18 00:53:37.401003 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:37.400943    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"250eb1bb006d8ce92b4dda673090fcecd910e0ce169edddc7289c78ba611e91a"} err="failed to get container status \"250eb1bb006d8ce92b4dda673090fcecd910e0ce169edddc7289c78ba611e91a\": rpc error: code = NotFound desc = could not find container \"250eb1bb006d8ce92b4dda673090fcecd910e0ce169edddc7289c78ba611e91a\": container with ID starting with 250eb1bb006d8ce92b4dda673090fcecd910e0ce169edddc7289c78ba611e91a not found: ID does not exist"
Jul 18 00:53:37.408114 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:37.408089    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d984fbcf-msrdj"]
Jul 18 00:53:37.411504 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:37.411479    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d984fbcf-msrdj"]
Jul 18 00:53:38.678349 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:53:38.678316    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af211d31-0bd6-4f08-a04a-b3cd00812926" path="/var/lib/kubelet/pods/af211d31-0bd6-4f08-a04a-b3cd00812926/volumes"
Jul 18 00:55:32.590404 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:55:32.590370    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 00:55:32.590919 ip-10-0-130-166 kubenswrapper[2575]: I0718 00:55:32.590672    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 01:00:32.621299 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:00:32.621273    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 01:00:32.622167 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:00:32.622134    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 01:05:32.651954 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:05:32.651923    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 01:05:32.653470 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:05:32.653448    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 01:10:32.684997 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:10:32.684969    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 01:10:32.686022 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:10:32.686004    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 01:15:32.723002 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:15:32.722968    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 01:15:32.726419 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:15:32.726383    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 01:20:32.752932 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:20:32.752901    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 01:20:32.758049 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:20:32.758029    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 01:24:59.413779 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.413747    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"]
Jul 18 01:24:59.414229 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.414150    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af211d31-0bd6-4f08-a04a-b3cd00812926" containerName="authorino"
Jul 18 01:24:59.414229 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.414161    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="af211d31-0bd6-4f08-a04a-b3cd00812926" containerName="authorino"
Jul 18 01:24:59.414313 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.414248    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="af211d31-0bd6-4f08-a04a-b3cd00812926" containerName="authorino"
Jul 18 01:24:59.417390 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.417370    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:24:59.419994 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.419966    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f92ba3bc\"/\"openshift-service-ca.crt\""
Jul 18 01:24:59.420121 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.419976    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f92ba3bc\"/\"kube-root-ca.crt\""
Jul 18 01:24:59.421147 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.421127    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f92ba3bc\"/\"default-dockercfg-fzrhj\""
Jul 18 01:24:59.421248 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.421146    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f92ba3bc\"/\"e2e-lifecycle-model-f92ba3bc-kserve-self-signed-certs\""
Jul 18 01:24:59.425344 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.425324    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"]
Jul 18 01:24:59.494765 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.494729    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-home\") pod \"e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") " pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:24:59.494905 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.494789    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-dshm\") pod \"e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") " pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:24:59.494905 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.494813    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-tmp-dir\") pod \"e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") " pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:24:59.494905 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.494835    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-tls-certs\") pod \"e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") " pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:24:59.494905 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.494853    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-model-cache\") pod \"e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") " pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:24:59.494905 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.494876    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kchwg\" (UniqueName: \"kubernetes.io/projected/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-kube-api-access-kchwg\") pod \"e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") " pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:24:59.595660 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.595629    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-home\") pod \"e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") " pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:24:59.595826 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.595689    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-dshm\") pod \"e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") " pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:24:59.595826 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.595715    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-tmp-dir\") pod \"e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") " pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:24:59.595826 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.595737    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-tls-certs\") pod \"e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") " pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:24:59.595826 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.595762    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-model-cache\") pod \"e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") " pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:24:59.595826 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.595795    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kchwg\" (UniqueName: \"kubernetes.io/projected/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-kube-api-access-kchwg\") pod \"e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") " pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:24:59.596115 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.596094    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-home\") pod \"e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") " pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:24:59.596159 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.596138    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-tmp-dir\") pod \"e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") " pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:24:59.596241 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.596163    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-model-cache\") pod \"e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") " pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:24:59.598311 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.598282    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-dshm\") pod \"e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") " pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:24:59.598513 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.598497    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-tls-certs\") pod \"e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") " pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:24:59.603150 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.603130    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kchwg\" (UniqueName: \"kubernetes.io/projected/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-kube-api-access-kchwg\") pod \"e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") " pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:24:59.728811 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.728728    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:24:59.860602 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:24:59.860577    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"]
Jul 18 01:24:59.863501 ip-10-0-130-166 kubenswrapper[2575]: W0718 01:24:59.863475    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3dba7563_ebb7_4593_a13b_c8fd54bd21eb.slice/crio-5988c9b5af3a1ab6014d1127749c87f7af0de53fc5a11e50cc6d44e6aa06dd06 WatchSource:0}: Error finding container 5988c9b5af3a1ab6014d1127749c87f7af0de53fc5a11e50cc6d44e6aa06dd06: Status 404 returned error can't find the container with id 5988c9b5af3a1ab6014d1127749c87f7af0de53fc5a11e50cc6d44e6aa06dd06
Jul 18 01:25:00.337808 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:25:00.337769    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz" event={"ID":"3dba7563-ebb7-4593-a13b-c8fd54bd21eb","Type":"ContainerStarted","Data":"cce44ff82a0af05d31a93776aad92a7365f64d95880d6f361ba710dacc135616"}
Jul 18 01:25:00.338012 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:25:00.337815    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz" event={"ID":"3dba7563-ebb7-4593-a13b-c8fd54bd21eb","Type":"ContainerStarted","Data":"5988c9b5af3a1ab6014d1127749c87f7af0de53fc5a11e50cc6d44e6aa06dd06"}
Jul 18 01:25:00.357395 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:25:00.357349    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz" podStartSLOduration=1.357333493 podStartE2EDuration="1.357333493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:24:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:25:00.355435563 +0000 UTC m=+2668.144847638" watchObservedRunningTime="2026-07-18 01:25:00.357333493 +0000 UTC m=+2668.146745550"
Jul 18 01:25:09.729264 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:25:09.729226    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:25:09.729663 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:25:09.729282    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:25:09.741598 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:25:09.741570    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:25:10.401333 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:25:10.401305    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:25:32.787440 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:25:32.787333    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 01:25:32.792458 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:25:32.792437    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 01:25:47.766699 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:25:47.766664    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"]
Jul 18 01:26:02.787601 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:02.787527    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz" podUID="3dba7563-ebb7-4593-a13b-c8fd54bd21eb" containerName="main" containerID="cri-o://cce44ff82a0af05d31a93776aad92a7365f64d95880d6f361ba710dacc135616" gracePeriod=45
Jul 18 01:26:03.040281 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.040198    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:26:03.190014 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.189981    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-dshm\") pod \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") "
Jul 18 01:26:03.190271 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.190050    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kchwg\" (UniqueName: \"kubernetes.io/projected/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-kube-api-access-kchwg\") pod \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") "
Jul 18 01:26:03.190271 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.190106    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-tmp-dir\") pod \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") "
Jul 18 01:26:03.190271 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.190123    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-model-cache\") pod \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") "
Jul 18 01:26:03.190271 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.190150    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-tls-certs\") pod \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") "
Jul 18 01:26:03.190271 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.190220    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-home\") pod \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\" (UID: \"3dba7563-ebb7-4593-a13b-c8fd54bd21eb\") "
Jul 18 01:26:03.190571 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.190429    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3dba7563-ebb7-4593-a13b-c8fd54bd21eb" (UID: "3dba7563-ebb7-4593-a13b-c8fd54bd21eb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:26:03.190571 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.190443    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-model-cache" (OuterVolumeSpecName: "model-cache") pod "3dba7563-ebb7-4593-a13b-c8fd54bd21eb" (UID: "3dba7563-ebb7-4593-a13b-c8fd54bd21eb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:26:03.190571 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.190555    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-home" (OuterVolumeSpecName: "home") pod "3dba7563-ebb7-4593-a13b-c8fd54bd21eb" (UID: "3dba7563-ebb7-4593-a13b-c8fd54bd21eb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:26:03.191121 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.190575    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-tmp-dir\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:26:03.191121 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.190595    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-model-cache\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:26:03.192466 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.192438    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-dshm" (OuterVolumeSpecName: "dshm") pod "3dba7563-ebb7-4593-a13b-c8fd54bd21eb" (UID: "3dba7563-ebb7-4593-a13b-c8fd54bd21eb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:26:03.192544 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.192488    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-kube-api-access-kchwg" (OuterVolumeSpecName: "kube-api-access-kchwg") pod "3dba7563-ebb7-4593-a13b-c8fd54bd21eb" (UID: "3dba7563-ebb7-4593-a13b-c8fd54bd21eb"). InnerVolumeSpecName "kube-api-access-kchwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:26:03.192544 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.192522    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3dba7563-ebb7-4593-a13b-c8fd54bd21eb" (UID: "3dba7563-ebb7-4593-a13b-c8fd54bd21eb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:26:03.291443 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.291356    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-tls-certs\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:26:03.291443 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.291384    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-home\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:26:03.291443 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.291394    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-dshm\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:26:03.291443 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.291403    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kchwg\" (UniqueName: \"kubernetes.io/projected/3dba7563-ebb7-4593-a13b-c8fd54bd21eb-kube-api-access-kchwg\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:26:03.646297 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.646263    2575 generic.go:356] "Generic (PLEG): container finished" podID="3dba7563-ebb7-4593-a13b-c8fd54bd21eb" containerID="cce44ff82a0af05d31a93776aad92a7365f64d95880d6f361ba710dacc135616" exitCode=0
Jul 18 01:26:03.646479 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.646311    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"
Jul 18 01:26:03.646479 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.646328    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz" event={"ID":"3dba7563-ebb7-4593-a13b-c8fd54bd21eb","Type":"ContainerDied","Data":"cce44ff82a0af05d31a93776aad92a7365f64d95880d6f361ba710dacc135616"}
Jul 18 01:26:03.646479 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.646361    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz" event={"ID":"3dba7563-ebb7-4593-a13b-c8fd54bd21eb","Type":"ContainerDied","Data":"5988c9b5af3a1ab6014d1127749c87f7af0de53fc5a11e50cc6d44e6aa06dd06"}
Jul 18 01:26:03.646479 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.646378    2575 scope.go:117] "RemoveContainer" containerID="cce44ff82a0af05d31a93776aad92a7365f64d95880d6f361ba710dacc135616"
Jul 18 01:26:03.658137 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.658116    2575 scope.go:117] "RemoveContainer" containerID="cce44ff82a0af05d31a93776aad92a7365f64d95880d6f361ba710dacc135616"
Jul 18 01:26:03.658465 ip-10-0-130-166 kubenswrapper[2575]: E0718 01:26:03.658439    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cce44ff82a0af05d31a93776aad92a7365f64d95880d6f361ba710dacc135616\": container with ID starting with cce44ff82a0af05d31a93776aad92a7365f64d95880d6f361ba710dacc135616 not found: ID does not exist" containerID="cce44ff82a0af05d31a93776aad92a7365f64d95880d6f361ba710dacc135616"
Jul 18 01:26:03.658516 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.658474    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cce44ff82a0af05d31a93776aad92a7365f64d95880d6f361ba710dacc135616"} err="failed to get container status \"cce44ff82a0af05d31a93776aad92a7365f64d95880d6f361ba710dacc135616\": rpc error: code = NotFound desc = could not find container \"cce44ff82a0af05d31a93776aad92a7365f64d95880d6f361ba710dacc135616\": container with ID starting with cce44ff82a0af05d31a93776aad92a7365f64d95880d6f361ba710dacc135616 not found: ID does not exist"
Jul 18 01:26:03.668852 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.668830    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"]
Jul 18 01:26:03.672520 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:03.672501    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-f92ba3bc/e2e-lifecycle-model-f92ba3bc-kserve-54cb9d5df5-mk9nz"]
Jul 18 01:26:04.678113 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:26:04.678077    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dba7563-ebb7-4593-a13b-c8fd54bd21eb" path="/var/lib/kubelet/pods/3dba7563-ebb7-4593-a13b-c8fd54bd21eb/volumes"
Jul 18 01:28:15.022365 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.022321    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"]
Jul 18 01:28:15.022909 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.022803    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dba7563-ebb7-4593-a13b-c8fd54bd21eb" containerName="main"
Jul 18 01:28:15.022909 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.022821    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dba7563-ebb7-4593-a13b-c8fd54bd21eb" containerName="main"
Jul 18 01:28:15.022995 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.022914    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dba7563-ebb7-4593-a13b-c8fd54bd21eb" containerName="main"
Jul 18 01:28:15.027350 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.027323    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:15.031272 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.031250    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-1e72d0\"/\"default-dockercfg-x4gfm\""
Jul 18 01:28:15.031272 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.031260    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-1e72d0\"/\"openshift-service-ca.crt\""
Jul 18 01:28:15.032384 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.032361    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-1e72d0\"/\"test-model-1e72d0-kserve-self-signed-certs\""
Jul 18 01:28:15.032614 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.032432    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-1e72d0\"/\"kube-root-ca.crt\""
Jul 18 01:28:15.036153 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.036129    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"]
Jul 18 01:28:15.200897 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.200856    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qgqv\" (UniqueName: \"kubernetes.io/projected/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-kube-api-access-6qgqv\") pod \"test-model-1e72d0-kserve-5566f9d487-nk8w4\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") " pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:15.200897 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.200902    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-model-cache\") pod \"test-model-1e72d0-kserve-5566f9d487-nk8w4\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") " pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:15.201115 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.200981    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-tmp-dir\") pod \"test-model-1e72d0-kserve-5566f9d487-nk8w4\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") " pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:15.201115 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.201039    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-tls-certs\") pod \"test-model-1e72d0-kserve-5566f9d487-nk8w4\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") " pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:15.201225 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.201112    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-dshm\") pod \"test-model-1e72d0-kserve-5566f9d487-nk8w4\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") " pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:15.201225 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.201135    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-home\") pod \"test-model-1e72d0-kserve-5566f9d487-nk8w4\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") " pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:15.302408 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.302302    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-tmp-dir\") pod \"test-model-1e72d0-kserve-5566f9d487-nk8w4\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") " pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:15.302408 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.302343    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-tls-certs\") pod \"test-model-1e72d0-kserve-5566f9d487-nk8w4\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") " pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:15.302408 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.302389    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-dshm\") pod \"test-model-1e72d0-kserve-5566f9d487-nk8w4\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") " pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:15.302408 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.302408    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-home\") pod \"test-model-1e72d0-kserve-5566f9d487-nk8w4\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") " pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:15.302761 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.302425    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qgqv\" (UniqueName: \"kubernetes.io/projected/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-kube-api-access-6qgqv\") pod \"test-model-1e72d0-kserve-5566f9d487-nk8w4\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") " pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:15.302761 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.302448    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-model-cache\") pod \"test-model-1e72d0-kserve-5566f9d487-nk8w4\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") " pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:15.302862 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.302793    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-tmp-dir\") pod \"test-model-1e72d0-kserve-5566f9d487-nk8w4\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") " pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:15.302862 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.302840    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-home\") pod \"test-model-1e72d0-kserve-5566f9d487-nk8w4\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") " pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:15.302976 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.302887    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-model-cache\") pod \"test-model-1e72d0-kserve-5566f9d487-nk8w4\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") " pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:15.304747 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.304725    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-dshm\") pod \"test-model-1e72d0-kserve-5566f9d487-nk8w4\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") " pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:15.305001 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.304984    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-tls-certs\") pod \"test-model-1e72d0-kserve-5566f9d487-nk8w4\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") " pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:15.310469 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.310447    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qgqv\" (UniqueName: \"kubernetes.io/projected/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-kube-api-access-6qgqv\") pod \"test-model-1e72d0-kserve-5566f9d487-nk8w4\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") " pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:15.340544 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.340503    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:15.477124 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:15.477094    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"]
Jul 18 01:28:15.480153 ip-10-0-130-166 kubenswrapper[2575]: W0718 01:28:15.480129    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81b8ed46_e7f2_45f8_ba05_f18f85bd8291.slice/crio-0fb66b8f38eae3485fb804f74225619fcadab9d55799d675b88fdc3f890c41a6 WatchSource:0}: Error finding container 0fb66b8f38eae3485fb804f74225619fcadab9d55799d675b88fdc3f890c41a6: Status 404 returned error can't find the container with id 0fb66b8f38eae3485fb804f74225619fcadab9d55799d675b88fdc3f890c41a6
Jul 18 01:28:16.282898 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:16.282859    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4" event={"ID":"81b8ed46-e7f2-45f8-ba05-f18f85bd8291","Type":"ContainerStarted","Data":"3605113205cd9fdfa0e534b5e71a476e2ae9cc11651add60ea8075a6842530ee"}
Jul 18 01:28:16.282898 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:16.282909    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4" event={"ID":"81b8ed46-e7f2-45f8-ba05-f18f85bd8291","Type":"ContainerStarted","Data":"0fb66b8f38eae3485fb804f74225619fcadab9d55799d675b88fdc3f890c41a6"}
Jul 18 01:28:16.301766 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:16.301712    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4" podStartSLOduration=1.3016936669999999 podStartE2EDuration="1.301693667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:28:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:28:16.299981263 +0000 UTC m=+2864.089393322" watchObservedRunningTime="2026-07-18 01:28:16.301693667 +0000 UTC m=+2864.091105725"
Jul 18 01:28:25.340882 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:25.340776    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:25.340882 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:25.340831    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:25.353771 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:25.353740    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:26.358864 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:26.358822    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:28:37.918998 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:37.918961    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"]
Jul 18 01:28:37.923368 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:37.923341    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:37.926983 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:37.926962    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-8e3c6c\"/\"default-dockercfg-ctg27\""
Jul 18 01:28:37.926983 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:37.926974    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-8e3c6c\"/\"openshift-service-ca.crt\""
Jul 18 01:28:37.927198 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:37.926984    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-8e3c6c\"/\"test-model-8e3c6c-kserve-self-signed-certs\""
Jul 18 01:28:37.927198 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:37.926977    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-8e3c6c\"/\"kube-root-ca.crt\""
Jul 18 01:28:37.931491 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:37.931456    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"]
Jul 18 01:28:38.023198 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:38.023156    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-dshm\") pod \"test-model-8e3c6c-kserve-6d96857f89-2fpfn\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") " pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:38.023362 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:38.023215    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-home\") pod \"test-model-8e3c6c-kserve-6d96857f89-2fpfn\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") " pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:38.023362 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:38.023273    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-tls-certs\") pod \"test-model-8e3c6c-kserve-6d96857f89-2fpfn\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") " pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:38.023362 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:38.023289    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6shf\" (UniqueName: \"kubernetes.io/projected/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-kube-api-access-w6shf\") pod \"test-model-8e3c6c-kserve-6d96857f89-2fpfn\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") " pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:38.023362 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:38.023317    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-model-cache\") pod \"test-model-8e3c6c-kserve-6d96857f89-2fpfn\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") " pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:38.023362 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:38.023349    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-tmp-dir\") pod \"test-model-8e3c6c-kserve-6d96857f89-2fpfn\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") " pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:38.124134 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:38.124093    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-dshm\") pod \"test-model-8e3c6c-kserve-6d96857f89-2fpfn\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") " pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:38.124134 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:38.124136    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-home\") pod \"test-model-8e3c6c-kserve-6d96857f89-2fpfn\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") " pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:38.124443 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:38.124228    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-tls-certs\") pod \"test-model-8e3c6c-kserve-6d96857f89-2fpfn\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") " pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:38.124443 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:38.124254    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6shf\" (UniqueName: \"kubernetes.io/projected/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-kube-api-access-w6shf\") pod \"test-model-8e3c6c-kserve-6d96857f89-2fpfn\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") " pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:38.124443 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:38.124290    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-model-cache\") pod \"test-model-8e3c6c-kserve-6d96857f89-2fpfn\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") " pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:38.124443 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:38.124312    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-tmp-dir\") pod \"test-model-8e3c6c-kserve-6d96857f89-2fpfn\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") " pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:38.124646 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:38.124590    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-home\") pod \"test-model-8e3c6c-kserve-6d96857f89-2fpfn\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") " pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:38.124646 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:38.124637    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-model-cache\") pod \"test-model-8e3c6c-kserve-6d96857f89-2fpfn\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") " pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:38.124754 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:38.124734    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-tmp-dir\") pod \"test-model-8e3c6c-kserve-6d96857f89-2fpfn\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") " pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:38.126636 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:38.126609    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-dshm\") pod \"test-model-8e3c6c-kserve-6d96857f89-2fpfn\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") " pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:38.126777 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:38.126761    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-tls-certs\") pod \"test-model-8e3c6c-kserve-6d96857f89-2fpfn\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") " pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:38.132348 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:38.132328    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6shf\" (UniqueName: \"kubernetes.io/projected/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-kube-api-access-w6shf\") pod \"test-model-8e3c6c-kserve-6d96857f89-2fpfn\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") " pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:38.234405 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:38.234318    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:38.367950 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:38.367917    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"]
Jul 18 01:28:38.371381 ip-10-0-130-166 kubenswrapper[2575]: W0718 01:28:38.371350    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb793e40_9d1d_437f_bbfe_0a886cc3bfbc.slice/crio-cc2191ca7d77f31c1c2ec8b76a8e0074f3d2a2c0cb959e45d9c2b77e886e0482 WatchSource:0}: Error finding container cc2191ca7d77f31c1c2ec8b76a8e0074f3d2a2c0cb959e45d9c2b77e886e0482: Status 404 returned error can't find the container with id cc2191ca7d77f31c1c2ec8b76a8e0074f3d2a2c0cb959e45d9c2b77e886e0482
Jul 18 01:28:38.403712 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:38.403683    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn" event={"ID":"db793e40-9d1d-437f-bbfe-0a886cc3bfbc","Type":"ContainerStarted","Data":"cc2191ca7d77f31c1c2ec8b76a8e0074f3d2a2c0cb959e45d9c2b77e886e0482"}
Jul 18 01:28:39.410581 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:39.410551    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn" event={"ID":"db793e40-9d1d-437f-bbfe-0a886cc3bfbc","Type":"ContainerStarted","Data":"34a39a605555005f7174bec96925aad8dd9e51f396834bf8fcfeeca565899188"}
Jul 18 01:28:39.427470 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:39.427425    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn" podStartSLOduration=2.427408883 podStartE2EDuration="2.427408883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:28:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:28:39.425295937 +0000 UTC m=+2887.214707992" watchObservedRunningTime="2026-07-18 01:28:39.427408883 +0000 UTC m=+2887.216820940"
Jul 18 01:28:48.235113 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:48.235075    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:48.235113 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:48.235123    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:48.247635 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:48.247602    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:48.465704 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:48.465676    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:28:58.108037 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:58.108004    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"]
Jul 18 01:28:58.968241 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:28:58.968178    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"]
Jul 18 01:29:13.129355 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.129306    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4" podUID="81b8ed46-e7f2-45f8-ba05-f18f85bd8291" containerName="main" containerID="cri-o://3605113205cd9fdfa0e534b5e71a476e2ae9cc11651add60ea8075a6842530ee" gracePeriod=45
Jul 18 01:29:13.380684 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.380602    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:29:13.467149 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.467111    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-tls-certs\") pod \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") "
Jul 18 01:29:13.467369 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.467220    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-model-cache\") pod \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") "
Jul 18 01:29:13.467369 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.467255    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-tmp-dir\") pod \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") "
Jul 18 01:29:13.467369 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.467285    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-dshm\") pod \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") "
Jul 18 01:29:13.467369 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.467340    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-home\") pod \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") "
Jul 18 01:29:13.467606 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.467396    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qgqv\" (UniqueName: \"kubernetes.io/projected/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-kube-api-access-6qgqv\") pod \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\" (UID: \"81b8ed46-e7f2-45f8-ba05-f18f85bd8291\") "
Jul 18 01:29:13.467606 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.467496    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-model-cache" (OuterVolumeSpecName: "model-cache") pod "81b8ed46-e7f2-45f8-ba05-f18f85bd8291" (UID: "81b8ed46-e7f2-45f8-ba05-f18f85bd8291"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:29:13.467606 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.467542    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "81b8ed46-e7f2-45f8-ba05-f18f85bd8291" (UID: "81b8ed46-e7f2-45f8-ba05-f18f85bd8291"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:29:13.467762 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.467638    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-home" (OuterVolumeSpecName: "home") pod "81b8ed46-e7f2-45f8-ba05-f18f85bd8291" (UID: "81b8ed46-e7f2-45f8-ba05-f18f85bd8291"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:29:13.467762 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.467728    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-model-cache\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:29:13.467762 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.467746    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-tmp-dir\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:29:13.467762 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.467754    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-home\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:29:13.469659 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.469633    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "81b8ed46-e7f2-45f8-ba05-f18f85bd8291" (UID: "81b8ed46-e7f2-45f8-ba05-f18f85bd8291"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:29:13.469760 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.469658    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-dshm" (OuterVolumeSpecName: "dshm") pod "81b8ed46-e7f2-45f8-ba05-f18f85bd8291" (UID: "81b8ed46-e7f2-45f8-ba05-f18f85bd8291"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:29:13.469760 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.469701    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-kube-api-access-6qgqv" (OuterVolumeSpecName: "kube-api-access-6qgqv") pod "81b8ed46-e7f2-45f8-ba05-f18f85bd8291" (UID: "81b8ed46-e7f2-45f8-ba05-f18f85bd8291"). InnerVolumeSpecName "kube-api-access-6qgqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:29:13.568641 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.568605    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qgqv\" (UniqueName: \"kubernetes.io/projected/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-kube-api-access-6qgqv\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:29:13.568641 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.568637    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-tls-certs\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:29:13.568641 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.568648    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81b8ed46-e7f2-45f8-ba05-f18f85bd8291-dshm\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:29:13.581978 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.581939    2575 generic.go:356] "Generic (PLEG): container finished" podID="81b8ed46-e7f2-45f8-ba05-f18f85bd8291" containerID="3605113205cd9fdfa0e534b5e71a476e2ae9cc11651add60ea8075a6842530ee" exitCode=0
Jul 18 01:29:13.582126 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.582003    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"
Jul 18 01:29:13.582126 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.582014    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4" event={"ID":"81b8ed46-e7f2-45f8-ba05-f18f85bd8291","Type":"ContainerDied","Data":"3605113205cd9fdfa0e534b5e71a476e2ae9cc11651add60ea8075a6842530ee"}
Jul 18 01:29:13.582126 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.582056    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4" event={"ID":"81b8ed46-e7f2-45f8-ba05-f18f85bd8291","Type":"ContainerDied","Data":"0fb66b8f38eae3485fb804f74225619fcadab9d55799d675b88fdc3f890c41a6"}
Jul 18 01:29:13.582126 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.582080    2575 scope.go:117] "RemoveContainer" containerID="3605113205cd9fdfa0e534b5e71a476e2ae9cc11651add60ea8075a6842530ee"
Jul 18 01:29:13.591282 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.591263    2575 scope.go:117] "RemoveContainer" containerID="3605113205cd9fdfa0e534b5e71a476e2ae9cc11651add60ea8075a6842530ee"
Jul 18 01:29:13.591590 ip-10-0-130-166 kubenswrapper[2575]: E0718 01:29:13.591572    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3605113205cd9fdfa0e534b5e71a476e2ae9cc11651add60ea8075a6842530ee\": container with ID starting with 3605113205cd9fdfa0e534b5e71a476e2ae9cc11651add60ea8075a6842530ee not found: ID does not exist" containerID="3605113205cd9fdfa0e534b5e71a476e2ae9cc11651add60ea8075a6842530ee"
Jul 18 01:29:13.591636 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.591599    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3605113205cd9fdfa0e534b5e71a476e2ae9cc11651add60ea8075a6842530ee"} err="failed to get container status \"3605113205cd9fdfa0e534b5e71a476e2ae9cc11651add60ea8075a6842530ee\": rpc error: code = NotFound desc = could not find container \"3605113205cd9fdfa0e534b5e71a476e2ae9cc11651add60ea8075a6842530ee\": container with ID starting with 3605113205cd9fdfa0e534b5e71a476e2ae9cc11651add60ea8075a6842530ee not found: ID does not exist"
Jul 18 01:29:13.602541 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.602510    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"]
Jul 18 01:29:13.610096 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.610071    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-1e72d0/test-model-1e72d0-kserve-5566f9d487-nk8w4"]
Jul 18 01:29:13.990780 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:13.990736    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn" podUID="db793e40-9d1d-437f-bbfe-0a886cc3bfbc" containerName="main" containerID="cri-o://34a39a605555005f7174bec96925aad8dd9e51f396834bf8fcfeeca565899188" gracePeriod=45
Jul 18 01:29:14.249892 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.249826    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:29:14.276401 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.276372    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-dshm\") pod \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") "
Jul 18 01:29:14.276579 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.276417    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-home\") pod \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") "
Jul 18 01:29:14.276579 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.276443    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6shf\" (UniqueName: \"kubernetes.io/projected/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-kube-api-access-w6shf\") pod \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") "
Jul 18 01:29:14.276579 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.276478    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-tmp-dir\") pod \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") "
Jul 18 01:29:14.276579 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.276571    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-model-cache\") pod \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") "
Jul 18 01:29:14.276808 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.276600    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-tls-certs\") pod \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\" (UID: \"db793e40-9d1d-437f-bbfe-0a886cc3bfbc\") "
Jul 18 01:29:14.276808 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.276643    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-home" (OuterVolumeSpecName: "home") pod "db793e40-9d1d-437f-bbfe-0a886cc3bfbc" (UID: "db793e40-9d1d-437f-bbfe-0a886cc3bfbc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:29:14.276922 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.276887    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "db793e40-9d1d-437f-bbfe-0a886cc3bfbc" (UID: "db793e40-9d1d-437f-bbfe-0a886cc3bfbc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:29:14.276922 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.276894    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-home\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:29:14.277025 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.276997    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-model-cache" (OuterVolumeSpecName: "model-cache") pod "db793e40-9d1d-437f-bbfe-0a886cc3bfbc" (UID: "db793e40-9d1d-437f-bbfe-0a886cc3bfbc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:29:14.278864 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.278836    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-kube-api-access-w6shf" (OuterVolumeSpecName: "kube-api-access-w6shf") pod "db793e40-9d1d-437f-bbfe-0a886cc3bfbc" (UID: "db793e40-9d1d-437f-bbfe-0a886cc3bfbc"). InnerVolumeSpecName "kube-api-access-w6shf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:29:14.278965 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.278935    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "db793e40-9d1d-437f-bbfe-0a886cc3bfbc" (UID: "db793e40-9d1d-437f-bbfe-0a886cc3bfbc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:29:14.279113 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.279094    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-dshm" (OuterVolumeSpecName: "dshm") pod "db793e40-9d1d-437f-bbfe-0a886cc3bfbc" (UID: "db793e40-9d1d-437f-bbfe-0a886cc3bfbc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:29:14.377927 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.377887    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-model-cache\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:29:14.377927 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.377920    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-tls-certs\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:29:14.377927 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.377928    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-dshm\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:29:14.377927 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.377937    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6shf\" (UniqueName: \"kubernetes.io/projected/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-kube-api-access-w6shf\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:29:14.378240 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.377949    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db793e40-9d1d-437f-bbfe-0a886cc3bfbc-tmp-dir\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:29:14.589136 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.589044    2575 generic.go:356] "Generic (PLEG): container finished" podID="db793e40-9d1d-437f-bbfe-0a886cc3bfbc" containerID="34a39a605555005f7174bec96925aad8dd9e51f396834bf8fcfeeca565899188" exitCode=0
Jul 18 01:29:14.589136 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.589080    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn" event={"ID":"db793e40-9d1d-437f-bbfe-0a886cc3bfbc","Type":"ContainerDied","Data":"34a39a605555005f7174bec96925aad8dd9e51f396834bf8fcfeeca565899188"}
Jul 18 01:29:14.589136 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.589093    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"
Jul 18 01:29:14.589136 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.589106    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn" event={"ID":"db793e40-9d1d-437f-bbfe-0a886cc3bfbc","Type":"ContainerDied","Data":"cc2191ca7d77f31c1c2ec8b76a8e0074f3d2a2c0cb959e45d9c2b77e886e0482"}
Jul 18 01:29:14.589136 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.589122    2575 scope.go:117] "RemoveContainer" containerID="34a39a605555005f7174bec96925aad8dd9e51f396834bf8fcfeeca565899188"
Jul 18 01:29:14.598552 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.598536    2575 scope.go:117] "RemoveContainer" containerID="34a39a605555005f7174bec96925aad8dd9e51f396834bf8fcfeeca565899188"
Jul 18 01:29:14.598823 ip-10-0-130-166 kubenswrapper[2575]: E0718 01:29:14.598804    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34a39a605555005f7174bec96925aad8dd9e51f396834bf8fcfeeca565899188\": container with ID starting with 34a39a605555005f7174bec96925aad8dd9e51f396834bf8fcfeeca565899188 not found: ID does not exist" containerID="34a39a605555005f7174bec96925aad8dd9e51f396834bf8fcfeeca565899188"
Jul 18 01:29:14.598862 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.598830    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34a39a605555005f7174bec96925aad8dd9e51f396834bf8fcfeeca565899188"} err="failed to get container status \"34a39a605555005f7174bec96925aad8dd9e51f396834bf8fcfeeca565899188\": rpc error: code = NotFound desc = could not find container \"34a39a605555005f7174bec96925aad8dd9e51f396834bf8fcfeeca565899188\": container with ID starting with 34a39a605555005f7174bec96925aad8dd9e51f396834bf8fcfeeca565899188 not found: ID does not exist"
Jul 18 01:29:14.610094 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.610061    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"]
Jul 18 01:29:14.614222 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.614163    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-8e3c6c/test-model-8e3c6c-kserve-6d96857f89-2fpfn"]
Jul 18 01:29:14.678913 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.678877    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81b8ed46-e7f2-45f8-ba05-f18f85bd8291" path="/var/lib/kubelet/pods/81b8ed46-e7f2-45f8-ba05-f18f85bd8291/volumes"
Jul 18 01:29:14.679364 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:29:14.679349    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db793e40-9d1d-437f-bbfe-0a886cc3bfbc" path="/var/lib/kubelet/pods/db793e40-9d1d-437f-bbfe-0a886cc3bfbc/volumes"
Jul 18 01:30:32.817410 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:30:32.817284    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 01:30:32.824284 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:30:32.824261    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 01:31:51.706090 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.706052    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"]
Jul 18 01:31:51.706612 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.706468    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81b8ed46-e7f2-45f8-ba05-f18f85bd8291" containerName="main"
Jul 18 01:31:51.706612 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.706480    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="81b8ed46-e7f2-45f8-ba05-f18f85bd8291" containerName="main"
Jul 18 01:31:51.706612 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.706511    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db793e40-9d1d-437f-bbfe-0a886cc3bfbc" containerName="main"
Jul 18 01:31:51.706612 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.706517    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="db793e40-9d1d-437f-bbfe-0a886cc3bfbc" containerName="main"
Jul 18 01:31:51.706612 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.706586    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="81b8ed46-e7f2-45f8-ba05-f18f85bd8291" containerName="main"
Jul 18 01:31:51.706612 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.706596    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="db793e40-9d1d-437f-bbfe-0a886cc3bfbc" containerName="main"
Jul 18 01:31:51.709766 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.709750    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:31:51.713562 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.713537    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6b3233\"/\"openshift-service-ca.crt\""
Jul 18 01:31:51.713562 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.713553    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6b3233\"/\"kube-root-ca.crt\""
Jul 18 01:31:51.713764 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.713568    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6b3233\"/\"auth-test-model-6b3233-kserve-self-signed-certs\""
Jul 18 01:31:51.713764 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.713537    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6b3233\"/\"default-dockercfg-wj657\""
Jul 18 01:31:51.718562 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.718541    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"]
Jul 18 01:31:51.826423 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.826379    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-dshm\") pod \"auth-test-model-6b3233-kserve-76c7897b7-88qt7\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") " pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:31:51.826423 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.826423    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-tmp-dir\") pod \"auth-test-model-6b3233-kserve-76c7897b7-88qt7\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") " pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:31:51.826646 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.826445    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-model-cache\") pod \"auth-test-model-6b3233-kserve-76c7897b7-88qt7\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") " pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:31:51.826646 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.826513    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4272e23-f6ce-43f1-99fd-9b5690f602f2-tls-certs\") pod \"auth-test-model-6b3233-kserve-76c7897b7-88qt7\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") " pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:31:51.826646 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.826593    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-home\") pod \"auth-test-model-6b3233-kserve-76c7897b7-88qt7\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") " pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:31:51.826745 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.826644    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds5ln\" (UniqueName: \"kubernetes.io/projected/e4272e23-f6ce-43f1-99fd-9b5690f602f2-kube-api-access-ds5ln\") pod \"auth-test-model-6b3233-kserve-76c7897b7-88qt7\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") " pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:31:51.927565 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.927534    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-dshm\") pod \"auth-test-model-6b3233-kserve-76c7897b7-88qt7\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") " pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:31:51.927565 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.927567    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-tmp-dir\") pod \"auth-test-model-6b3233-kserve-76c7897b7-88qt7\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") " pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:31:51.927812 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.927589    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-model-cache\") pod \"auth-test-model-6b3233-kserve-76c7897b7-88qt7\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") " pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:31:51.928130 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.927890    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4272e23-f6ce-43f1-99fd-9b5690f602f2-tls-certs\") pod \"auth-test-model-6b3233-kserve-76c7897b7-88qt7\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") " pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:31:51.928130 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.927977    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-home\") pod \"auth-test-model-6b3233-kserve-76c7897b7-88qt7\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") " pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:31:51.928130 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.927983    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-model-cache\") pod \"auth-test-model-6b3233-kserve-76c7897b7-88qt7\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") " pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:31:51.928130 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.928031    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds5ln\" (UniqueName: \"kubernetes.io/projected/e4272e23-f6ce-43f1-99fd-9b5690f602f2-kube-api-access-ds5ln\") pod \"auth-test-model-6b3233-kserve-76c7897b7-88qt7\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") " pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:31:51.928130 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.928031    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-tmp-dir\") pod \"auth-test-model-6b3233-kserve-76c7897b7-88qt7\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") " pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:31:51.928486 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.928338    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-home\") pod \"auth-test-model-6b3233-kserve-76c7897b7-88qt7\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") " pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:31:51.930069 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.930038    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-dshm\") pod \"auth-test-model-6b3233-kserve-76c7897b7-88qt7\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") " pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:31:51.931295 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.931273    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4272e23-f6ce-43f1-99fd-9b5690f602f2-tls-certs\") pod \"auth-test-model-6b3233-kserve-76c7897b7-88qt7\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") " pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:31:51.936497 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:51.936476    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds5ln\" (UniqueName: \"kubernetes.io/projected/e4272e23-f6ce-43f1-99fd-9b5690f602f2-kube-api-access-ds5ln\") pod \"auth-test-model-6b3233-kserve-76c7897b7-88qt7\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") " pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:31:52.020393 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:52.020290    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:31:52.161793 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:52.161762    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"]
Jul 18 01:31:52.165005 ip-10-0-130-166 kubenswrapper[2575]: W0718 01:31:52.164972    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4272e23_f6ce_43f1_99fd_9b5690f602f2.slice/crio-06e4ee403729e3f4580c443f8733632a0d278da2042f4248411cb728f92002ab WatchSource:0}: Error finding container 06e4ee403729e3f4580c443f8733632a0d278da2042f4248411cb728f92002ab: Status 404 returned error can't find the container with id 06e4ee403729e3f4580c443f8733632a0d278da2042f4248411cb728f92002ab
Jul 18 01:31:52.368485 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:52.368450    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7" event={"ID":"e4272e23-f6ce-43f1-99fd-9b5690f602f2","Type":"ContainerStarted","Data":"cae99cec56e8c6d62461e61962b107a58bca6f5294e4085df517504dbc9427b8"}
Jul 18 01:31:52.368485 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:52.368493    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7" event={"ID":"e4272e23-f6ce-43f1-99fd-9b5690f602f2","Type":"ContainerStarted","Data":"06e4ee403729e3f4580c443f8733632a0d278da2042f4248411cb728f92002ab"}
Jul 18 01:31:52.386082 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:31:52.386029    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7" podStartSLOduration=1.386009262 podStartE2EDuration="1.386009262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:31:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:31:52.385445334 +0000 UTC m=+3080.174857392" watchObservedRunningTime="2026-07-18 01:31:52.386009262 +0000 UTC m=+3080.175421318"
Jul 18 01:32:02.020455 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:02.020414    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:32:02.020455 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:02.020459    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:32:02.033548 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:02.033519    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:32:02.430302 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:02.430271    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:32:10.504022 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.503985    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"]
Jul 18 01:32:10.508349 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.508317    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:32:10.511990 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.511966    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b17102\"/\"auth-test-model-b17102-kserve-self-signed-certs\""
Jul 18 01:32:10.512161 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.512007    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b17102\"/\"kube-root-ca.crt\""
Jul 18 01:32:10.512161 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.512034    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b17102\"/\"default-dockercfg-b56bz\""
Jul 18 01:32:10.512161 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.512065    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b17102\"/\"openshift-service-ca.crt\""
Jul 18 01:32:10.517137 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.516683    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"]
Jul 18 01:32:10.606655 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.606616    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-home\") pod \"auth-test-model-b17102-kserve-6fb7489b7f-slzkd\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") " pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:32:10.606655 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.606655    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-dshm\") pod \"auth-test-model-b17102-kserve-6fb7489b7f-slzkd\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") " pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:32:10.606889 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.606746    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-tmp-dir\") pod \"auth-test-model-b17102-kserve-6fb7489b7f-slzkd\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") " pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:32:10.606889 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.606804    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-model-cache\") pod \"auth-test-model-b17102-kserve-6fb7489b7f-slzkd\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") " pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:32:10.606889 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.606833    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e1b038-b11e-4993-8952-49c768d8b368-tls-certs\") pod \"auth-test-model-b17102-kserve-6fb7489b7f-slzkd\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") " pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:32:10.606889 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.606858    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh9ll\" (UniqueName: \"kubernetes.io/projected/d9e1b038-b11e-4993-8952-49c768d8b368-kube-api-access-lh9ll\") pod \"auth-test-model-b17102-kserve-6fb7489b7f-slzkd\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") " pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:32:10.707812 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.707766    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-home\") pod \"auth-test-model-b17102-kserve-6fb7489b7f-slzkd\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") " pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:32:10.707812 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.707807    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-dshm\") pod \"auth-test-model-b17102-kserve-6fb7489b7f-slzkd\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") " pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:32:10.708057 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.707841    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-tmp-dir\") pod \"auth-test-model-b17102-kserve-6fb7489b7f-slzkd\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") " pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:32:10.708057 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.707869    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-model-cache\") pod \"auth-test-model-b17102-kserve-6fb7489b7f-slzkd\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") " pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:32:10.708057 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.707894    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e1b038-b11e-4993-8952-49c768d8b368-tls-certs\") pod \"auth-test-model-b17102-kserve-6fb7489b7f-slzkd\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") " pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:32:10.708057 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.707912    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh9ll\" (UniqueName: \"kubernetes.io/projected/d9e1b038-b11e-4993-8952-49c768d8b368-kube-api-access-lh9ll\") pod \"auth-test-model-b17102-kserve-6fb7489b7f-slzkd\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") " pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:32:10.708373 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.708346    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-tmp-dir\") pod \"auth-test-model-b17102-kserve-6fb7489b7f-slzkd\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") " pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:32:10.708462 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.708359    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-home\") pod \"auth-test-model-b17102-kserve-6fb7489b7f-slzkd\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") " pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:32:10.708462 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.708404    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-model-cache\") pod \"auth-test-model-b17102-kserve-6fb7489b7f-slzkd\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") " pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:32:10.710344 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.710323    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-dshm\") pod \"auth-test-model-b17102-kserve-6fb7489b7f-slzkd\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") " pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:32:10.710603 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.710583    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e1b038-b11e-4993-8952-49c768d8b368-tls-certs\") pod \"auth-test-model-b17102-kserve-6fb7489b7f-slzkd\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") " pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:32:10.716379 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.716356    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh9ll\" (UniqueName: \"kubernetes.io/projected/d9e1b038-b11e-4993-8952-49c768d8b368-kube-api-access-lh9ll\") pod \"auth-test-model-b17102-kserve-6fb7489b7f-slzkd\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") " pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:32:10.820115 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.820012    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:32:10.962440 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:10.962413    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"]
Jul 18 01:32:10.964775 ip-10-0-130-166 kubenswrapper[2575]: W0718 01:32:10.964744    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9e1b038_b11e_4993_8952_49c768d8b368.slice/crio-b646c5fe8614563b534d8f8ee3501d504cefc7582f534fffbc5b3dc8b455c5a8 WatchSource:0}: Error finding container b646c5fe8614563b534d8f8ee3501d504cefc7582f534fffbc5b3dc8b455c5a8: Status 404 returned error can't find the container with id b646c5fe8614563b534d8f8ee3501d504cefc7582f534fffbc5b3dc8b455c5a8
Jul 18 01:32:11.463172 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:11.463131    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd" event={"ID":"d9e1b038-b11e-4993-8952-49c768d8b368","Type":"ContainerStarted","Data":"822c644956e4cd3955b02d21b232f239dd326b31e58b9c41c5732c6fe5dbcb89"}
Jul 18 01:32:11.463172 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:11.463197    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd" event={"ID":"d9e1b038-b11e-4993-8952-49c768d8b368","Type":"ContainerStarted","Data":"b646c5fe8614563b534d8f8ee3501d504cefc7582f534fffbc5b3dc8b455c5a8"}
Jul 18 01:32:11.481338 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:11.481277    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd" podStartSLOduration=1.481254621 podStartE2EDuration="1.481254621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:32:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:32:11.480810216 +0000 UTC m=+3099.270222275" watchObservedRunningTime="2026-07-18 01:32:11.481254621 +0000 UTC m=+3099.270666687"
Jul 18 01:32:20.820690 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:20.820648    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:32:20.821120 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:20.820918    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:32:20.833521 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:20.833492    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:32:21.524395 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:32:21.524363    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:34:34.762664 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:34.762621    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"]
Jul 18 01:34:35.699108 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:35.699061    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"]
Jul 18 01:34:49.783955 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:49.783879    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7" podUID="e4272e23-f6ce-43f1-99fd-9b5690f602f2" containerName="main" containerID="cri-o://cae99cec56e8c6d62461e61962b107a58bca6f5294e4085df517504dbc9427b8" gracePeriod=45
Jul 18 01:34:50.047750 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.047667    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:34:50.130207 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.130154    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-tmp-dir\") pod \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") "
Jul 18 01:34:50.130415 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.130228    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ds5ln\" (UniqueName: \"kubernetes.io/projected/e4272e23-f6ce-43f1-99fd-9b5690f602f2-kube-api-access-ds5ln\") pod \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") "
Jul 18 01:34:50.130415 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.130283    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-dshm\") pod \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") "
Jul 18 01:34:50.130415 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.130301    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-model-cache\") pod \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") "
Jul 18 01:34:50.130415 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.130331    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-home\") pod \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") "
Jul 18 01:34:50.130415 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.130368    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4272e23-f6ce-43f1-99fd-9b5690f602f2-tls-certs\") pod \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\" (UID: \"e4272e23-f6ce-43f1-99fd-9b5690f602f2\") "
Jul 18 01:34:50.130668 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.130516    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e4272e23-f6ce-43f1-99fd-9b5690f602f2" (UID: "e4272e23-f6ce-43f1-99fd-9b5690f602f2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:34:50.130668 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.130597    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-home" (OuterVolumeSpecName: "home") pod "e4272e23-f6ce-43f1-99fd-9b5690f602f2" (UID: "e4272e23-f6ce-43f1-99fd-9b5690f602f2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:34:50.130668 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.130620    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-model-cache" (OuterVolumeSpecName: "model-cache") pod "e4272e23-f6ce-43f1-99fd-9b5690f602f2" (UID: "e4272e23-f6ce-43f1-99fd-9b5690f602f2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:34:50.130778 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.130736    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-tmp-dir\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:34:50.130778 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.130750    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-model-cache\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:34:50.130778 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.130758    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-home\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:34:50.132819 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.132789    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4272e23-f6ce-43f1-99fd-9b5690f602f2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e4272e23-f6ce-43f1-99fd-9b5690f602f2" (UID: "e4272e23-f6ce-43f1-99fd-9b5690f602f2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:34:50.132912 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.132850    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4272e23-f6ce-43f1-99fd-9b5690f602f2-kube-api-access-ds5ln" (OuterVolumeSpecName: "kube-api-access-ds5ln") pod "e4272e23-f6ce-43f1-99fd-9b5690f602f2" (UID: "e4272e23-f6ce-43f1-99fd-9b5690f602f2"). InnerVolumeSpecName "kube-api-access-ds5ln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:34:50.132912 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.132870    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-dshm" (OuterVolumeSpecName: "dshm") pod "e4272e23-f6ce-43f1-99fd-9b5690f602f2" (UID: "e4272e23-f6ce-43f1-99fd-9b5690f602f2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:34:50.232298 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.232259    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4272e23-f6ce-43f1-99fd-9b5690f602f2-dshm\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:34:50.232298 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.232290    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4272e23-f6ce-43f1-99fd-9b5690f602f2-tls-certs\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:34:50.232298 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.232301    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ds5ln\" (UniqueName: \"kubernetes.io/projected/e4272e23-f6ce-43f1-99fd-9b5690f602f2-kube-api-access-ds5ln\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:34:50.252594 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.252547    2575 generic.go:356] "Generic (PLEG): container finished" podID="e4272e23-f6ce-43f1-99fd-9b5690f602f2" containerID="cae99cec56e8c6d62461e61962b107a58bca6f5294e4085df517504dbc9427b8" exitCode=0
Jul 18 01:34:50.252594 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.252591    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"
Jul 18 01:34:50.252843 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.252631    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7" event={"ID":"e4272e23-f6ce-43f1-99fd-9b5690f602f2","Type":"ContainerDied","Data":"cae99cec56e8c6d62461e61962b107a58bca6f5294e4085df517504dbc9427b8"}
Jul 18 01:34:50.252843 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.252674    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7" event={"ID":"e4272e23-f6ce-43f1-99fd-9b5690f602f2","Type":"ContainerDied","Data":"06e4ee403729e3f4580c443f8733632a0d278da2042f4248411cb728f92002ab"}
Jul 18 01:34:50.252843 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.252692    2575 scope.go:117] "RemoveContainer" containerID="cae99cec56e8c6d62461e61962b107a58bca6f5294e4085df517504dbc9427b8"
Jul 18 01:34:50.262409 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.262389    2575 scope.go:117] "RemoveContainer" containerID="cae99cec56e8c6d62461e61962b107a58bca6f5294e4085df517504dbc9427b8"
Jul 18 01:34:50.262731 ip-10-0-130-166 kubenswrapper[2575]: E0718 01:34:50.262714    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cae99cec56e8c6d62461e61962b107a58bca6f5294e4085df517504dbc9427b8\": container with ID starting with cae99cec56e8c6d62461e61962b107a58bca6f5294e4085df517504dbc9427b8 not found: ID does not exist" containerID="cae99cec56e8c6d62461e61962b107a58bca6f5294e4085df517504dbc9427b8"
Jul 18 01:34:50.262801 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.262742    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cae99cec56e8c6d62461e61962b107a58bca6f5294e4085df517504dbc9427b8"} err="failed to get container status \"cae99cec56e8c6d62461e61962b107a58bca6f5294e4085df517504dbc9427b8\": rpc error: code = NotFound desc = could not find container \"cae99cec56e8c6d62461e61962b107a58bca6f5294e4085df517504dbc9427b8\": container with ID starting with cae99cec56e8c6d62461e61962b107a58bca6f5294e4085df517504dbc9427b8 not found: ID does not exist"
Jul 18 01:34:50.275538 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.275502    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"]
Jul 18 01:34:50.281675 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.281645    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6b3233/auth-test-model-6b3233-kserve-76c7897b7-88qt7"]
Jul 18 01:34:50.679427 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.679392    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4272e23-f6ce-43f1-99fd-9b5690f602f2" path="/var/lib/kubelet/pods/e4272e23-f6ce-43f1-99fd-9b5690f602f2/volumes"
Jul 18 01:34:50.720630 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.720589    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd" podUID="d9e1b038-b11e-4993-8952-49c768d8b368" containerName="main" containerID="cri-o://822c644956e4cd3955b02d21b232f239dd326b31e58b9c41c5732c6fe5dbcb89" gracePeriod=45
Jul 18 01:34:50.975866 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:50.975839    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:34:51.144371 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.144331    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e1b038-b11e-4993-8952-49c768d8b368-tls-certs\") pod \"d9e1b038-b11e-4993-8952-49c768d8b368\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") "
Jul 18 01:34:51.144555 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.144390    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-model-cache\") pod \"d9e1b038-b11e-4993-8952-49c768d8b368\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") "
Jul 18 01:34:51.144555 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.144409    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lh9ll\" (UniqueName: \"kubernetes.io/projected/d9e1b038-b11e-4993-8952-49c768d8b368-kube-api-access-lh9ll\") pod \"d9e1b038-b11e-4993-8952-49c768d8b368\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") "
Jul 18 01:34:51.144555 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.144482    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-dshm\") pod \"d9e1b038-b11e-4993-8952-49c768d8b368\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") "
Jul 18 01:34:51.144555 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.144522    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-tmp-dir\") pod \"d9e1b038-b11e-4993-8952-49c768d8b368\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") "
Jul 18 01:34:51.144745 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.144604    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-home\") pod \"d9e1b038-b11e-4993-8952-49c768d8b368\" (UID: \"d9e1b038-b11e-4993-8952-49c768d8b368\") "
Jul 18 01:34:51.144745 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.144711    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-model-cache" (OuterVolumeSpecName: "model-cache") pod "d9e1b038-b11e-4993-8952-49c768d8b368" (UID: "d9e1b038-b11e-4993-8952-49c768d8b368"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:34:51.144887 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.144864    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-home" (OuterVolumeSpecName: "home") pod "d9e1b038-b11e-4993-8952-49c768d8b368" (UID: "d9e1b038-b11e-4993-8952-49c768d8b368"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:34:51.144972 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.144896    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d9e1b038-b11e-4993-8952-49c768d8b368" (UID: "d9e1b038-b11e-4993-8952-49c768d8b368"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:34:51.145041 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.145023    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-model-cache\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:34:51.145099 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.145049    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-tmp-dir\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:34:51.145099 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.145063    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-home\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:34:51.147062 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.147034    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-dshm" (OuterVolumeSpecName: "dshm") pod "d9e1b038-b11e-4993-8952-49c768d8b368" (UID: "d9e1b038-b11e-4993-8952-49c768d8b368"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:34:51.147266 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.147239    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9e1b038-b11e-4993-8952-49c768d8b368-kube-api-access-lh9ll" (OuterVolumeSpecName: "kube-api-access-lh9ll") pod "d9e1b038-b11e-4993-8952-49c768d8b368" (UID: "d9e1b038-b11e-4993-8952-49c768d8b368"). InnerVolumeSpecName "kube-api-access-lh9ll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:34:51.147266 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.147245    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9e1b038-b11e-4993-8952-49c768d8b368-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d9e1b038-b11e-4993-8952-49c768d8b368" (UID: "d9e1b038-b11e-4993-8952-49c768d8b368"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:34:51.246061 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.245964    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e1b038-b11e-4993-8952-49c768d8b368-tls-certs\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:34:51.246061 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.245996    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lh9ll\" (UniqueName: \"kubernetes.io/projected/d9e1b038-b11e-4993-8952-49c768d8b368-kube-api-access-lh9ll\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:34:51.246061 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.246007    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e1b038-b11e-4993-8952-49c768d8b368-dshm\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:34:51.259144 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.259113    2575 generic.go:356] "Generic (PLEG): container finished" podID="d9e1b038-b11e-4993-8952-49c768d8b368" containerID="822c644956e4cd3955b02d21b232f239dd326b31e58b9c41c5732c6fe5dbcb89" exitCode=0
Jul 18 01:34:51.259351 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.259158    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"
Jul 18 01:34:51.259351 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.259165    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd" event={"ID":"d9e1b038-b11e-4993-8952-49c768d8b368","Type":"ContainerDied","Data":"822c644956e4cd3955b02d21b232f239dd326b31e58b9c41c5732c6fe5dbcb89"}
Jul 18 01:34:51.259351 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.259232    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd" event={"ID":"d9e1b038-b11e-4993-8952-49c768d8b368","Type":"ContainerDied","Data":"b646c5fe8614563b534d8f8ee3501d504cefc7582f534fffbc5b3dc8b455c5a8"}
Jul 18 01:34:51.259351 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.259255    2575 scope.go:117] "RemoveContainer" containerID="822c644956e4cd3955b02d21b232f239dd326b31e58b9c41c5732c6fe5dbcb89"
Jul 18 01:34:51.269782 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.269662    2575 scope.go:117] "RemoveContainer" containerID="822c644956e4cd3955b02d21b232f239dd326b31e58b9c41c5732c6fe5dbcb89"
Jul 18 01:34:51.270082 ip-10-0-130-166 kubenswrapper[2575]: E0718 01:34:51.270058    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"822c644956e4cd3955b02d21b232f239dd326b31e58b9c41c5732c6fe5dbcb89\": container with ID starting with 822c644956e4cd3955b02d21b232f239dd326b31e58b9c41c5732c6fe5dbcb89 not found: ID does not exist" containerID="822c644956e4cd3955b02d21b232f239dd326b31e58b9c41c5732c6fe5dbcb89"
Jul 18 01:34:51.270220 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.270092    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"822c644956e4cd3955b02d21b232f239dd326b31e58b9c41c5732c6fe5dbcb89"} err="failed to get container status \"822c644956e4cd3955b02d21b232f239dd326b31e58b9c41c5732c6fe5dbcb89\": rpc error: code = NotFound desc = could not find container \"822c644956e4cd3955b02d21b232f239dd326b31e58b9c41c5732c6fe5dbcb89\": container with ID starting with 822c644956e4cd3955b02d21b232f239dd326b31e58b9c41c5732c6fe5dbcb89 not found: ID does not exist"
Jul 18 01:34:51.283058 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.283027    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"]
Jul 18 01:34:51.287152 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:51.287127    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b17102/auth-test-model-b17102-kserve-6fb7489b7f-slzkd"]
Jul 18 01:34:52.679083 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:52.679036    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9e1b038-b11e-4993-8952-49c768d8b368" path="/var/lib/kubelet/pods/d9e1b038-b11e-4993-8952-49c768d8b368/volumes"
Jul 18 01:34:56.645122 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:56.645082    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8942d9e2-7742s"]
Jul 18 01:34:56.645559 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:56.645500    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4272e23-f6ce-43f1-99fd-9b5690f602f2" containerName="main"
Jul 18 01:34:56.645559 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:56.645513    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4272e23-f6ce-43f1-99fd-9b5690f602f2" containerName="main"
Jul 18 01:34:56.645559 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:56.645523    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9e1b038-b11e-4993-8952-49c768d8b368" containerName="main"
Jul 18 01:34:56.645559 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:56.645529    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9e1b038-b11e-4993-8952-49c768d8b368" containerName="main"
Jul 18 01:34:56.645688 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:56.645597    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4272e23-f6ce-43f1-99fd-9b5690f602f2" containerName="main"
Jul 18 01:34:56.645688 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:56.645608    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9e1b038-b11e-4993-8952-49c768d8b368" containerName="main"
Jul 18 01:34:56.650053 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:56.650035    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8942d9e2-7742s"
Jul 18 01:34:56.653319 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:56.653290    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r95h7\""
Jul 18 01:34:56.653532 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:56.653447    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 01:34:56.654759 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:56.654731    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8942d9e2-7742s"]
Jul 18 01:34:56.802446 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:56.802396    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abe57642-bead-4380-9e6a-1c6453a132cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8942d9e2-7742s\" (UID: \"abe57642-bead-4380-9e6a-1c6453a132cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8942d9e2-7742s"
Jul 18 01:34:56.903276 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:56.903234    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abe57642-bead-4380-9e6a-1c6453a132cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8942d9e2-7742s\" (UID: \"abe57642-bead-4380-9e6a-1c6453a132cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8942d9e2-7742s"
Jul 18 01:34:56.903900 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:56.903876    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abe57642-bead-4380-9e6a-1c6453a132cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8942d9e2-7742s\" (UID: \"abe57642-bead-4380-9e6a-1c6453a132cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8942d9e2-7742s"
Jul 18 01:34:56.963069 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:56.963035    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8942d9e2-7742s"
Jul 18 01:34:57.100474 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:57.100445    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8942d9e2-7742s"]
Jul 18 01:34:57.102391 ip-10-0-130-166 kubenswrapper[2575]: W0718 01:34:57.102362    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe57642_bead_4380_9e6a_1c6453a132cb.slice/crio-1d43cf031fe171dc5e05ddd3df7bb8209bceb36ece1aee3f3b6e5c445c3fd076 WatchSource:0}: Error finding container 1d43cf031fe171dc5e05ddd3df7bb8209bceb36ece1aee3f3b6e5c445c3fd076: Status 404 returned error can't find the container with id 1d43cf031fe171dc5e05ddd3df7bb8209bceb36ece1aee3f3b6e5c445c3fd076
Jul 18 01:34:57.104403 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:57.104384    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 01:34:57.291086 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:34:57.290991    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8942d9e2-7742s" event={"ID":"abe57642-bead-4380-9e6a-1c6453a132cb","Type":"ContainerStarted","Data":"1d43cf031fe171dc5e05ddd3df7bb8209bceb36ece1aee3f3b6e5c445c3fd076"}
Jul 18 01:35:00.308472 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:00.308364    2575 generic.go:356] "Generic (PLEG): container finished" podID="abe57642-bead-4380-9e6a-1c6453a132cb" containerID="85f02b1d22f88bb45ddde959ab50873281911a7089db9abbfa56b2985ff2f37b" exitCode=6
Jul 18 01:35:00.308472 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:00.308451    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8942d9e2-7742s" event={"ID":"abe57642-bead-4380-9e6a-1c6453a132cb","Type":"ContainerDied","Data":"85f02b1d22f88bb45ddde959ab50873281911a7089db9abbfa56b2985ff2f37b"}
Jul 18 01:35:00.308944 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:00.308653    2575 scope.go:117] "RemoveContainer" containerID="85f02b1d22f88bb45ddde959ab50873281911a7089db9abbfa56b2985ff2f37b"
Jul 18 01:35:01.315919 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:01.315826    2575 generic.go:356] "Generic (PLEG): container finished" podID="abe57642-bead-4380-9e6a-1c6453a132cb" containerID="a7307031ef78836374c795298b7b87888eb9b8d962b1ed790beb9fccbebede44" exitCode=6
Jul 18 01:35:01.315919 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:01.315886    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8942d9e2-7742s" event={"ID":"abe57642-bead-4380-9e6a-1c6453a132cb","Type":"ContainerDied","Data":"a7307031ef78836374c795298b7b87888eb9b8d962b1ed790beb9fccbebede44"}
Jul 18 01:35:01.316407 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:01.315934    2575 scope.go:117] "RemoveContainer" containerID="85f02b1d22f88bb45ddde959ab50873281911a7089db9abbfa56b2985ff2f37b"
Jul 18 01:35:01.316407 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:01.316109    2575 scope.go:117] "RemoveContainer" containerID="a7307031ef78836374c795298b7b87888eb9b8d962b1ed790beb9fccbebede44"
Jul 18 01:35:01.316407 ip-10-0-130-166 kubenswrapper[2575]: E0718 01:35:01.316372    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-8942d9e2-7742s_odh-ai-gateway-infra(abe57642-bead-4380-9e6a-1c6453a132cb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8942d9e2-7742s" podUID="abe57642-bead-4380-9e6a-1c6453a132cb"
Jul 18 01:35:02.322486 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:02.322451    2575 scope.go:117] "RemoveContainer" containerID="a7307031ef78836374c795298b7b87888eb9b8d962b1ed790beb9fccbebede44"
Jul 18 01:35:02.322909 ip-10-0-130-166 kubenswrapper[2575]: E0718 01:35:02.322674    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-8942d9e2-7742s_odh-ai-gateway-infra(abe57642-bead-4380-9e6a-1c6453a132cb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8942d9e2-7742s" podUID="abe57642-bead-4380-9e6a-1c6453a132cb"
Jul 18 01:35:09.127778 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.127744    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"]
Jul 18 01:35:09.132749 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.132726    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:09.135440 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.135415    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b17102\"/\"default-dockercfg-b56bz\""
Jul 18 01:35:09.135591 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.135482    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b17102\"/\"kube-root-ca.crt\""
Jul 18 01:35:09.136817 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.136798    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b17102\"/\"openshift-service-ca.crt\""
Jul 18 01:35:09.136934 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.136917    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b17102\"/\"sub-test-model-b17102-kserve-self-signed-certs\""
Jul 18 01:35:09.139694 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.139664    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"]
Jul 18 01:35:09.218089 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.218045    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-dshm\") pod \"sub-test-model-b17102-kserve-cf4468d89-z8nwz\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") " pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:09.218089 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.218088    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-tmp-dir\") pod \"sub-test-model-b17102-kserve-cf4468d89-z8nwz\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") " pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:09.218356 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.218142    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-home\") pod \"sub-test-model-b17102-kserve-cf4468d89-z8nwz\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") " pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:09.218356 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.218259    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-model-cache\") pod \"sub-test-model-b17102-kserve-cf4468d89-z8nwz\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") " pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:09.218356 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.218303    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjpwd\" (UniqueName: \"kubernetes.io/projected/f575d282-4e45-48b9-a5a4-6ae2982ad37e-kube-api-access-mjpwd\") pod \"sub-test-model-b17102-kserve-cf4468d89-z8nwz\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") " pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:09.218356 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.218353    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f575d282-4e45-48b9-a5a4-6ae2982ad37e-tls-certs\") pod \"sub-test-model-b17102-kserve-cf4468d89-z8nwz\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") " pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:09.319092 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.319047    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-model-cache\") pod \"sub-test-model-b17102-kserve-cf4468d89-z8nwz\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") " pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:09.319092 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.319102    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjpwd\" (UniqueName: \"kubernetes.io/projected/f575d282-4e45-48b9-a5a4-6ae2982ad37e-kube-api-access-mjpwd\") pod \"sub-test-model-b17102-kserve-cf4468d89-z8nwz\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") " pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:09.319391 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.319130    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f575d282-4e45-48b9-a5a4-6ae2982ad37e-tls-certs\") pod \"sub-test-model-b17102-kserve-cf4468d89-z8nwz\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") " pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:09.319391 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.319164    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-dshm\") pod \"sub-test-model-b17102-kserve-cf4468d89-z8nwz\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") " pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:09.319391 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.319179    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-tmp-dir\") pod \"sub-test-model-b17102-kserve-cf4468d89-z8nwz\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") " pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:09.319391 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.319239    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-home\") pod \"sub-test-model-b17102-kserve-cf4468d89-z8nwz\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") " pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:09.319576 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.319557    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-model-cache\") pod \"sub-test-model-b17102-kserve-cf4468d89-z8nwz\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") " pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:09.319633 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.319606    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-tmp-dir\") pod \"sub-test-model-b17102-kserve-cf4468d89-z8nwz\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") " pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:09.319688 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.319655    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-home\") pod \"sub-test-model-b17102-kserve-cf4468d89-z8nwz\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") " pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:09.321644 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.321621    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-dshm\") pod \"sub-test-model-b17102-kserve-cf4468d89-z8nwz\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") " pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:09.321880 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.321862    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f575d282-4e45-48b9-a5a4-6ae2982ad37e-tls-certs\") pod \"sub-test-model-b17102-kserve-cf4468d89-z8nwz\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") " pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:09.327680 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.327659    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjpwd\" (UniqueName: \"kubernetes.io/projected/f575d282-4e45-48b9-a5a4-6ae2982ad37e-kube-api-access-mjpwd\") pod \"sub-test-model-b17102-kserve-cf4468d89-z8nwz\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") " pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:09.443543 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.443456    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:09.585659 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:09.585604    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"]
Jul 18 01:35:09.589336 ip-10-0-130-166 kubenswrapper[2575]: W0718 01:35:09.589304    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf575d282_4e45_48b9_a5a4_6ae2982ad37e.slice/crio-bef8b4b51c7e3cc3c16b7a71b24d80602bb15f839691c4c2981dd3a100884739 WatchSource:0}: Error finding container bef8b4b51c7e3cc3c16b7a71b24d80602bb15f839691c4c2981dd3a100884739: Status 404 returned error can't find the container with id bef8b4b51c7e3cc3c16b7a71b24d80602bb15f839691c4c2981dd3a100884739
Jul 18 01:35:10.363918 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:10.363874    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz" event={"ID":"f575d282-4e45-48b9-a5a4-6ae2982ad37e","Type":"ContainerStarted","Data":"89e9b6cf9d30c62f89395786ecf9c74961525c5e37f8270255cea889aa3a3dd6"}
Jul 18 01:35:10.363918 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:10.363925    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz" event={"ID":"f575d282-4e45-48b9-a5a4-6ae2982ad37e","Type":"ContainerStarted","Data":"bef8b4b51c7e3cc3c16b7a71b24d80602bb15f839691c4c2981dd3a100884739"}
Jul 18 01:35:10.384099 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:10.384050    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz" podStartSLOduration=1.38403291 podStartE2EDuration="1.38403291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:35:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:35:10.382794569 +0000 UTC m=+3278.172206653" watchObservedRunningTime="2026-07-18 01:35:10.38403291 +0000 UTC m=+3278.173444966"
Jul 18 01:35:14.673393 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:14.673359    2575 scope.go:117] "RemoveContainer" containerID="a7307031ef78836374c795298b7b87888eb9b8d962b1ed790beb9fccbebede44"
Jul 18 01:35:15.397948 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:15.397912    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8942d9e2-7742s" event={"ID":"abe57642-bead-4380-9e6a-1c6453a132cb","Type":"ContainerStarted","Data":"5c8baad7e72eefb6e75ff9826da34620d3f513ef894a7f041063c938091ecb2e"}
Jul 18 01:35:15.415319 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:15.415268    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8942d9e2-7742s" podStartSLOduration=17.21050617 podStartE2EDuration="19.415251399s" totalImagesPullingTime="2.204745229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:35:15.413687544 +0000 UTC m=+3283.203099602" watchObservedRunningTime="2026-07-18 01:35:15.415251399 +0000 UTC m=+3283.204663489"
Jul 18 01:35:16.405356 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:16.405324    2575 generic.go:356] "Generic (PLEG): container finished" podID="abe57642-bead-4380-9e6a-1c6453a132cb" containerID="5c8baad7e72eefb6e75ff9826da34620d3f513ef894a7f041063c938091ecb2e" exitCode=6
Jul 18 01:35:16.405761 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:16.405400    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8942d9e2-7742s" event={"ID":"abe57642-bead-4380-9e6a-1c6453a132cb","Type":"ContainerDied","Data":"5c8baad7e72eefb6e75ff9826da34620d3f513ef894a7f041063c938091ecb2e"}
Jul 18 01:35:16.405761 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:16.405463    2575 scope.go:117] "RemoveContainer" containerID="a7307031ef78836374c795298b7b87888eb9b8d962b1ed790beb9fccbebede44"
Jul 18 01:35:16.405761 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:16.405757    2575 scope.go:117] "RemoveContainer" containerID="5c8baad7e72eefb6e75ff9826da34620d3f513ef894a7f041063c938091ecb2e"
Jul 18 01:35:16.405986 ip-10-0-130-166 kubenswrapper[2575]: E0718 01:35:16.405966    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-8942d9e2-7742s_odh-ai-gateway-infra(abe57642-bead-4380-9e6a-1c6453a132cb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8942d9e2-7742s" podUID="abe57642-bead-4380-9e6a-1c6453a132cb"
Jul 18 01:35:16.428932 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:16.428897    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8942d9e2-7742s"]
Jul 18 01:35:17.552139 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:17.552112    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8942d9e2-7742s"
Jul 18 01:35:17.706392 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:17.706292    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abe57642-bead-4380-9e6a-1c6453a132cb-maas-api-service-ca\") pod \"abe57642-bead-4380-9e6a-1c6453a132cb\" (UID: \"abe57642-bead-4380-9e6a-1c6453a132cb\") "
Jul 18 01:35:17.706653 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:17.706630    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abe57642-bead-4380-9e6a-1c6453a132cb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "abe57642-bead-4380-9e6a-1c6453a132cb" (UID: "abe57642-bead-4380-9e6a-1c6453a132cb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:35:17.807877 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:17.807830    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abe57642-bead-4380-9e6a-1c6453a132cb-maas-api-service-ca\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:35:18.418678 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:18.418645    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8942d9e2-7742s"
Jul 18 01:35:18.418894 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:18.418687    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8942d9e2-7742s" event={"ID":"abe57642-bead-4380-9e6a-1c6453a132cb","Type":"ContainerDied","Data":"1d43cf031fe171dc5e05ddd3df7bb8209bceb36ece1aee3f3b6e5c445c3fd076"}
Jul 18 01:35:18.418894 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:18.418755    2575 scope.go:117] "RemoveContainer" containerID="5c8baad7e72eefb6e75ff9826da34620d3f513ef894a7f041063c938091ecb2e"
Jul 18 01:35:18.440096 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:18.440062    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8942d9e2-7742s"]
Jul 18 01:35:18.444707 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:18.444680    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8942d9e2-7742s"]
Jul 18 01:35:18.679083 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:18.678997    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abe57642-bead-4380-9e6a-1c6453a132cb" path="/var/lib/kubelet/pods/abe57642-bead-4380-9e6a-1c6453a132cb/volumes"
Jul 18 01:35:19.444015 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:19.443971    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:19.444264 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:19.444054    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:19.456607 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:19.456574    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:20.441703 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:20.441671    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:35:32.849355 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:32.849248    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 01:35:32.872512 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:32.864223    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tjb92_9311a43d-6509-4370-9c1b-1db5eeb58cb0/ovn-acl-logging/0.log"
Jul 18 01:35:47.177345 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:47.177304    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"]
Jul 18 01:35:51.624499 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:51.624457    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc"]
Jul 18 01:35:51.624899 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:51.624840    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe57642-bead-4380-9e6a-1c6453a132cb" containerName="revoke-keys"
Jul 18 01:35:51.624899 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:51.624851    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe57642-bead-4380-9e6a-1c6453a132cb" containerName="revoke-keys"
Jul 18 01:35:51.624899 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:51.624865    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe57642-bead-4380-9e6a-1c6453a132cb" containerName="revoke-keys"
Jul 18 01:35:51.624899 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:51.624870    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe57642-bead-4380-9e6a-1c6453a132cb" containerName="revoke-keys"
Jul 18 01:35:51.625033 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:51.624934    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="abe57642-bead-4380-9e6a-1c6453a132cb" containerName="revoke-keys"
Jul 18 01:35:51.625033 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:51.624946    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="abe57642-bead-4380-9e6a-1c6453a132cb" containerName="revoke-keys"
Jul 18 01:35:51.627768 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:51.627751    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc"
Jul 18 01:35:51.630455 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:51.630427    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r95h7\""
Jul 18 01:35:51.630599 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:51.630429    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 01:35:51.635847 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:51.635819    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc"]
Jul 18 01:35:51.722338 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:51.722293    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4be08df4-f4f9-4b78-afcb-e8072cb1d998-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc\" (UID: \"4be08df4-f4f9-4b78-afcb-e8072cb1d998\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc"
Jul 18 01:35:51.823524 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:51.823484    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4be08df4-f4f9-4b78-afcb-e8072cb1d998-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc\" (UID: \"4be08df4-f4f9-4b78-afcb-e8072cb1d998\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc"
Jul 18 01:35:51.824144 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:51.824114    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4be08df4-f4f9-4b78-afcb-e8072cb1d998-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc\" (UID: \"4be08df4-f4f9-4b78-afcb-e8072cb1d998\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc"
Jul 18 01:35:51.939398 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:51.939304    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc"
Jul 18 01:35:52.082110 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:52.082082    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc"]
Jul 18 01:35:52.084624 ip-10-0-130-166 kubenswrapper[2575]: W0718 01:35:52.084589    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4be08df4_f4f9_4b78_afcb_e8072cb1d998.slice/crio-0d5c80a38b3dc0661df00085b56b0e90c7d1243cd9296b1109d0385075426254 WatchSource:0}: Error finding container 0d5c80a38b3dc0661df00085b56b0e90c7d1243cd9296b1109d0385075426254: Status 404 returned error can't find the container with id 0d5c80a38b3dc0661df00085b56b0e90c7d1243cd9296b1109d0385075426254
Jul 18 01:35:52.591018 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:52.590913    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc" event={"ID":"4be08df4-f4f9-4b78-afcb-e8072cb1d998","Type":"ContainerStarted","Data":"54c97224bda073375bc0d6361c9048cad5ab65c3b9095b850583f4a1fae9c0d3"}
Jul 18 01:35:52.591018 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:52.590976    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc" event={"ID":"4be08df4-f4f9-4b78-afcb-e8072cb1d998","Type":"ContainerStarted","Data":"0d5c80a38b3dc0661df00085b56b0e90c7d1243cd9296b1109d0385075426254"}
Jul 18 01:35:52.608458 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:52.608405    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc" podStartSLOduration=1.608387414 podStartE2EDuration="1.608387414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:35:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:35:52.607166272 +0000 UTC m=+3320.396578328" watchObservedRunningTime="2026-07-18 01:35:52.608387414 +0000 UTC m=+3320.397799529"
Jul 18 01:35:53.597645 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:53.597555    2575 generic.go:356] "Generic (PLEG): container finished" podID="4be08df4-f4f9-4b78-afcb-e8072cb1d998" containerID="54c97224bda073375bc0d6361c9048cad5ab65c3b9095b850583f4a1fae9c0d3" exitCode=6
Jul 18 01:35:53.597990 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:53.597655    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc" event={"ID":"4be08df4-f4f9-4b78-afcb-e8072cb1d998","Type":"ContainerDied","Data":"54c97224bda073375bc0d6361c9048cad5ab65c3b9095b850583f4a1fae9c0d3"}
Jul 18 01:35:53.597990 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:53.597823    2575 scope.go:117] "RemoveContainer" containerID="54c97224bda073375bc0d6361c9048cad5ab65c3b9095b850583f4a1fae9c0d3"
Jul 18 01:35:54.604316 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:54.604167    2575 generic.go:356] "Generic (PLEG): container finished" podID="4be08df4-f4f9-4b78-afcb-e8072cb1d998" containerID="74f9eedcdfce73a673becc02cbd8a88a1009e9ae60ad10c68116cef4a4acf77c" exitCode=6
Jul 18 01:35:54.604316 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:54.604270    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc" event={"ID":"4be08df4-f4f9-4b78-afcb-e8072cb1d998","Type":"ContainerDied","Data":"74f9eedcdfce73a673becc02cbd8a88a1009e9ae60ad10c68116cef4a4acf77c"}
Jul 18 01:35:54.604841 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:54.604348    2575 scope.go:117] "RemoveContainer" containerID="54c97224bda073375bc0d6361c9048cad5ab65c3b9095b850583f4a1fae9c0d3"
Jul 18 01:35:54.604841 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:54.604548    2575 scope.go:117] "RemoveContainer" containerID="74f9eedcdfce73a673becc02cbd8a88a1009e9ae60ad10c68116cef4a4acf77c"
Jul 18 01:35:54.604923 ip-10-0-130-166 kubenswrapper[2575]: E0718 01:35:54.604870    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc_odh-ai-gateway-infra(4be08df4-f4f9-4b78-afcb-e8072cb1d998)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc" podUID="4be08df4-f4f9-4b78-afcb-e8072cb1d998"
Jul 18 01:35:55.612017 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:35:55.611988    2575 scope.go:117] "RemoveContainer" containerID="74f9eedcdfce73a673becc02cbd8a88a1009e9ae60ad10c68116cef4a4acf77c"
Jul 18 01:35:55.612437 ip-10-0-130-166 kubenswrapper[2575]: E0718 01:35:55.612274    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc_odh-ai-gateway-infra(4be08df4-f4f9-4b78-afcb-e8072cb1d998)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc" podUID="4be08df4-f4f9-4b78-afcb-e8072cb1d998"
Jul 18 01:36:02.198478 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.198392    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz" podUID="f575d282-4e45-48b9-a5a4-6ae2982ad37e" containerName="main" containerID="cri-o://89e9b6cf9d30c62f89395786ecf9c74961525c5e37f8270255cea889aa3a3dd6" gracePeriod=45
Jul 18 01:36:02.455889 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.455819    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:36:02.526125 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.526083    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-model-cache\") pod \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") "
Jul 18 01:36:02.526125 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.526130    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjpwd\" (UniqueName: \"kubernetes.io/projected/f575d282-4e45-48b9-a5a4-6ae2982ad37e-kube-api-access-mjpwd\") pod \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") "
Jul 18 01:36:02.526407 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.526282    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-home\") pod \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") "
Jul 18 01:36:02.526407 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.526312    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-tmp-dir\") pod \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") "
Jul 18 01:36:02.526407 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.526348    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f575d282-4e45-48b9-a5a4-6ae2982ad37e-tls-certs\") pod \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") "
Jul 18 01:36:02.526407 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.526373    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-dshm\") pod \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\" (UID: \"f575d282-4e45-48b9-a5a4-6ae2982ad37e\") "
Jul 18 01:36:02.526608 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.526396    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-model-cache" (OuterVolumeSpecName: "model-cache") pod "f575d282-4e45-48b9-a5a4-6ae2982ad37e" (UID: "f575d282-4e45-48b9-a5a4-6ae2982ad37e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:36:02.526608 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.526567    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-home" (OuterVolumeSpecName: "home") pod "f575d282-4e45-48b9-a5a4-6ae2982ad37e" (UID: "f575d282-4e45-48b9-a5a4-6ae2982ad37e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:36:02.526608 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.526579    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f575d282-4e45-48b9-a5a4-6ae2982ad37e" (UID: "f575d282-4e45-48b9-a5a4-6ae2982ad37e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:36:02.526737 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.526723    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-home\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:36:02.526774 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.526766    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-tmp-dir\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:36:02.526811 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.526782    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-model-cache\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:36:02.528556 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.528532    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f575d282-4e45-48b9-a5a4-6ae2982ad37e-kube-api-access-mjpwd" (OuterVolumeSpecName: "kube-api-access-mjpwd") pod "f575d282-4e45-48b9-a5a4-6ae2982ad37e" (UID: "f575d282-4e45-48b9-a5a4-6ae2982ad37e"). InnerVolumeSpecName "kube-api-access-mjpwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:36:02.528721 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.528699    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-dshm" (OuterVolumeSpecName: "dshm") pod "f575d282-4e45-48b9-a5a4-6ae2982ad37e" (UID: "f575d282-4e45-48b9-a5a4-6ae2982ad37e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:36:02.528762 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.528705    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f575d282-4e45-48b9-a5a4-6ae2982ad37e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f575d282-4e45-48b9-a5a4-6ae2982ad37e" (UID: "f575d282-4e45-48b9-a5a4-6ae2982ad37e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:36:02.627943 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.627897    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f575d282-4e45-48b9-a5a4-6ae2982ad37e-tls-certs\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:36:02.627943 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.627934    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f575d282-4e45-48b9-a5a4-6ae2982ad37e-dshm\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:36:02.627943 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.627943    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjpwd\" (UniqueName: \"kubernetes.io/projected/f575d282-4e45-48b9-a5a4-6ae2982ad37e-kube-api-access-mjpwd\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:36:02.644797 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.644762    2575 generic.go:356] "Generic (PLEG): container finished" podID="f575d282-4e45-48b9-a5a4-6ae2982ad37e" containerID="89e9b6cf9d30c62f89395786ecf9c74961525c5e37f8270255cea889aa3a3dd6" exitCode=0
Jul 18 01:36:02.644969 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.644817    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"
Jul 18 01:36:02.644969 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.644827    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz" event={"ID":"f575d282-4e45-48b9-a5a4-6ae2982ad37e","Type":"ContainerDied","Data":"89e9b6cf9d30c62f89395786ecf9c74961525c5e37f8270255cea889aa3a3dd6"}
Jul 18 01:36:02.644969 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.644873    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz" event={"ID":"f575d282-4e45-48b9-a5a4-6ae2982ad37e","Type":"ContainerDied","Data":"bef8b4b51c7e3cc3c16b7a71b24d80602bb15f839691c4c2981dd3a100884739"}
Jul 18 01:36:02.644969 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.644892    2575 scope.go:117] "RemoveContainer" containerID="89e9b6cf9d30c62f89395786ecf9c74961525c5e37f8270255cea889aa3a3dd6"
Jul 18 01:36:02.654516 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.654496    2575 scope.go:117] "RemoveContainer" containerID="89e9b6cf9d30c62f89395786ecf9c74961525c5e37f8270255cea889aa3a3dd6"
Jul 18 01:36:02.654819 ip-10-0-130-166 kubenswrapper[2575]: E0718 01:36:02.654797    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89e9b6cf9d30c62f89395786ecf9c74961525c5e37f8270255cea889aa3a3dd6\": container with ID starting with 89e9b6cf9d30c62f89395786ecf9c74961525c5e37f8270255cea889aa3a3dd6 not found: ID does not exist" containerID="89e9b6cf9d30c62f89395786ecf9c74961525c5e37f8270255cea889aa3a3dd6"
Jul 18 01:36:02.654914 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.654826    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e9b6cf9d30c62f89395786ecf9c74961525c5e37f8270255cea889aa3a3dd6"} err="failed to get container status \"89e9b6cf9d30c62f89395786ecf9c74961525c5e37f8270255cea889aa3a3dd6\": rpc error: code = NotFound desc = could not find container \"89e9b6cf9d30c62f89395786ecf9c74961525c5e37f8270255cea889aa3a3dd6\": container with ID starting with 89e9b6cf9d30c62f89395786ecf9c74961525c5e37f8270255cea889aa3a3dd6 not found: ID does not exist"
Jul 18 01:36:02.666556 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.666521    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"]
Jul 18 01:36:02.670948 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.670916    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b17102/sub-test-model-b17102-kserve-cf4468d89-z8nwz"]
Jul 18 01:36:02.679888 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:02.679853    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f575d282-4e45-48b9-a5a4-6ae2982ad37e" path="/var/lib/kubelet/pods/f575d282-4e45-48b9-a5a4-6ae2982ad37e/volumes"
Jul 18 01:36:10.673650 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:10.673613    2575 scope.go:117] "RemoveContainer" containerID="74f9eedcdfce73a673becc02cbd8a88a1009e9ae60ad10c68116cef4a4acf77c"
Jul 18 01:36:11.695202 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:11.695155    2575 generic.go:356] "Generic (PLEG): container finished" podID="4be08df4-f4f9-4b78-afcb-e8072cb1d998" containerID="3143ac240231ce9e76696adddcb50861fb7a744cb42e47553a76759f7fdd87ed" exitCode=6
Jul 18 01:36:11.695653 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:11.695225    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc" event={"ID":"4be08df4-f4f9-4b78-afcb-e8072cb1d998","Type":"ContainerDied","Data":"3143ac240231ce9e76696adddcb50861fb7a744cb42e47553a76759f7fdd87ed"}
Jul 18 01:36:11.695653 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:11.695291    2575 scope.go:117] "RemoveContainer" containerID="74f9eedcdfce73a673becc02cbd8a88a1009e9ae60ad10c68116cef4a4acf77c"
Jul 18 01:36:11.695653 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:11.695592    2575 scope.go:117] "RemoveContainer" containerID="3143ac240231ce9e76696adddcb50861fb7a744cb42e47553a76759f7fdd87ed"
Jul 18 01:36:11.695845 ip-10-0-130-166 kubenswrapper[2575]: E0718 01:36:11.695826    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc_odh-ai-gateway-infra(4be08df4-f4f9-4b78-afcb-e8072cb1d998)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc" podUID="4be08df4-f4f9-4b78-afcb-e8072cb1d998"
Jul 18 01:36:12.721742 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:12.721702    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc"]
Jul 18 01:36:12.866764 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:12.866736    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc"
Jul 18 01:36:13.023983 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:13.023867    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4be08df4-f4f9-4b78-afcb-e8072cb1d998-maas-api-service-ca\") pod \"4be08df4-f4f9-4b78-afcb-e8072cb1d998\" (UID: \"4be08df4-f4f9-4b78-afcb-e8072cb1d998\") "
Jul 18 01:36:13.024343 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:13.024315    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4be08df4-f4f9-4b78-afcb-e8072cb1d998-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4be08df4-f4f9-4b78-afcb-e8072cb1d998" (UID: "4be08df4-f4f9-4b78-afcb-e8072cb1d998"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:36:13.124980 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:13.124937    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4be08df4-f4f9-4b78-afcb-e8072cb1d998-maas-api-service-ca\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:36:13.708145 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:13.708098    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc" event={"ID":"4be08df4-f4f9-4b78-afcb-e8072cb1d998","Type":"ContainerDied","Data":"0d5c80a38b3dc0661df00085b56b0e90c7d1243cd9296b1109d0385075426254"}
Jul 18 01:36:13.708145 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:13.708129    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc"
Jul 18 01:36:13.708410 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:13.708173    2575 scope.go:117] "RemoveContainer" containerID="3143ac240231ce9e76696adddcb50861fb7a744cb42e47553a76759f7fdd87ed"
Jul 18 01:36:13.729300 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:13.729264    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc"]
Jul 18 01:36:13.736891 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:13.736864    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-7djhc"]
Jul 18 01:36:14.678617 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:14.678582    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4be08df4-f4f9-4b78-afcb-e8072cb1d998" path="/var/lib/kubelet/pods/4be08df4-f4f9-4b78-afcb-e8072cb1d998/volumes"
Jul 18 01:36:40.902104 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.902070    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"]
Jul 18 01:36:40.902559 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.902533    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe57642-bead-4380-9e6a-1c6453a132cb" containerName="revoke-keys"
Jul 18 01:36:40.902559 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.902557    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe57642-bead-4380-9e6a-1c6453a132cb" containerName="revoke-keys"
Jul 18 01:36:40.902697 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.902586    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4be08df4-f4f9-4b78-afcb-e8072cb1d998" containerName="revoke-keys"
Jul 18 01:36:40.902697 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.902595    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4be08df4-f4f9-4b78-afcb-e8072cb1d998" containerName="revoke-keys"
Jul 18 01:36:40.902697 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.902612    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4be08df4-f4f9-4b78-afcb-e8072cb1d998" containerName="revoke-keys"
Jul 18 01:36:40.902697 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.902621    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4be08df4-f4f9-4b78-afcb-e8072cb1d998" containerName="revoke-keys"
Jul 18 01:36:40.902697 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.902633    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4be08df4-f4f9-4b78-afcb-e8072cb1d998" containerName="revoke-keys"
Jul 18 01:36:40.902697 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.902641    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4be08df4-f4f9-4b78-afcb-e8072cb1d998" containerName="revoke-keys"
Jul 18 01:36:40.902697 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.902657    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f575d282-4e45-48b9-a5a4-6ae2982ad37e" containerName="main"
Jul 18 01:36:40.902697 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.902666    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f575d282-4e45-48b9-a5a4-6ae2982ad37e" containerName="main"
Jul 18 01:36:40.903083 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.902780    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f575d282-4e45-48b9-a5a4-6ae2982ad37e" containerName="main"
Jul 18 01:36:40.903083 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.902793    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4be08df4-f4f9-4b78-afcb-e8072cb1d998" containerName="revoke-keys"
Jul 18 01:36:40.903083 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.902805    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="abe57642-bead-4380-9e6a-1c6453a132cb" containerName="revoke-keys"
Jul 18 01:36:40.903083 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.902816    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4be08df4-f4f9-4b78-afcb-e8072cb1d998" containerName="revoke-keys"
Jul 18 01:36:40.907519 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.907499    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:40.910288 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.910265    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b17102\"/\"kube-root-ca.crt\""
Jul 18 01:36:40.911388 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.911364    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b17102\"/\"openshift-service-ca.crt\""
Jul 18 01:36:40.911508 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.911406    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b17102\"/\"rate-test-model-b17102-kserve-self-signed-certs\""
Jul 18 01:36:40.911572 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.911499    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b17102\"/\"default-dockercfg-b56bz\""
Jul 18 01:36:40.919074 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.919042    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"]
Jul 18 01:36:40.988016 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.987978    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-dshm\") pod \"rate-test-model-b17102-kserve-7d8fb496f5-w672f\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") " pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:40.988016 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.988017    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-model-cache\") pod \"rate-test-model-b17102-kserve-7d8fb496f5-w672f\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") " pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:40.988296 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.988042    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-tls-certs\") pod \"rate-test-model-b17102-kserve-7d8fb496f5-w672f\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") " pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:40.988296 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.988150    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-tmp-dir\") pod \"rate-test-model-b17102-kserve-7d8fb496f5-w672f\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") " pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:40.988296 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.988252    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-home\") pod \"rate-test-model-b17102-kserve-7d8fb496f5-w672f\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") " pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:40.988296 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:40.988283    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pngcf\" (UniqueName: \"kubernetes.io/projected/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-kube-api-access-pngcf\") pod \"rate-test-model-b17102-kserve-7d8fb496f5-w672f\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") " pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:41.089821 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:41.089776    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-dshm\") pod \"rate-test-model-b17102-kserve-7d8fb496f5-w672f\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") " pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:41.089821 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:41.089819    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-model-cache\") pod \"rate-test-model-b17102-kserve-7d8fb496f5-w672f\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") " pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:41.090071 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:41.089841    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-tls-certs\") pod \"rate-test-model-b17102-kserve-7d8fb496f5-w672f\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") " pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:41.090071 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:41.089880    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-tmp-dir\") pod \"rate-test-model-b17102-kserve-7d8fb496f5-w672f\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") " pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:41.090071 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:41.089926    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-home\") pod \"rate-test-model-b17102-kserve-7d8fb496f5-w672f\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") " pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:41.090071 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:41.089961    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pngcf\" (UniqueName: \"kubernetes.io/projected/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-kube-api-access-pngcf\") pod \"rate-test-model-b17102-kserve-7d8fb496f5-w672f\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") " pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:41.090331 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:41.090301    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-model-cache\") pod \"rate-test-model-b17102-kserve-7d8fb496f5-w672f\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") " pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:41.090406 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:41.090381    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-tmp-dir\") pod \"rate-test-model-b17102-kserve-7d8fb496f5-w672f\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") " pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:41.090454 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:41.090420    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-home\") pod \"rate-test-model-b17102-kserve-7d8fb496f5-w672f\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") " pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:41.092388 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:41.092366    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-dshm\") pod \"rate-test-model-b17102-kserve-7d8fb496f5-w672f\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") " pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:41.092532 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:41.092514    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-tls-certs\") pod \"rate-test-model-b17102-kserve-7d8fb496f5-w672f\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") " pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:41.098257 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:41.098235    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pngcf\" (UniqueName: \"kubernetes.io/projected/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-kube-api-access-pngcf\") pod \"rate-test-model-b17102-kserve-7d8fb496f5-w672f\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") " pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:41.219741 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:41.219633    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:41.359240 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:41.359156    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"]
Jul 18 01:36:41.364096 ip-10-0-130-166 kubenswrapper[2575]: W0718 01:36:41.364061    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9490cbd_8ce5_4a92_9d7d_6725bdd21252.slice/crio-5e0625218b88226b1267ed8bb819f5d6038c2450e0d3329e3c7a73e636f1c1e1 WatchSource:0}: Error finding container 5e0625218b88226b1267ed8bb819f5d6038c2450e0d3329e3c7a73e636f1c1e1: Status 404 returned error can't find the container with id 5e0625218b88226b1267ed8bb819f5d6038c2450e0d3329e3c7a73e636f1c1e1
Jul 18 01:36:41.854072 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:41.854031    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f" event={"ID":"f9490cbd-8ce5-4a92-9d7d-6725bdd21252","Type":"ContainerStarted","Data":"ebfdb39d269733d66e38e35f21aa40c65bcd0aba6c76b7aec6f7f31579139c49"}
Jul 18 01:36:41.854072 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:41.854079    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f" event={"ID":"f9490cbd-8ce5-4a92-9d7d-6725bdd21252","Type":"ContainerStarted","Data":"5e0625218b88226b1267ed8bb819f5d6038c2450e0d3329e3c7a73e636f1c1e1"}
Jul 18 01:36:41.873253 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:41.873195    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f" podStartSLOduration=1.873162283 podStartE2EDuration="1.873162283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:36:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:36:41.871045969 +0000 UTC m=+3369.660458026" watchObservedRunningTime="2026-07-18 01:36:41.873162283 +0000 UTC m=+3369.662574340"
Jul 18 01:36:49.496200 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:49.496152    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh"]
Jul 18 01:36:49.496628 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:49.496613    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4be08df4-f4f9-4b78-afcb-e8072cb1d998" containerName="revoke-keys"
Jul 18 01:36:49.499649 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:49.499634    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh"
Jul 18 01:36:49.502598 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:49.502568    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r95h7\""
Jul 18 01:36:49.502744 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:49.502722    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 01:36:49.508013 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:49.507991    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh"]
Jul 18 01:36:49.672607 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:49.672570    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f8f2438-c6a3-443b-80c6-9677c3deb2fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh\" (UID: \"8f8f2438-c6a3-443b-80c6-9677c3deb2fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh"
Jul 18 01:36:49.773871 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:49.773782    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f8f2438-c6a3-443b-80c6-9677c3deb2fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh\" (UID: \"8f8f2438-c6a3-443b-80c6-9677c3deb2fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh"
Jul 18 01:36:49.774445 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:49.774424    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f8f2438-c6a3-443b-80c6-9677c3deb2fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh\" (UID: \"8f8f2438-c6a3-443b-80c6-9677c3deb2fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh"
Jul 18 01:36:49.811569 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:49.811533    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh"
Jul 18 01:36:49.950536 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:49.950501    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh"]
Jul 18 01:36:49.953879 ip-10-0-130-166 kubenswrapper[2575]: W0718 01:36:49.953840    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f8f2438_c6a3_443b_80c6_9677c3deb2fb.slice/crio-37789da1fc5c9c7ea650cd34bb5c17d1289727998062ae6eac67809d3a31ee87 WatchSource:0}: Error finding container 37789da1fc5c9c7ea650cd34bb5c17d1289727998062ae6eac67809d3a31ee87: Status 404 returned error can't find the container with id 37789da1fc5c9c7ea650cd34bb5c17d1289727998062ae6eac67809d3a31ee87
Jul 18 01:36:50.901763 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:50.901726    2575 generic.go:356] "Generic (PLEG): container finished" podID="8f8f2438-c6a3-443b-80c6-9677c3deb2fb" containerID="b777d2c323b7bfd4b847929e25484e426c9d3b0a697276740b69d4e34084eb32" exitCode=6
Jul 18 01:36:50.902134 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:50.901825    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh" event={"ID":"8f8f2438-c6a3-443b-80c6-9677c3deb2fb","Type":"ContainerDied","Data":"b777d2c323b7bfd4b847929e25484e426c9d3b0a697276740b69d4e34084eb32"}
Jul 18 01:36:50.902134 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:50.901879    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh" event={"ID":"8f8f2438-c6a3-443b-80c6-9677c3deb2fb","Type":"ContainerStarted","Data":"37789da1fc5c9c7ea650cd34bb5c17d1289727998062ae6eac67809d3a31ee87"}
Jul 18 01:36:50.902134 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:50.901976    2575 scope.go:117] "RemoveContainer" containerID="b777d2c323b7bfd4b847929e25484e426c9d3b0a697276740b69d4e34084eb32"
Jul 18 01:36:51.220301 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:51.220266    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:51.220477 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:51.220316    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:51.233108 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:51.233073    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:51.908323 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:51.908285    2575 generic.go:356] "Generic (PLEG): container finished" podID="8f8f2438-c6a3-443b-80c6-9677c3deb2fb" containerID="01a1275cb2cebe5cdf105f66a1815c351fafcd6a94805facf4fe0b187d0dd6ea" exitCode=6
Jul 18 01:36:51.908725 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:51.908367    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh" event={"ID":"8f8f2438-c6a3-443b-80c6-9677c3deb2fb","Type":"ContainerDied","Data":"01a1275cb2cebe5cdf105f66a1815c351fafcd6a94805facf4fe0b187d0dd6ea"}
Jul 18 01:36:51.908725 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:51.908433    2575 scope.go:117] "RemoveContainer" containerID="b777d2c323b7bfd4b847929e25484e426c9d3b0a697276740b69d4e34084eb32"
Jul 18 01:36:51.908725 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:51.908616    2575 scope.go:117] "RemoveContainer" containerID="01a1275cb2cebe5cdf105f66a1815c351fafcd6a94805facf4fe0b187d0dd6ea"
Jul 18 01:36:51.908890 ip-10-0-130-166 kubenswrapper[2575]: E0718 01:36:51.908865    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh_odh-ai-gateway-infra(8f8f2438-c6a3-443b-80c6-9677c3deb2fb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh" podUID="8f8f2438-c6a3-443b-80c6-9677c3deb2fb"
Jul 18 01:36:51.921772 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:51.921749    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:36:52.915856 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:36:52.915829    2575 scope.go:117] "RemoveContainer" containerID="01a1275cb2cebe5cdf105f66a1815c351fafcd6a94805facf4fe0b187d0dd6ea"
Jul 18 01:36:52.916362 ip-10-0-130-166 kubenswrapper[2575]: E0718 01:36:52.916012    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh_odh-ai-gateway-infra(8f8f2438-c6a3-443b-80c6-9677c3deb2fb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh" podUID="8f8f2438-c6a3-443b-80c6-9677c3deb2fb"
Jul 18 01:37:08.672962 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:08.672922    2575 scope.go:117] "RemoveContainer" containerID="01a1275cb2cebe5cdf105f66a1815c351fafcd6a94805facf4fe0b187d0dd6ea"
Jul 18 01:37:08.992987 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:08.992955    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh" event={"ID":"8f8f2438-c6a3-443b-80c6-9677c3deb2fb","Type":"ContainerStarted","Data":"4a5af182c4a68382ebbe5b1a39fc017a134c632e81f8e8c78d0c321d0112c304"}
Jul 18 01:37:09.008849 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:09.008799    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh" podStartSLOduration=20.00878389 podStartE2EDuration="20.00878389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:36:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:37:09.007407773 +0000 UTC m=+3396.796819830" watchObservedRunningTime="2026-07-18 01:37:09.00878389 +0000 UTC m=+3396.798195946"
Jul 18 01:37:09.999998 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:09.999966    2575 generic.go:356] "Generic (PLEG): container finished" podID="8f8f2438-c6a3-443b-80c6-9677c3deb2fb" containerID="4a5af182c4a68382ebbe5b1a39fc017a134c632e81f8e8c78d0c321d0112c304" exitCode=6
Jul 18 01:37:10.000496 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:10.000043    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh" event={"ID":"8f8f2438-c6a3-443b-80c6-9677c3deb2fb","Type":"ContainerDied","Data":"4a5af182c4a68382ebbe5b1a39fc017a134c632e81f8e8c78d0c321d0112c304"}
Jul 18 01:37:10.000496 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:10.000118    2575 scope.go:117] "RemoveContainer" containerID="01a1275cb2cebe5cdf105f66a1815c351fafcd6a94805facf4fe0b187d0dd6ea"
Jul 18 01:37:10.000598 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:10.000514    2575 scope.go:117] "RemoveContainer" containerID="4a5af182c4a68382ebbe5b1a39fc017a134c632e81f8e8c78d0c321d0112c304"
Jul 18 01:37:10.000744 ip-10-0-130-166 kubenswrapper[2575]: E0718 01:37:10.000721    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh_odh-ai-gateway-infra(8f8f2438-c6a3-443b-80c6-9677c3deb2fb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh" podUID="8f8f2438-c6a3-443b-80c6-9677c3deb2fb"
Jul 18 01:37:10.025485 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:10.025450    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh"]
Jul 18 01:37:11.145076 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:11.145041    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh"
Jul 18 01:37:11.275064 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:11.274964    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f8f2438-c6a3-443b-80c6-9677c3deb2fb-maas-api-service-ca\") pod \"8f8f2438-c6a3-443b-80c6-9677c3deb2fb\" (UID: \"8f8f2438-c6a3-443b-80c6-9677c3deb2fb\") "
Jul 18 01:37:11.275386 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:11.275363    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f8f2438-c6a3-443b-80c6-9677c3deb2fb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8f8f2438-c6a3-443b-80c6-9677c3deb2fb" (UID: "8f8f2438-c6a3-443b-80c6-9677c3deb2fb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:37:11.376104 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:11.376061    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f8f2438-c6a3-443b-80c6-9677c3deb2fb-maas-api-service-ca\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:37:12.012599 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:12.012569    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh"
Jul 18 01:37:12.012783 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:12.012573    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh" event={"ID":"8f8f2438-c6a3-443b-80c6-9677c3deb2fb","Type":"ContainerDied","Data":"37789da1fc5c9c7ea650cd34bb5c17d1289727998062ae6eac67809d3a31ee87"}
Jul 18 01:37:12.012783 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:12.012696    2575 scope.go:117] "RemoveContainer" containerID="4a5af182c4a68382ebbe5b1a39fc017a134c632e81f8e8c78d0c321d0112c304"
Jul 18 01:37:12.033421 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:12.033387    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh"]
Jul 18 01:37:12.035237 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:12.035218    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d5466ad4-4vjsh"]
Jul 18 01:37:12.679203 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:12.679152    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f8f2438-c6a3-443b-80c6-9677c3deb2fb" path="/var/lib/kubelet/pods/8f8f2438-c6a3-443b-80c6-9677c3deb2fb/volumes"
Jul 18 01:37:24.703579 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:24.703501    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"]
Jul 18 01:37:34.162620 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:34.162587    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t"]
Jul 18 01:37:34.163036 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:34.162966    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f8f2438-c6a3-443b-80c6-9677c3deb2fb" containerName="revoke-keys"
Jul 18 01:37:34.163036 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:34.162977    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f8f2438-c6a3-443b-80c6-9677c3deb2fb" containerName="revoke-keys"
Jul 18 01:37:34.163036 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:34.162990    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f8f2438-c6a3-443b-80c6-9677c3deb2fb" containerName="revoke-keys"
Jul 18 01:37:34.163036 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:34.162996    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f8f2438-c6a3-443b-80c6-9677c3deb2fb" containerName="revoke-keys"
Jul 18 01:37:34.163172 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:34.163063    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f8f2438-c6a3-443b-80c6-9677c3deb2fb" containerName="revoke-keys"
Jul 18 01:37:34.163172 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:34.163070    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f8f2438-c6a3-443b-80c6-9677c3deb2fb" containerName="revoke-keys"
Jul 18 01:37:34.163172 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:34.163075    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f8f2438-c6a3-443b-80c6-9677c3deb2fb" containerName="revoke-keys"
Jul 18 01:37:34.167250 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:34.167231    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t"
Jul 18 01:37:34.170292 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:34.170248    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 01:37:34.171030 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:34.170982    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r95h7\""
Jul 18 01:37:34.172758 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:34.172735    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t"]
Jul 18 01:37:34.195229 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:34.195175    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5d80798-43f9-4438-9e65-a84bf32c216a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t\" (UID: \"b5d80798-43f9-4438-9e65-a84bf32c216a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t"
Jul 18 01:37:34.295979 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:34.295937    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5d80798-43f9-4438-9e65-a84bf32c216a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t\" (UID: \"b5d80798-43f9-4438-9e65-a84bf32c216a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t"
Jul 18 01:37:34.296640 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:34.296616    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5d80798-43f9-4438-9e65-a84bf32c216a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t\" (UID: \"b5d80798-43f9-4438-9e65-a84bf32c216a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t"
Jul 18 01:37:34.479261 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:34.479130    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t"
Jul 18 01:37:34.615379 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:34.615355    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t"]
Jul 18 01:37:34.617596 ip-10-0-130-166 kubenswrapper[2575]: W0718 01:37:34.617567    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5d80798_43f9_4438_9e65_a84bf32c216a.slice/crio-b4832ddd806b944f875e91d9ba56fca20af41166708b3156015461cffad0f730 WatchSource:0}: Error finding container b4832ddd806b944f875e91d9ba56fca20af41166708b3156015461cffad0f730: Status 404 returned error can't find the container with id b4832ddd806b944f875e91d9ba56fca20af41166708b3156015461cffad0f730
Jul 18 01:37:35.126361 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:35.126331    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t" event={"ID":"b5d80798-43f9-4438-9e65-a84bf32c216a","Type":"ContainerStarted","Data":"b74065b89ce7c4d5764c0dfc82f389fd332dcacda3538570d8fe037e51c31a87"}
Jul 18 01:37:35.126560 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:35.126383    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t" event={"ID":"b5d80798-43f9-4438-9e65-a84bf32c216a","Type":"ContainerStarted","Data":"b4832ddd806b944f875e91d9ba56fca20af41166708b3156015461cffad0f730"}
Jul 18 01:37:35.144470 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:35.144417    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t" podStartSLOduration=1.144403118 podStartE2EDuration="1.144403118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:37:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:37:35.144313755 +0000 UTC m=+3422.933725815" watchObservedRunningTime="2026-07-18 01:37:35.144403118 +0000 UTC m=+3422.933815174"
Jul 18 01:37:36.133161 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:36.133130    2575 generic.go:356] "Generic (PLEG): container finished" podID="b5d80798-43f9-4438-9e65-a84bf32c216a" containerID="b74065b89ce7c4d5764c0dfc82f389fd332dcacda3538570d8fe037e51c31a87" exitCode=6
Jul 18 01:37:36.133599 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:36.133224    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t" event={"ID":"b5d80798-43f9-4438-9e65-a84bf32c216a","Type":"ContainerDied","Data":"b74065b89ce7c4d5764c0dfc82f389fd332dcacda3538570d8fe037e51c31a87"}
Jul 18 01:37:36.133599 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:36.133388    2575 scope.go:117] "RemoveContainer" containerID="b74065b89ce7c4d5764c0dfc82f389fd332dcacda3538570d8fe037e51c31a87"
Jul 18 01:37:37.146997 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:37.146964    2575 generic.go:356] "Generic (PLEG): container finished" podID="b5d80798-43f9-4438-9e65-a84bf32c216a" containerID="d45f8d04013277bb8649e30de8d911d359b35611dc22b4ddf3b061f55e7d0e6b" exitCode=6
Jul 18 01:37:37.147462 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:37.147050    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t" event={"ID":"b5d80798-43f9-4438-9e65-a84bf32c216a","Type":"ContainerDied","Data":"d45f8d04013277bb8649e30de8d911d359b35611dc22b4ddf3b061f55e7d0e6b"}
Jul 18 01:37:37.147462 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:37.147133    2575 scope.go:117] "RemoveContainer" containerID="b74065b89ce7c4d5764c0dfc82f389fd332dcacda3538570d8fe037e51c31a87"
Jul 18 01:37:37.147462 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:37.147396    2575 scope.go:117] "RemoveContainer" containerID="d45f8d04013277bb8649e30de8d911d359b35611dc22b4ddf3b061f55e7d0e6b"
Jul 18 01:37:37.147677 ip-10-0-130-166 kubenswrapper[2575]: E0718 01:37:37.147653    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t_odh-ai-gateway-infra(b5d80798-43f9-4438-9e65-a84bf32c216a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t" podUID="b5d80798-43f9-4438-9e65-a84bf32c216a"
Jul 18 01:37:38.154277 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:38.154245    2575 scope.go:117] "RemoveContainer" containerID="d45f8d04013277bb8649e30de8d911d359b35611dc22b4ddf3b061f55e7d0e6b"
Jul 18 01:37:38.154763 ip-10-0-130-166 kubenswrapper[2575]: E0718 01:37:38.154428    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t_odh-ai-gateway-infra(b5d80798-43f9-4438-9e65-a84bf32c216a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t" podUID="b5d80798-43f9-4438-9e65-a84bf32c216a"
Jul 18 01:37:39.723937 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:39.723901    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f" podUID="f9490cbd-8ce5-4a92-9d7d-6725bdd21252" containerName="main" containerID="cri-o://ebfdb39d269733d66e38e35f21aa40c65bcd0aba6c76b7aec6f7f31579139c49" gracePeriod=45
Jul 18 01:37:39.978778 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:39.978711    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:37:40.051209 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.051157    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-dshm\") pod \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") "
Jul 18 01:37:40.051399 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.051223    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-home\") pod \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") "
Jul 18 01:37:40.051399 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.051248    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-tls-certs\") pod \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") "
Jul 18 01:37:40.051399 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.051269    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-model-cache\") pod \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") "
Jul 18 01:37:40.051399 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.051324    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-tmp-dir\") pod \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") "
Jul 18 01:37:40.051399 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.051340    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pngcf\" (UniqueName: \"kubernetes.io/projected/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-kube-api-access-pngcf\") pod \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\" (UID: \"f9490cbd-8ce5-4a92-9d7d-6725bdd21252\") "
Jul 18 01:37:40.051687 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.051541    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-home" (OuterVolumeSpecName: "home") pod "f9490cbd-8ce5-4a92-9d7d-6725bdd21252" (UID: "f9490cbd-8ce5-4a92-9d7d-6725bdd21252"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:37:40.051687 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.051611    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-model-cache" (OuterVolumeSpecName: "model-cache") pod "f9490cbd-8ce5-4a92-9d7d-6725bdd21252" (UID: "f9490cbd-8ce5-4a92-9d7d-6725bdd21252"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:37:40.051687 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.051642    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f9490cbd-8ce5-4a92-9d7d-6725bdd21252" (UID: "f9490cbd-8ce5-4a92-9d7d-6725bdd21252"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:37:40.051687 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.051677    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-home\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:37:40.053546 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.053520    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f9490cbd-8ce5-4a92-9d7d-6725bdd21252" (UID: "f9490cbd-8ce5-4a92-9d7d-6725bdd21252"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:37:40.053681 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.053568    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-dshm" (OuterVolumeSpecName: "dshm") pod "f9490cbd-8ce5-4a92-9d7d-6725bdd21252" (UID: "f9490cbd-8ce5-4a92-9d7d-6725bdd21252"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:37:40.053681 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.053589    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-kube-api-access-pngcf" (OuterVolumeSpecName: "kube-api-access-pngcf") pod "f9490cbd-8ce5-4a92-9d7d-6725bdd21252" (UID: "f9490cbd-8ce5-4a92-9d7d-6725bdd21252"). InnerVolumeSpecName "kube-api-access-pngcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:37:40.152456 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.152417    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-dshm\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:37:40.152456 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.152449    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-tls-certs\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:37:40.152456 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.152460    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-model-cache\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:37:40.152456 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.152468    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-tmp-dir\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:37:40.152739 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.152478    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pngcf\" (UniqueName: \"kubernetes.io/projected/f9490cbd-8ce5-4a92-9d7d-6725bdd21252-kube-api-access-pngcf\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:37:40.165545 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.165515    2575 generic.go:356] "Generic (PLEG): container finished" podID="f9490cbd-8ce5-4a92-9d7d-6725bdd21252" containerID="ebfdb39d269733d66e38e35f21aa40c65bcd0aba6c76b7aec6f7f31579139c49" exitCode=0
Jul 18 01:37:40.165687 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.165553    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f" event={"ID":"f9490cbd-8ce5-4a92-9d7d-6725bdd21252","Type":"ContainerDied","Data":"ebfdb39d269733d66e38e35f21aa40c65bcd0aba6c76b7aec6f7f31579139c49"}
Jul 18 01:37:40.165687 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.165565    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"
Jul 18 01:37:40.165687 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.165581    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f" event={"ID":"f9490cbd-8ce5-4a92-9d7d-6725bdd21252","Type":"ContainerDied","Data":"5e0625218b88226b1267ed8bb819f5d6038c2450e0d3329e3c7a73e636f1c1e1"}
Jul 18 01:37:40.165687 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.165598    2575 scope.go:117] "RemoveContainer" containerID="ebfdb39d269733d66e38e35f21aa40c65bcd0aba6c76b7aec6f7f31579139c49"
Jul 18 01:37:40.174950 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.174930    2575 scope.go:117] "RemoveContainer" containerID="ebfdb39d269733d66e38e35f21aa40c65bcd0aba6c76b7aec6f7f31579139c49"
Jul 18 01:37:40.175252 ip-10-0-130-166 kubenswrapper[2575]: E0718 01:37:40.175226    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebfdb39d269733d66e38e35f21aa40c65bcd0aba6c76b7aec6f7f31579139c49\": container with ID starting with ebfdb39d269733d66e38e35f21aa40c65bcd0aba6c76b7aec6f7f31579139c49 not found: ID does not exist" containerID="ebfdb39d269733d66e38e35f21aa40c65bcd0aba6c76b7aec6f7f31579139c49"
Jul 18 01:37:40.175361 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.175258    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebfdb39d269733d66e38e35f21aa40c65bcd0aba6c76b7aec6f7f31579139c49"} err="failed to get container status \"ebfdb39d269733d66e38e35f21aa40c65bcd0aba6c76b7aec6f7f31579139c49\": rpc error: code = NotFound desc = could not find container \"ebfdb39d269733d66e38e35f21aa40c65bcd0aba6c76b7aec6f7f31579139c49\": container with ID starting with ebfdb39d269733d66e38e35f21aa40c65bcd0aba6c76b7aec6f7f31579139c49 not found: ID does not exist"
Jul 18 01:37:40.185899 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.185867    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"]
Jul 18 01:37:40.189145 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.189121    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b17102/rate-test-model-b17102-kserve-7d8fb496f5-w672f"]
Jul 18 01:37:40.678967 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:40.678925    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9490cbd-8ce5-4a92-9d7d-6725bdd21252" path="/var/lib/kubelet/pods/f9490cbd-8ce5-4a92-9d7d-6725bdd21252/volumes"
Jul 18 01:37:41.709302 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:41.709266    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6"]
Jul 18 01:37:41.709699 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:41.709676    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9490cbd-8ce5-4a92-9d7d-6725bdd21252" containerName="main"
Jul 18 01:37:41.709699 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:41.709688    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9490cbd-8ce5-4a92-9d7d-6725bdd21252" containerName="main"
Jul 18 01:37:41.709699 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:41.709698    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f8f2438-c6a3-443b-80c6-9677c3deb2fb" containerName="revoke-keys"
Jul 18 01:37:41.709797 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:41.709704    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f8f2438-c6a3-443b-80c6-9677c3deb2fb" containerName="revoke-keys"
Jul 18 01:37:41.709797 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:41.709789    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9490cbd-8ce5-4a92-9d7d-6725bdd21252" containerName="main"
Jul 18 01:37:41.719650 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:41.719613    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6"
Jul 18 01:37:41.720776 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:41.720742    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6"]
Jul 18 01:37:41.766920 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:41.766877    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f49247c0-e5e5-48a4-a459-b47dd19a2aee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6\" (UID: \"f49247c0-e5e5-48a4-a459-b47dd19a2aee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6"
Jul 18 01:37:41.867886 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:41.867848    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f49247c0-e5e5-48a4-a459-b47dd19a2aee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6\" (UID: \"f49247c0-e5e5-48a4-a459-b47dd19a2aee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6"
Jul 18 01:37:41.868523 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:41.868505    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f49247c0-e5e5-48a4-a459-b47dd19a2aee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6\" (UID: \"f49247c0-e5e5-48a4-a459-b47dd19a2aee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6"
Jul 18 01:37:42.031332 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:42.031239    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6"
Jul 18 01:37:42.167308 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:42.167275    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6"]
Jul 18 01:37:42.170449 ip-10-0-130-166 kubenswrapper[2575]: W0718 01:37:42.170418    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf49247c0_e5e5_48a4_a459_b47dd19a2aee.slice/crio-84058b9678b853339ead6023b5932d7b88c62162394c7019a746225ceba4918d WatchSource:0}: Error finding container 84058b9678b853339ead6023b5932d7b88c62162394c7019a746225ceba4918d: Status 404 returned error can't find the container with id 84058b9678b853339ead6023b5932d7b88c62162394c7019a746225ceba4918d
Jul 18 01:37:42.177004 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:42.176978    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6" event={"ID":"f49247c0-e5e5-48a4-a459-b47dd19a2aee","Type":"ContainerStarted","Data":"84058b9678b853339ead6023b5932d7b88c62162394c7019a746225ceba4918d"}
Jul 18 01:37:43.182968 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:43.182934    2575 generic.go:356] "Generic (PLEG): container finished" podID="f49247c0-e5e5-48a4-a459-b47dd19a2aee" containerID="8b012a483e9d8c5f9bec1c428b10d6a5786ff259b16fc1f805f58f3dba4f0a20" exitCode=6
Jul 18 01:37:43.183402 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:43.183020    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6" event={"ID":"f49247c0-e5e5-48a4-a459-b47dd19a2aee","Type":"ContainerDied","Data":"8b012a483e9d8c5f9bec1c428b10d6a5786ff259b16fc1f805f58f3dba4f0a20"}
Jul 18 01:37:43.183402 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:43.183160    2575 scope.go:117] "RemoveContainer" containerID="8b012a483e9d8c5f9bec1c428b10d6a5786ff259b16fc1f805f58f3dba4f0a20"
Jul 18 01:37:44.190259 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:44.190226    2575 generic.go:356] "Generic (PLEG): container finished" podID="f49247c0-e5e5-48a4-a459-b47dd19a2aee" containerID="e12b7386a01a2ec4ff1b8e1e6f5048c2819a87d4bd81a2acea9a8925072dd230" exitCode=6
Jul 18 01:37:44.190735 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:44.190296    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6" event={"ID":"f49247c0-e5e5-48a4-a459-b47dd19a2aee","Type":"ContainerDied","Data":"e12b7386a01a2ec4ff1b8e1e6f5048c2819a87d4bd81a2acea9a8925072dd230"}
Jul 18 01:37:44.190735 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:44.190346    2575 scope.go:117] "RemoveContainer" containerID="8b012a483e9d8c5f9bec1c428b10d6a5786ff259b16fc1f805f58f3dba4f0a20"
Jul 18 01:37:44.190735 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:44.190585    2575 scope.go:117] "RemoveContainer" containerID="e12b7386a01a2ec4ff1b8e1e6f5048c2819a87d4bd81a2acea9a8925072dd230"
Jul 18 01:37:44.190897 ip-10-0-130-166 kubenswrapper[2575]: E0718 01:37:44.190816    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6_odh-ai-gateway-infra(f49247c0-e5e5-48a4-a459-b47dd19a2aee)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6" podUID="f49247c0-e5e5-48a4-a459-b47dd19a2aee"
Jul 18 01:37:45.196848 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:45.196817    2575 scope.go:117] "RemoveContainer" containerID="e12b7386a01a2ec4ff1b8e1e6f5048c2819a87d4bd81a2acea9a8925072dd230"
Jul 18 01:37:45.197278 ip-10-0-130-166 kubenswrapper[2575]: E0718 01:37:45.197006    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6_odh-ai-gateway-infra(f49247c0-e5e5-48a4-a459-b47dd19a2aee)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6" podUID="f49247c0-e5e5-48a4-a459-b47dd19a2aee"
Jul 18 01:37:51.672989 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:51.672953    2575 scope.go:117] "RemoveContainer" containerID="d45f8d04013277bb8649e30de8d911d359b35611dc22b4ddf3b061f55e7d0e6b"
Jul 18 01:37:52.232469 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:52.232437    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t" event={"ID":"b5d80798-43f9-4438-9e65-a84bf32c216a","Type":"ContainerStarted","Data":"1d7b98a0c6bcb639e04fc1b0e50c1367019dc0e421bf3f9897642304047b9cb4"}
Jul 18 01:37:53.238918 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:53.238875    2575 generic.go:356] "Generic (PLEG): container finished" podID="b5d80798-43f9-4438-9e65-a84bf32c216a" containerID="1d7b98a0c6bcb639e04fc1b0e50c1367019dc0e421bf3f9897642304047b9cb4" exitCode=6
Jul 18 01:37:53.239441 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:53.238949    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t" event={"ID":"b5d80798-43f9-4438-9e65-a84bf32c216a","Type":"ContainerDied","Data":"1d7b98a0c6bcb639e04fc1b0e50c1367019dc0e421bf3f9897642304047b9cb4"}
Jul 18 01:37:53.239441 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:53.239040    2575 scope.go:117] "RemoveContainer" containerID="d45f8d04013277bb8649e30de8d911d359b35611dc22b4ddf3b061f55e7d0e6b"
Jul 18 01:37:53.239441 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:53.239348    2575 scope.go:117] "RemoveContainer" containerID="1d7b98a0c6bcb639e04fc1b0e50c1367019dc0e421bf3f9897642304047b9cb4"
Jul 18 01:37:53.239598 ip-10-0-130-166 kubenswrapper[2575]: E0718 01:37:53.239576    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t_odh-ai-gateway-infra(b5d80798-43f9-4438-9e65-a84bf32c216a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t" podUID="b5d80798-43f9-4438-9e65-a84bf32c216a"
Jul 18 01:37:53.261119 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:53.261094    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t"]
Jul 18 01:37:54.387981 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:54.387956    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t"
Jul 18 01:37:54.486318 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:54.486270    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5d80798-43f9-4438-9e65-a84bf32c216a-maas-api-service-ca\") pod \"b5d80798-43f9-4438-9e65-a84bf32c216a\" (UID: \"b5d80798-43f9-4438-9e65-a84bf32c216a\") "
Jul 18 01:37:54.486698 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:54.486678    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5d80798-43f9-4438-9e65-a84bf32c216a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b5d80798-43f9-4438-9e65-a84bf32c216a" (UID: "b5d80798-43f9-4438-9e65-a84bf32c216a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:37:54.587922 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:54.587840    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5d80798-43f9-4438-9e65-a84bf32c216a-maas-api-service-ca\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:37:55.254753 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:55.254721    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t" event={"ID":"b5d80798-43f9-4438-9e65-a84bf32c216a","Type":"ContainerDied","Data":"b4832ddd806b944f875e91d9ba56fca20af41166708b3156015461cffad0f730"}
Jul 18 01:37:55.254753 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:55.254742    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t"
Jul 18 01:37:55.254992 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:55.254784    2575 scope.go:117] "RemoveContainer" containerID="1d7b98a0c6bcb639e04fc1b0e50c1367019dc0e421bf3f9897642304047b9cb4"
Jul 18 01:37:55.269966 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:55.269938    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t"]
Jul 18 01:37:55.278266 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:55.278241    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-354f15cb-s5h8t"]
Jul 18 01:37:56.673019 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:56.672980    2575 scope.go:117] "RemoveContainer" containerID="e12b7386a01a2ec4ff1b8e1e6f5048c2819a87d4bd81a2acea9a8925072dd230"
Jul 18 01:37:56.678210 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:56.678158    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5d80798-43f9-4438-9e65-a84bf32c216a" path="/var/lib/kubelet/pods/b5d80798-43f9-4438-9e65-a84bf32c216a/volumes"
Jul 18 01:37:57.267297 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:57.267212    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6" event={"ID":"f49247c0-e5e5-48a4-a459-b47dd19a2aee","Type":"ContainerStarted","Data":"5c9bb114b03dccfb7a5b0bf0b04827e6c997388d6e2835bf8b435e0ad6c181f8"}
Jul 18 01:37:57.282265 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:57.282148    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6" podStartSLOduration=16.282128855 podStartE2EDuration="16.282128855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:37:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:37:57.281718021 +0000 UTC m=+3445.071130080" watchObservedRunningTime="2026-07-18 01:37:57.282128855 +0000 UTC m=+3445.071540915"
Jul 18 01:37:58.275004 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:58.274971    2575 generic.go:356] "Generic (PLEG): container finished" podID="f49247c0-e5e5-48a4-a459-b47dd19a2aee" containerID="5c9bb114b03dccfb7a5b0bf0b04827e6c997388d6e2835bf8b435e0ad6c181f8" exitCode=6
Jul 18 01:37:58.275515 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:58.275022    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6" event={"ID":"f49247c0-e5e5-48a4-a459-b47dd19a2aee","Type":"ContainerDied","Data":"5c9bb114b03dccfb7a5b0bf0b04827e6c997388d6e2835bf8b435e0ad6c181f8"}
Jul 18 01:37:58.275515 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:58.275072    2575 scope.go:117] "RemoveContainer" containerID="e12b7386a01a2ec4ff1b8e1e6f5048c2819a87d4bd81a2acea9a8925072dd230"
Jul 18 01:37:58.275515 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:58.275430    2575 scope.go:117] "RemoveContainer" containerID="5c9bb114b03dccfb7a5b0bf0b04827e6c997388d6e2835bf8b435e0ad6c181f8"
Jul 18 01:37:58.275703 ip-10-0-130-166 kubenswrapper[2575]: E0718 01:37:58.275681    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6_odh-ai-gateway-infra(f49247c0-e5e5-48a4-a459-b47dd19a2aee)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6" podUID="f49247c0-e5e5-48a4-a459-b47dd19a2aee"
Jul 18 01:37:58.298731 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:58.298694    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6"]
Jul 18 01:37:59.418999 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:59.418973    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6"
Jul 18 01:37:59.537488 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:59.537390    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f49247c0-e5e5-48a4-a459-b47dd19a2aee-maas-api-service-ca\") pod \"f49247c0-e5e5-48a4-a459-b47dd19a2aee\" (UID: \"f49247c0-e5e5-48a4-a459-b47dd19a2aee\") "
Jul 18 01:37:59.537796 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:59.537768    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f49247c0-e5e5-48a4-a459-b47dd19a2aee-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f49247c0-e5e5-48a4-a459-b47dd19a2aee" (UID: "f49247c0-e5e5-48a4-a459-b47dd19a2aee"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:37:59.638394 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:37:59.638353    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f49247c0-e5e5-48a4-a459-b47dd19a2aee-maas-api-service-ca\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 18 01:38:00.287049 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:38:00.287015    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6"
Jul 18 01:38:00.287241 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:38:00.287050    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6" event={"ID":"f49247c0-e5e5-48a4-a459-b47dd19a2aee","Type":"ContainerDied","Data":"84058b9678b853339ead6023b5932d7b88c62162394c7019a746225ceba4918d"}
Jul 18 01:38:00.287241 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:38:00.287115    2575 scope.go:117] "RemoveContainer" containerID="5c9bb114b03dccfb7a5b0bf0b04827e6c997388d6e2835bf8b435e0ad6c181f8"
Jul 18 01:38:00.310619 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:38:00.310574    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6"]
Jul 18 01:38:00.318166 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:38:00.318138    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1b6716ba-47sx6"]
Jul 18 01:38:00.679217 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:38:00.679169    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f49247c0-e5e5-48a4-a459-b47dd19a2aee" path="/var/lib/kubelet/pods/f49247c0-e5e5-48a4-a459-b47dd19a2aee/volumes"
Jul 18 01:38:36.410331 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:38:36.410291    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5cb64f9966-8zkfq_cbd82392-c091-42cb-b359-c83e12bc5c9e/authorino/0.log"
Jul 18 01:38:41.909642 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:38:41.909605    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-gbdrr_d4101cfb-ded6-4617-b332-239e741d7deb/manager/0.log"
Jul 18 01:38:42.637111 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:38:42.637081    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9_f521625b-6b5e-4f09-8901-ee3e65c39990/copy-manifests/0.log"
Jul 18 01:38:42.644550 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:38:42.644527    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9_f521625b-6b5e-4f09-8901-ee3e65c39990/manager/0.log"
Jul 18 01:38:45.864025 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:38:45.863993    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5cb64f9966-8zkfq_cbd82392-c091-42cb-b359-c83e12bc5c9e/authorino/0.log"
Jul 18 01:38:45.980958 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:38:45.980928    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9mvvm_73a9ad61-7a6e-490d-8f44-4721a97e38e0/manager/0.log"
Jul 18 01:38:47.267423 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:38:47.267388    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7569c6bc9b-pllps_a9fc45c4-958e-4d5a-87d7-254816a2bdcb/kube-auth-proxy/0.log"
Jul 18 01:38:47.605055 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:38:47.604964    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-6jjvv_24291311-d822-4982-821b-410efb0066e3/payload-pre-processing/0.log"
Jul 18 01:38:48.283537 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:38:48.283505    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-wr87q_90fa3261-cfbe-406a-b1ab-8b6850663af8/main/0.log"
Jul 18 01:38:48.513144 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:38:48.513108    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4mt6p_c554feeb-8a1d-4a3f-bd3c-2aead365ad1f/main/0.log"
Jul 18 01:38:48.734204 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:38:48.734164    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-47qcr_af335c44-5d42-454b-bc3e-cf30a216b2a5/main/0.log"
Jul 18 01:38:57.268864 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:38:57.268829    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zghtc_a209204d-2b7f-40e7-9ccb-e79a97531adf/global-pull-secret-syncer/0.log"
Jul 18 01:38:57.353409 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:38:57.353381    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9tn4l_031ededa-1f92-4818-873b-631a36945bfe/konnectivity-agent/0.log"
Jul 18 01:38:57.404996 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:38:57.404965    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-166.ec2.internal_a4f18a4042ac0c4f669794ed57bc7586/haproxy/0.log"
Jul 18 01:39:02.462444 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:02.462405    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5cb64f9966-8zkfq_cbd82392-c091-42cb-b359-c83e12bc5c9e/authorino/0.log"
Jul 18 01:39:02.488593 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:02.488559    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9mvvm_73a9ad61-7a6e-490d-8f44-4721a97e38e0/manager/0.log"
Jul 18 01:39:04.857160 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:04.857132    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_59f77baa-3b12-4df5-8d69-522741752b37/alertmanager/0.log"
Jul 18 01:39:04.880391 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:04.880364    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_59f77baa-3b12-4df5-8d69-522741752b37/config-reloader/0.log"
Jul 18 01:39:04.902325 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:04.902297    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_59f77baa-3b12-4df5-8d69-522741752b37/kube-rbac-proxy-web/0.log"
Jul 18 01:39:04.924837 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:04.924762    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_59f77baa-3b12-4df5-8d69-522741752b37/kube-rbac-proxy/0.log"
Jul 18 01:39:04.944670 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:04.944635    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_59f77baa-3b12-4df5-8d69-522741752b37/kube-rbac-proxy-metric/0.log"
Jul 18 01:39:04.969675 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:04.969643    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_59f77baa-3b12-4df5-8d69-522741752b37/prom-label-proxy/0.log"
Jul 18 01:39:04.989176 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:04.989151    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_59f77baa-3b12-4df5-8d69-522741752b37/init-config-reloader/0.log"
Jul 18 01:39:05.068509 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.068479    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-hb2m2_9ac13500-567a-4f83-b31c-c0a9b7ba674d/kube-state-metrics/0.log"
Jul 18 01:39:05.085769 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.085742    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-hb2m2_9ac13500-567a-4f83-b31c-c0a9b7ba674d/kube-rbac-proxy-main/0.log"
Jul 18 01:39:05.105421 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.105396    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-hb2m2_9ac13500-567a-4f83-b31c-c0a9b7ba674d/kube-rbac-proxy-self/0.log"
Jul 18 01:39:05.131575 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.131552    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5699b5bd57-pjrgs_c028b2a4-ac11-4827-9d86-889d7d19f609/metrics-server/0.log"
Jul 18 01:39:05.154534 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.154506    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-jq46v_e89a9052-a6b3-4428-b7d9-95812ad97769/monitoring-plugin/0.log"
Jul 18 01:39:05.182954 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.182881    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5bb22_2e715093-02fc-4f5e-9ca5-9a49aeeb7b59/node-exporter/0.log"
Jul 18 01:39:05.204970 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.204950    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5bb22_2e715093-02fc-4f5e-9ca5-9a49aeeb7b59/kube-rbac-proxy/0.log"
Jul 18 01:39:05.226010 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.225989    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5bb22_2e715093-02fc-4f5e-9ca5-9a49aeeb7b59/init-textfile/0.log"
Jul 18 01:39:05.401711 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.401687    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-ml7pc_8ba9a1c4-2b55-469d-b739-886d9af055b7/kube-rbac-proxy-main/0.log"
Jul 18 01:39:05.423307 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.423283    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-ml7pc_8ba9a1c4-2b55-469d-b739-886d9af055b7/kube-rbac-proxy-self/0.log"
Jul 18 01:39:05.444535 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.444464    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-ml7pc_8ba9a1c4-2b55-469d-b739-886d9af055b7/openshift-state-metrics/0.log"
Jul 18 01:39:05.494501 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.494473    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bf31fd8-2f99-4e22-a70d-199fe4c89789/prometheus/0.log"
Jul 18 01:39:05.515136 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.515110    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bf31fd8-2f99-4e22-a70d-199fe4c89789/config-reloader/0.log"
Jul 18 01:39:05.535132 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.535101    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bf31fd8-2f99-4e22-a70d-199fe4c89789/thanos-sidecar/0.log"
Jul 18 01:39:05.554871 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.554843    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bf31fd8-2f99-4e22-a70d-199fe4c89789/kube-rbac-proxy-web/0.log"
Jul 18 01:39:05.574536 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.574517    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bf31fd8-2f99-4e22-a70d-199fe4c89789/kube-rbac-proxy/0.log"
Jul 18 01:39:05.593380 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.593359    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bf31fd8-2f99-4e22-a70d-199fe4c89789/kube-rbac-proxy-thanos/0.log"
Jul 18 01:39:05.614876 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.614858    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bf31fd8-2f99-4e22-a70d-199fe4c89789/init-config-reloader/0.log"
Jul 18 01:39:05.799502 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.799476    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847d574c6-mz4pw_7111db5e-d779-41fd-831f-55768cb56c59/thanos-query/0.log"
Jul 18 01:39:05.820142 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.820109    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847d574c6-mz4pw_7111db5e-d779-41fd-831f-55768cb56c59/kube-rbac-proxy-web/0.log"
Jul 18 01:39:05.852223 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.852174    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847d574c6-mz4pw_7111db5e-d779-41fd-831f-55768cb56c59/kube-rbac-proxy/0.log"
Jul 18 01:39:05.872016 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.871988    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847d574c6-mz4pw_7111db5e-d779-41fd-831f-55768cb56c59/prom-label-proxy/0.log"
Jul 18 01:39:05.891021 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.890996    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847d574c6-mz4pw_7111db5e-d779-41fd-831f-55768cb56c59/kube-rbac-proxy-rules/0.log"
Jul 18 01:39:05.910232 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:05.910178    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-847d574c6-mz4pw_7111db5e-d779-41fd-831f-55768cb56c59/kube-rbac-proxy-metrics/0.log"
Jul 18 01:39:07.496441 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.496405    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6"]
Jul 18 01:39:07.496825 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.496799    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5d80798-43f9-4438-9e65-a84bf32c216a" containerName="revoke-keys"
Jul 18 01:39:07.496825 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.496809    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5d80798-43f9-4438-9e65-a84bf32c216a" containerName="revoke-keys"
Jul 18 01:39:07.496825 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.496816    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f49247c0-e5e5-48a4-a459-b47dd19a2aee" containerName="revoke-keys"
Jul 18 01:39:07.496825 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.496821    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f49247c0-e5e5-48a4-a459-b47dd19a2aee" containerName="revoke-keys"
Jul 18 01:39:07.496960 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.496833    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f49247c0-e5e5-48a4-a459-b47dd19a2aee" containerName="revoke-keys"
Jul 18 01:39:07.496960 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.496839    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f49247c0-e5e5-48a4-a459-b47dd19a2aee" containerName="revoke-keys"
Jul 18 01:39:07.496960 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.496853    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5d80798-43f9-4438-9e65-a84bf32c216a" containerName="revoke-keys"
Jul 18 01:39:07.496960 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.496858    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5d80798-43f9-4438-9e65-a84bf32c216a" containerName="revoke-keys"
Jul 18 01:39:07.496960 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.496865    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5d80798-43f9-4438-9e65-a84bf32c216a" containerName="revoke-keys"
Jul 18 01:39:07.496960 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.496871    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5d80798-43f9-4438-9e65-a84bf32c216a" containerName="revoke-keys"
Jul 18 01:39:07.496960 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.496923    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f49247c0-e5e5-48a4-a459-b47dd19a2aee" containerName="revoke-keys"
Jul 18 01:39:07.496960 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.496931    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5d80798-43f9-4438-9e65-a84bf32c216a" containerName="revoke-keys"
Jul 18 01:39:07.496960 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.496936    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5d80798-43f9-4438-9e65-a84bf32c216a" containerName="revoke-keys"
Jul 18 01:39:07.496960 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.496942    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f49247c0-e5e5-48a4-a459-b47dd19a2aee" containerName="revoke-keys"
Jul 18 01:39:07.496960 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.496947    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5d80798-43f9-4438-9e65-a84bf32c216a" containerName="revoke-keys"
Jul 18 01:39:07.500356 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.500340    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6"
Jul 18 01:39:07.503315 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.503286    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dn4z4\"/\"openshift-service-ca.crt\""
Jul 18 01:39:07.503315 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.503302    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dn4z4\"/\"default-dockercfg-glxnk\""
Jul 18 01:39:07.504379 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.504361    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dn4z4\"/\"kube-root-ca.crt\""
Jul 18 01:39:07.509078 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.509053    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6"]
Jul 18 01:39:07.561780 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.561748    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4374d662-f178-4195-a660-26f99ee23180-proc\") pod \"perf-node-gather-daemonset-6nwd6\" (UID: \"4374d662-f178-4195-a660-26f99ee23180\") " pod="openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6"
Jul 18 01:39:07.561954 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.561793    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4374d662-f178-4195-a660-26f99ee23180-sys\") pod \"perf-node-gather-daemonset-6nwd6\" (UID: \"4374d662-f178-4195-a660-26f99ee23180\") " pod="openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6"
Jul 18 01:39:07.561954 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.561817    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4374d662-f178-4195-a660-26f99ee23180-podres\") pod \"perf-node-gather-daemonset-6nwd6\" (UID: \"4374d662-f178-4195-a660-26f99ee23180\") " pod="openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6"
Jul 18 01:39:07.561954 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.561920    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4374d662-f178-4195-a660-26f99ee23180-lib-modules\") pod \"perf-node-gather-daemonset-6nwd6\" (UID: \"4374d662-f178-4195-a660-26f99ee23180\") " pod="openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6"
Jul 18 01:39:07.562066 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.561999    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w4p7\" (UniqueName: \"kubernetes.io/projected/4374d662-f178-4195-a660-26f99ee23180-kube-api-access-8w4p7\") pod \"perf-node-gather-daemonset-6nwd6\" (UID: \"4374d662-f178-4195-a660-26f99ee23180\") " pod="openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6"
Jul 18 01:39:07.662865 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.662824    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w4p7\" (UniqueName: \"kubernetes.io/projected/4374d662-f178-4195-a660-26f99ee23180-kube-api-access-8w4p7\") pod \"perf-node-gather-daemonset-6nwd6\" (UID: \"4374d662-f178-4195-a660-26f99ee23180\") " pod="openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6"
Jul 18 01:39:07.663061 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.662889    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4374d662-f178-4195-a660-26f99ee23180-proc\") pod \"perf-node-gather-daemonset-6nwd6\" (UID: \"4374d662-f178-4195-a660-26f99ee23180\") " pod="openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6"
Jul 18 01:39:07.663061 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.662929    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4374d662-f178-4195-a660-26f99ee23180-sys\") pod \"perf-node-gather-daemonset-6nwd6\" (UID: \"4374d662-f178-4195-a660-26f99ee23180\") " pod="openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6"
Jul 18 01:39:07.663061 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.662951    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4374d662-f178-4195-a660-26f99ee23180-podres\") pod \"perf-node-gather-daemonset-6nwd6\" (UID: \"4374d662-f178-4195-a660-26f99ee23180\") " pod="openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6"
Jul 18 01:39:07.663061 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.663002    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4374d662-f178-4195-a660-26f99ee23180-lib-modules\") pod \"perf-node-gather-daemonset-6nwd6\" (UID: \"4374d662-f178-4195-a660-26f99ee23180\") " pod="openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6"
Jul 18 01:39:07.663061 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.663044    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4374d662-f178-4195-a660-26f99ee23180-sys\") pod \"perf-node-gather-daemonset-6nwd6\" (UID: \"4374d662-f178-4195-a660-26f99ee23180\") " pod="openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6"
Jul 18 01:39:07.663336 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.663044    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4374d662-f178-4195-a660-26f99ee23180-proc\") pod \"perf-node-gather-daemonset-6nwd6\" (UID: \"4374d662-f178-4195-a660-26f99ee23180\") " pod="openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6"
Jul 18 01:39:07.663336 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.663120    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4374d662-f178-4195-a660-26f99ee23180-podres\") pod \"perf-node-gather-daemonset-6nwd6\" (UID: \"4374d662-f178-4195-a660-26f99ee23180\") " pod="openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6"
Jul 18 01:39:07.663336 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.663146    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4374d662-f178-4195-a660-26f99ee23180-lib-modules\") pod \"perf-node-gather-daemonset-6nwd6\" (UID: \"4374d662-f178-4195-a660-26f99ee23180\") " pod="openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6"
Jul 18 01:39:07.670709 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.670685    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w4p7\" (UniqueName: \"kubernetes.io/projected/4374d662-f178-4195-a660-26f99ee23180-kube-api-access-8w4p7\") pod \"perf-node-gather-daemonset-6nwd6\" (UID: \"4374d662-f178-4195-a660-26f99ee23180\") " pod="openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6"
Jul 18 01:39:07.811802 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.811696    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6"
Jul 18 01:39:07.984552 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:07.984524    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6"]
Jul 18 01:39:07.986212 ip-10-0-130-166 kubenswrapper[2575]: W0718 01:39:07.986149    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4374d662_f178_4195_a660_26f99ee23180.slice/crio-66369365c622beeb4e2d5ca9480f0053499c12996e24e908c0c9d5d6c563938c WatchSource:0}: Error finding container 66369365c622beeb4e2d5ca9480f0053499c12996e24e908c0c9d5d6c563938c: Status 404 returned error can't find the container with id 66369365c622beeb4e2d5ca9480f0053499c12996e24e908c0c9d5d6c563938c
Jul 18 01:39:08.320234 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:08.320129    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-52zxk_61a01215-46f4-4d8d-96e4-21a5f53b4e8e/download-server/0.log"
Jul 18 01:39:08.640618 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:08.640575    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6" event={"ID":"4374d662-f178-4195-a660-26f99ee23180","Type":"ContainerStarted","Data":"5dd3f068cff3868da979ef733a5c4ec0a131248235df6c0824aa2ad85bec9c07"}
Jul 18 01:39:08.641022 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:08.640636    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6" event={"ID":"4374d662-f178-4195-a660-26f99ee23180","Type":"ContainerStarted","Data":"66369365c622beeb4e2d5ca9480f0053499c12996e24e908c0c9d5d6c563938c"}
Jul 18 01:39:08.641022 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:08.640665    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6"
Jul 18 01:39:08.658237 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:08.658172    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6" podStartSLOduration=1.6581569969999999 podStartE2EDuration="1.658156997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:39:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:39:08.655721936 +0000 UTC m=+3516.445133993" watchObservedRunningTime="2026-07-18 01:39:08.658156997 +0000 UTC m=+3516.447569054"
Jul 18 01:39:10.047993 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:10.047962    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nmq5l_53da426e-0564-4c0a-bbda-6d0f37267192/dns/0.log"
Jul 18 01:39:10.071709 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:10.071683    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nmq5l_53da426e-0564-4c0a-bbda-6d0f37267192/kube-rbac-proxy/0.log"
Jul 18 01:39:10.115935 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:10.115903    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5ktrw_ac8eced4-49d8-49d7-b990-7293cb285952/dns-node-resolver/0.log"
Jul 18 01:39:10.802763 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:10.802738    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lqwmf_c5317943-47c6-46a6-865a-e062f6ed279b/node-ca/0.log"
Jul 18 01:39:11.880910 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:11.880882    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7569c6bc9b-pllps_a9fc45c4-958e-4d5a-87d7-254816a2bdcb/kube-auth-proxy/0.log"
Jul 18 01:39:12.001879 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:12.001846    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-6jjvv_24291311-d822-4982-821b-410efb0066e3/payload-pre-processing/0.log"
Jul 18 01:39:12.757972 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:12.757942    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c92dm_62f3563e-fc37-4270-9d39-53090eec3241/serve-healthcheck-canary/0.log"
Jul 18 01:39:13.329140 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:13.329112    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f8w54_c7854b84-8d2b-4dbf-b79c-f7213d24a1ab/kube-rbac-proxy/0.log"
Jul 18 01:39:13.348980 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:13.348949    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f8w54_c7854b84-8d2b-4dbf-b79c-f7213d24a1ab/exporter/0.log"
Jul 18 01:39:13.369470 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:13.369427    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f8w54_c7854b84-8d2b-4dbf-b79c-f7213d24a1ab/extractor/0.log"
Jul 18 01:39:14.656326 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:14.656296    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dn4z4/perf-node-gather-daemonset-6nwd6"
Jul 18 01:39:15.648557 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:15.648498    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-gbdrr_d4101cfb-ded6-4617-b332-239e741d7deb/manager/0.log"
Jul 18 01:39:16.056203 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:16.056105    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9_f521625b-6b5e-4f09-8901-ee3e65c39990/manager/0.log"
Jul 18 01:39:16.077054 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:16.077029    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bd8c7c4c4-mqxg9_f521625b-6b5e-4f09-8901-ee3e65c39990/copy-manifests/0.log"
Jul 18 01:39:17.492064 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:17.491986    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-845f554b8f-99zj8_1add44ca-eec5-4cf7-9c02-7296b84a21b1/manager/0.log"
Jul 18 01:39:18.619252 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:18.619224    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7569c6bc9b-pllps_a9fc45c4-958e-4d5a-87d7-254816a2bdcb/kube-auth-proxy/0.log"
Jul 18 01:39:18.724785 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:18.724754    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-6jjvv_24291311-d822-4982-821b-410efb0066e3/payload-pre-processing/0.log"
Jul 18 01:39:20.102587 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:20.102555    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7569c6bc9b-pllps_a9fc45c4-958e-4d5a-87d7-254816a2bdcb/kube-auth-proxy/0.log"
Jul 18 01:39:20.203142 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:20.203112    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-6jjvv_24291311-d822-4982-821b-410efb0066e3/payload-pre-processing/0.log"
Jul 18 01:39:22.782899 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:22.782868    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-jppsq_96797281-81c7-459c-9ab4-b05b2d4980f7/migrator/0.log"
Jul 18 01:39:22.803075 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:22.803045    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-jppsq_96797281-81c7-459c-9ab4-b05b2d4980f7/graceful-termination/0.log"
Jul 18 01:39:24.439777 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:24.439737    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zh2l6_13495ace-a3dd-4fc1-8035-0a2e54879d58/kube-multus-additional-cni-plugins/0.log"
Jul 18 01:39:24.458937 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:24.458911    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zh2l6_13495ace-a3dd-4fc1-8035-0a2e54879d58/egress-router-binary-copy/0.log"
Jul 18 01:39:24.480764 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:24.480739    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zh2l6_13495ace-a3dd-4fc1-8035-0a2e54879d58/cni-plugins/0.log"
Jul 18 01:39:24.502844 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:24.502817    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zh2l6_13495ace-a3dd-4fc1-8035-0a2e54879d58/bond-cni-plugin/0.log"
Jul 18 01:39:24.523723 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:24.523700    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zh2l6_13495ace-a3dd-4fc1-8035-0a2e54879d58/routeoverride-cni/0.log"
Jul 18 01:39:24.542150 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:24.542129    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zh2l6_13495ace-a3dd-4fc1-8035-0a2e54879d58/whereabouts-cni-bincopy/0.log"
Jul 18 01:39:24.561038 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:24.561014    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zh2l6_13495ace-a3dd-4fc1-8035-0a2e54879d58/whereabouts-cni/0.log"
Jul 18 01:39:24.691424 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:24.691326    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mgzpn_59d36460-6568-4ce0-b273-cb9b1e69a680/kube-multus/0.log"
Jul 18 01:39:24.754362 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:24.754333    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nxj6q_12acb4ef-54f7-4c47-884b-aa81ed6d7eb0/network-metrics-daemon/0.log"
Jul 18 01:39:24.771554 ip-10-0-130-166 kubenswrapper[2575]: I0718 01:39:24.771527    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nxj6q_12acb4ef-54f7-4c47-884b-aa81ed6d7eb0/kube-rbac-proxy/0.log"