Apr 24 21:14:07.813391 ip-10-0-131-162 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Apr 24 21:14:07.813406 ip-10-0-131-162 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Apr 24 21:14:07.813416 ip-10-0-131-162 systemd[1]: kubelet.service: Failed with result 'resources'.
Apr 24 21:14:07.813718 ip-10-0-131-162 systemd[1]: Failed to start Kubernetes Kubelet.
Apr 24 21:14:17.918089 ip-10-0-131-162 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Apr 24 21:14:17.918104 ip-10-0-131-162 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 9977787e52bb440fa01b9047d3453b19 --
Apr 24 21:16:47.265676 ip-10-0-131-162 systemd[1]: Starting Kubernetes Kubelet...
Apr 24 21:16:47.708336 ip-10-0-131-162 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 24 21:16:47.708336 ip-10-0-131-162 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Apr 24 21:16:47.708336 ip-10-0-131-162 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 24 21:16:47.708336 ip-10-0-131-162 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Apr 24 21:16:47.708336 ip-10-0-131-162 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 24 21:16:47.709137 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.709053    2569 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Apr 24 21:16:47.711898 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711883    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Apr 24 21:16:47.711898 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711897    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Apr 24 21:16:47.711959 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711902    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Apr 24 21:16:47.711959 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711906    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Apr 24 21:16:47.711959 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711910    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Apr 24 21:16:47.711959 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711913    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Apr 24 21:16:47.711959 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711916    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Apr 24 21:16:47.711959 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711919    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Apr 24 21:16:47.711959 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711923    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Apr 24 21:16:47.711959 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711927    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Apr 24 21:16:47.711959 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711930    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Apr 24 21:16:47.711959 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711933    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Apr 24 21:16:47.711959 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711936    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Apr 24 21:16:47.711959 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711938    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Apr 24 21:16:47.711959 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711945    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Apr 24 21:16:47.711959 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711948    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Apr 24 21:16:47.711959 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711951    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Apr 24 21:16:47.711959 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711954    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Apr 24 21:16:47.711959 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711956    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Apr 24 21:16:47.711959 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711959    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Apr 24 21:16:47.711959 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711962    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Apr 24 21:16:47.712468 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711964    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Apr 24 21:16:47.712468 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711967    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Apr 24 21:16:47.712468 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711970    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Apr 24 21:16:47.712468 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711973    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Apr 24 21:16:47.712468 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711976    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Apr 24 21:16:47.712468 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711981    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Apr 24 21:16:47.712468 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711984    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Apr 24 21:16:47.712468 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711987    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Apr 24 21:16:47.712468 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711990    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Apr 24 21:16:47.712468 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711993    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Apr 24 21:16:47.712468 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.711997    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Apr 24 21:16:47.712468 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712000    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Apr 24 21:16:47.712468 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712003    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Apr 24 21:16:47.712468 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712005    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Apr 24 21:16:47.712468 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712008    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Apr 24 21:16:47.712468 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712011    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Apr 24 21:16:47.712468 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712013    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Apr 24 21:16:47.712468 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712016    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Apr 24 21:16:47.712468 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712018    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Apr 24 21:16:47.712468 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712021    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Apr 24 21:16:47.712991 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712023    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Apr 24 21:16:47.712991 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712026    2569 feature_gate.go:328] unrecognized feature gate: Example
Apr 24 21:16:47.712991 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712028    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Apr 24 21:16:47.712991 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712031    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Apr 24 21:16:47.712991 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712033    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Apr 24 21:16:47.712991 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712036    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Apr 24 21:16:47.712991 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712039    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Apr 24 21:16:47.712991 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712042    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Apr 24 21:16:47.712991 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712044    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Apr 24 21:16:47.712991 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712047    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Apr 24 21:16:47.712991 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712049    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Apr 24 21:16:47.712991 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712051    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Apr 24 21:16:47.712991 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712054    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Apr 24 21:16:47.712991 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712058    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Apr 24 21:16:47.712991 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712061    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Apr 24 21:16:47.712991 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712065    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Apr 24 21:16:47.712991 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712067    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Apr 24 21:16:47.712991 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712070    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Apr 24 21:16:47.712991 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712073    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Apr 24 21:16:47.712991 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712075    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Apr 24 21:16:47.713480 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712078    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Apr 24 21:16:47.713480 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712080    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Apr 24 21:16:47.713480 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712083    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Apr 24 21:16:47.713480 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712086    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Apr 24 21:16:47.713480 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712088    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Apr 24 21:16:47.713480 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712091    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Apr 24 21:16:47.713480 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712093    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Apr 24 21:16:47.713480 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712096    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Apr 24 21:16:47.713480 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712098    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Apr 24 21:16:47.713480 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712101    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Apr 24 21:16:47.713480 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712104    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Apr 24 21:16:47.713480 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712106    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Apr 24 21:16:47.713480 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712109    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Apr 24 21:16:47.713480 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712111    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Apr 24 21:16:47.713480 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712114    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Apr 24 21:16:47.713480 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712116    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Apr 24 21:16:47.713480 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712119    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Apr 24 21:16:47.713480 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712128    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Apr 24 21:16:47.713480 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712132    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Apr 24 21:16:47.713480 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712136    2569 feature_gate.go:328] unrecognized feature gate: Example2
Apr 24 21:16:47.713962 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712138    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Apr 24 21:16:47.713962 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712141    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Apr 24 21:16:47.713962 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712143    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Apr 24 21:16:47.713962 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712146    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Apr 24 21:16:47.713962 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712148    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Apr 24 21:16:47.713962 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712584    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Apr 24 21:16:47.713962 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712590    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Apr 24 21:16:47.713962 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712593    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Apr 24 21:16:47.713962 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712596    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Apr 24 21:16:47.713962 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712599    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Apr 24 21:16:47.713962 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712603    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Apr 24 21:16:47.713962 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712605    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Apr 24 21:16:47.713962 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712608    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Apr 24 21:16:47.713962 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712611    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Apr 24 21:16:47.713962 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712613    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Apr 24 21:16:47.713962 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712616    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Apr 24 21:16:47.713962 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712619    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Apr 24 21:16:47.713962 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712621    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Apr 24 21:16:47.713962 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712624    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Apr 24 21:16:47.713962 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712626    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Apr 24 21:16:47.714463 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712629    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Apr 24 21:16:47.714463 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712632    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Apr 24 21:16:47.714463 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712634    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Apr 24 21:16:47.714463 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712636    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Apr 24 21:16:47.714463 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712639    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Apr 24 21:16:47.714463 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712641    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Apr 24 21:16:47.714463 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712644    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Apr 24 21:16:47.714463 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712647    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Apr 24 21:16:47.714463 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712649    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Apr 24 21:16:47.714463 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712653    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Apr 24 21:16:47.714463 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712656    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Apr 24 21:16:47.714463 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712658    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Apr 24 21:16:47.714463 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712662    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Apr 24 21:16:47.714463 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712666    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Apr 24 21:16:47.714463 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712668    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Apr 24 21:16:47.714463 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712671    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Apr 24 21:16:47.714463 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712673    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Apr 24 21:16:47.714463 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712677    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Apr 24 21:16:47.714463 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712679    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Apr 24 21:16:47.714957 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712682    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Apr 24 21:16:47.714957 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712685    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Apr 24 21:16:47.714957 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712687    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Apr 24 21:16:47.714957 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712689    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Apr 24 21:16:47.714957 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712692    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Apr 24 21:16:47.714957 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712695    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Apr 24 21:16:47.714957 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712697    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Apr 24 21:16:47.714957 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712700    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Apr 24 21:16:47.714957 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712702    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Apr 24 21:16:47.714957 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712705    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Apr 24 21:16:47.714957 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712709    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Apr 24 21:16:47.714957 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712711    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Apr 24 21:16:47.714957 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712714    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Apr 24 21:16:47.714957 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712716    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Apr 24 21:16:47.714957 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712719    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Apr 24 21:16:47.714957 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712721    2569 feature_gate.go:328] unrecognized feature gate: Example2
Apr 24 21:16:47.714957 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712724    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Apr 24 21:16:47.714957 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712726    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Apr 24 21:16:47.714957 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712729    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Apr 24 21:16:47.714957 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712731    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Apr 24 21:16:47.715462 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712733    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Apr 24 21:16:47.715462 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712736    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Apr 24 21:16:47.715462 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712739    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Apr 24 21:16:47.715462 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712742    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Apr 24 21:16:47.715462 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712744    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Apr 24 21:16:47.715462 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712747    2569 feature_gate.go:328] unrecognized feature gate: Example
Apr 24 21:16:47.715462 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712750    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Apr 24 21:16:47.715462 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712753    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Apr 24 21:16:47.715462 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712755    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Apr 24 21:16:47.715462 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712758    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Apr 24 21:16:47.715462 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712761    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Apr 24 21:16:47.715462 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712763    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Apr 24 21:16:47.715462 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712766    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Apr 24 21:16:47.715462 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712769    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Apr 24 21:16:47.715462 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712771    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Apr 24 21:16:47.715462 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712774    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Apr 24 21:16:47.715462 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712776    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Apr 24 21:16:47.715462 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712779    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Apr 24 21:16:47.715462 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712787    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Apr 24 21:16:47.715462 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712790    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Apr 24 21:16:47.715967 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712792    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Apr 24 21:16:47.715967 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712795    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Apr 24 21:16:47.715967 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712797    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Apr 24 21:16:47.715967 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712800    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Apr 24 21:16:47.715967 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712803    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Apr 24 21:16:47.715967 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712805    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Apr 24 21:16:47.715967 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712809    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Apr 24 21:16:47.715967 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712813    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Apr 24 21:16:47.715967 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712816    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Apr 24 21:16:47.715967 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712819    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Apr 24 21:16:47.715967 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712823    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Apr 24 21:16:47.715967 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.712825    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Apr 24 21:16:47.715967 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.712920    2569 flags.go:64] FLAG: --address="0.0.0.0"
Apr 24 21:16:47.715967 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.712930    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Apr 24 21:16:47.715967 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.712937    2569 flags.go:64] FLAG: --anonymous-auth="true"
Apr 24 21:16:47.715967 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.712942    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
Apr 24 21:16:47.715967 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.712946    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
Apr 24 21:16:47.715967 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.712949    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Apr 24 21:16:47.715967 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.712954    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Apr 24 21:16:47.715967 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.712959    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Apr 24 21:16:47.715967 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.712962    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.712966    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.712969    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.712973    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.712976    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.712979    2569 flags.go:64] FLAG: --cgroup-root=""
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.712982    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.712985    2569 flags.go:64] FLAG: --client-ca-file=""
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.712988    2569 flags.go:64] FLAG: --cloud-config=""
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.712991    2569 flags.go:64] FLAG: --cloud-provider="external"
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.712996    2569 flags.go:64] FLAG: --cluster-dns="[]"
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713001    2569 flags.go:64] FLAG: --cluster-domain=""
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713004    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713007    2569 flags.go:64] FLAG: --config-dir=""
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713010    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713014    2569 flags.go:64] FLAG: --container-log-max-files="5"
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713018    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713021    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713024    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713028    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713031    2569 flags.go:64] FLAG: --contention-profiling="false"
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713034    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713037    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713040    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713043    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
Apr 24 21:16:47.716652 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713052    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713055    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713058    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713061    2569 flags.go:64] FLAG: --enable-load-reader="false"
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713064    2569 flags.go:64] FLAG: --enable-server="true"
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713067    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713072    2569 flags.go:64] FLAG: --event-burst="100"
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713076    2569 flags.go:64] FLAG: --event-qps="50"
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713079    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713082    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713085    2569 flags.go:64] FLAG: --eviction-hard=""
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713089    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713092    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713095    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713098    2569 flags.go:64] FLAG: --eviction-soft=""
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713101    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713104    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713108    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713111    2569 flags.go:64] FLAG: --experimental-mounter-path=""
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713114    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713117    2569 flags.go:64] FLAG: --fail-swap-on="true"
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713120    2569 flags.go:64] FLAG: --feature-gates=""
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713123    2569 flags.go:64] FLAG: --file-check-frequency="20s"
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713126    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713130    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Apr 24 21:16:47.717273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713133    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713136    2569 flags.go:64] FLAG: --healthz-port="10248"
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713139    2569 flags.go:64] FLAG: --help="false"
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713142    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-131-162.ec2.internal"
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713145    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713148    2569 flags.go:64] FLAG: --http-check-frequency="20s"
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713151    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713154    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713158    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713161    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713163    2569 flags.go:64] FLAG: --image-service-endpoint=""
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713166    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713169    2569 flags.go:64] FLAG: --kube-api-burst="100"
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713175    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713179    2569 flags.go:64] FLAG: --kube-api-qps="50"
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713182    2569 flags.go:64] FLAG: --kube-reserved=""
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713185    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713188    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713191    2569 flags.go:64] FLAG: --kubelet-cgroups=""
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713194    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713197    2569 flags.go:64] FLAG: --lock-file=""
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713200    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713203    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713206    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Apr 24 21:16:47.717883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713212    2569 flags.go:64] FLAG: --log-json-split-stream="false"
Apr 24 21:16:47.718479 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713215    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Apr 24 21:16:47.718479 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713218    2569 flags.go:64] FLAG: --log-text-split-stream="false"
Apr 24 21:16:47.718479 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713221    2569 flags.go:64] FLAG: --logging-format="text"
Apr 24 21:16:47.718479 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713224    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Apr 24 21:16:47.718479 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713227    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
Apr 24 21:16:47.718479 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713230    2569 flags.go:64] FLAG: --manifest-url=""
Apr 24 21:16:47.718479 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713232    2569 flags.go:64] FLAG: --manifest-url-header=""
Apr 24 21:16:47.718479 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713237    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Apr 24 21:16:47.718479 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713240    2569 flags.go:64] FLAG: --max-open-files="1000000"
Apr 24 21:16:47.718479 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713244    2569 flags.go:64] FLAG: --max-pods="110"
Apr 24 21:16:47.718479 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713247    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
Apr 24 21:16:47.718479 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713250    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Apr 24 21:16:47.718479 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713253    2569 flags.go:64] FLAG: --memory-manager-policy="None"
Apr 24 21:16:47.718479 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713256    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Apr 24 21:16:47.718479 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713259    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Apr 24 21:16:47.718479 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713262    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
Apr 24 21:16:47.718479 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713265    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Apr 24 21:16:47.718479 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713272    2569 flags.go:64] FLAG: --node-status-max-images="50"
Apr 24 21:16:47.718479 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713275    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
Apr 24 21:16:47.718479 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713278    2569 flags.go:64] FLAG: --oom-score-adj="-999"
Apr 24 21:16:47.718479 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713282    2569 flags.go:64] FLAG: --pod-cidr=""
Apr 24 21:16:47.718479 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713285    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c8cfe89231412ff3ee8cb6207fa0be33cad0f08e88c9c0f1e9f7e8c6f14d6715"
Apr 24 21:16:47.718479 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713292    2569 flags.go:64] FLAG: --pod-manifest-path=""
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713295    2569 flags.go:64] FLAG: --pod-max-pids="-1"
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713298    2569 flags.go:64] FLAG: --pods-per-core="0"
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713301    2569 flags.go:64] FLAG: --port="10250"
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713304    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713307    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d91d5fbaebc94a4c"
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713310    2569 flags.go:64] FLAG: --qos-reserved=""
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713313    2569 flags.go:64] FLAG: --read-only-port="10255"
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713316    2569 flags.go:64] FLAG: --register-node="true"
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713320    2569 flags.go:64] FLAG: --register-schedulable="true"
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713323    2569 flags.go:64] FLAG: --register-with-taints=""
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713326    2569 flags.go:64] FLAG: --registry-burst="10"
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713329    2569 flags.go:64] FLAG: --registry-qps="5"
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713332    2569 flags.go:64] FLAG: --reserved-cpus=""
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713335    2569 flags.go:64] FLAG: --reserved-memory=""
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713339    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713341    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713344    2569 flags.go:64] FLAG: --rotate-certificates="false"
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713349    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713352    2569 flags.go:64] FLAG: --runonce="false"
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713355    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713358    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713362    2569 flags.go:64] FLAG: --seccomp-default="false"
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713365    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713367    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713371    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Apr 24 21:16:47.719027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713374    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713393    2569 flags.go:64] FLAG: --storage-driver-password="root"
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713398    2569 flags.go:64] FLAG: --storage-driver-secure="false"
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713403    2569 flags.go:64] FLAG: --storage-driver-table="stats"
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713407    2569 flags.go:64] FLAG: --storage-driver-user="root"
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713411    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713414    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713418    2569 flags.go:64] FLAG: --system-cgroups=""
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713421    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713427    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713429    2569 flags.go:64] FLAG: --tls-cert-file=""
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713432    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713436    2569 flags.go:64] FLAG: --tls-min-version=""
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713439    2569 flags.go:64] FLAG: --tls-private-key-file=""
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713442    2569 flags.go:64] FLAG: --topology-manager-policy="none"
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713446    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713449    2569 flags.go:64] FLAG: --topology-manager-scope="container"
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713452    2569 flags.go:64] FLAG: --v="2"
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713456    2569 flags.go:64] FLAG: --version="false"
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713461    2569 flags.go:64] FLAG: --vmodule=""
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713465    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.713469    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713561    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713564    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Apr 24 21:16:47.719695 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713567    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Apr 24 21:16:47.720283 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713571    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Apr 24 21:16:47.720283 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713573    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Apr 24 21:16:47.720283 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713576    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Apr 24 21:16:47.720283 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713579    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Apr 24 21:16:47.720283 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713581    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Apr 24 21:16:47.720283 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713584    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Apr 24 21:16:47.720283 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713587    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Apr 24 21:16:47.720283 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713589    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Apr 24 21:16:47.720283 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713591    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Apr 24 21:16:47.720283 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713594    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Apr 24 21:16:47.720283 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713597    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Apr 24 21:16:47.720283 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713600    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Apr 24 21:16:47.720283 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713604    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Apr 24 21:16:47.720283 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713606    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Apr 24 21:16:47.720283 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713609    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Apr 24 21:16:47.720283 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713612    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Apr 24 21:16:47.720283 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713615    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Apr 24 21:16:47.720283 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713619    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Apr 24 21:16:47.720283 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713623    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Apr 24 21:16:47.720283 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713625    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Apr 24 21:16:47.720847 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713628    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Apr 24 21:16:47.720847 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713631    2569 feature_gate.go:328] unrecognized feature gate: Example
Apr 24 21:16:47.720847 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713635    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Apr 24 21:16:47.720847 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713638    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Apr 24 21:16:47.720847 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713640    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Apr 24 21:16:47.720847 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713643    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Apr 24 21:16:47.720847 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713645    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Apr 24 21:16:47.720847 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713648    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Apr 24 21:16:47.720847 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713650    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Apr 24 21:16:47.720847 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713653    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Apr 24 21:16:47.720847 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713655    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Apr 24 21:16:47.720847 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713657    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Apr 24 21:16:47.720847 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713660    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Apr 24 21:16:47.720847 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713663    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Apr 24 21:16:47.720847 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713665    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Apr 24 21:16:47.720847 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713668    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Apr 24 21:16:47.720847 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713670    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Apr 24 21:16:47.720847 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713673    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Apr 24 21:16:47.720847 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713675    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Apr 24 21:16:47.720847 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713678    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Apr 24 21:16:47.721345 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713680    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Apr 24 21:16:47.721345 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713683    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Apr 24 21:16:47.721345 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713685    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Apr 24 21:16:47.721345 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713688    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Apr 24 21:16:47.721345 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713692    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Apr 24 21:16:47.721345 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713694    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Apr 24 21:16:47.721345 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713697    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Apr 24 21:16:47.721345 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713699    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Apr 24 21:16:47.721345 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713702    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Apr 24 21:16:47.721345 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713705    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Apr 24 21:16:47.721345 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713707    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Apr 24 21:16:47.721345 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713710    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Apr 24 21:16:47.721345 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713713    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Apr 24 21:16:47.721345 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713715    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Apr 24 21:16:47.721345 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713719    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Apr 24 21:16:47.721345 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713722    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Apr 24 21:16:47.721345 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713724    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Apr 24 21:16:47.721345 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713727    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Apr 24 21:16:47.721345 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713729    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Apr 24 21:16:47.721345 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713732    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Apr 24 21:16:47.722101 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713734    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Apr 24 21:16:47.722101 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713737    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Apr 24 21:16:47.722101 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713739    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Apr 24 21:16:47.722101 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713742    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Apr 24 21:16:47.722101 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713744    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Apr 24 21:16:47.722101 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713747    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Apr 24 21:16:47.722101 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713749    2569 feature_gate.go:328] unrecognized feature gate: Example2
Apr 24 21:16:47.722101 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713752    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Apr 24 21:16:47.722101 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713754    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Apr 24 21:16:47.722101 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713757    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Apr 24 21:16:47.722101 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713759    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Apr 24 21:16:47.722101 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713762    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Apr 24 21:16:47.722101 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713764    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Apr 24 21:16:47.722101 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713766    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Apr 24 21:16:47.722101 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713770    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Apr 24 21:16:47.722101 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713772    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Apr 24 21:16:47.722101 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713776    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Apr 24 21:16:47.722101 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713779    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Apr 24 21:16:47.722101 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713781    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Apr 24 21:16:47.722101 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713785    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Apr 24 21:16:47.722852 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713789    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Apr 24 21:16:47.722852 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713793    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Apr 24 21:16:47.722852 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.713795    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Apr 24 21:16:47.722852 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.714372    2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Apr 24 21:16:47.722852 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.722670    2569 server.go:530] "Kubelet version" kubeletVersion="v1.33.9"
Apr 24 21:16:47.722852 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.722688    2569 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Apr 24 21:16:47.722852 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722740    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Apr 24 21:16:47.722852 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722745    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Apr 24 21:16:47.722852 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722749    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Apr 24 21:16:47.722852 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722752    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Apr 24 21:16:47.722852 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722755    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Apr 24 21:16:47.722852 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722758    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Apr 24 21:16:47.722852 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722761    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Apr 24 21:16:47.722852 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722764    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Apr 24 21:16:47.722852 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722767    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Apr 24 21:16:47.722852 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722770    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Apr 24 21:16:47.723267 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722772    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Apr 24 21:16:47.723267 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722776    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Apr 24 21:16:47.723267 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722778    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Apr 24 21:16:47.723267 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722781    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Apr 24 21:16:47.723267 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722784    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Apr 24 21:16:47.723267 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722786    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Apr 24 21:16:47.723267 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722789    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Apr 24 21:16:47.723267 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722791    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Apr 24 21:16:47.723267 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722794    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Apr 24 21:16:47.723267 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722796    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Apr 24 21:16:47.723267 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722800    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Apr 24 21:16:47.723267 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722804    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Apr 24 21:16:47.723267 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722808    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Apr 24 21:16:47.723267 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722811    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Apr 24 21:16:47.723267 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722814    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Apr 24 21:16:47.723267 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722816    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Apr 24 21:16:47.723267 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722819    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Apr 24 21:16:47.723267 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722822    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Apr 24 21:16:47.723731 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722824    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Apr 24 21:16:47.723731 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722827    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Apr 24 21:16:47.723731 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722829    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Apr 24 21:16:47.723731 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722833    2569 feature_gate.go:328] unrecognized feature gate: Example2
Apr 24 21:16:47.723731 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722836    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Apr 24 21:16:47.723731 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722838    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Apr 24 21:16:47.723731 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722841    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Apr 24 21:16:47.723731 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722844    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Apr 24 21:16:47.723731 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722846    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Apr 24 21:16:47.723731 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722849    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Apr 24 21:16:47.723731 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722851    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Apr 24 21:16:47.723731 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722854    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Apr 24 21:16:47.723731 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722857    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Apr 24 21:16:47.723731 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722860    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Apr 24 21:16:47.723731 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722863    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Apr 24 21:16:47.723731 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722866    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Apr 24 21:16:47.723731 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722869    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Apr 24 21:16:47.723731 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722872    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Apr 24 21:16:47.723731 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722874    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Apr 24 21:16:47.723731 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722877    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Apr 24 21:16:47.724244 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722880    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Apr 24 21:16:47.724244 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722883    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Apr 24 21:16:47.724244 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722886    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Apr 24 21:16:47.724244 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722889    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Apr 24 21:16:47.724244 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722891    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Apr 24 21:16:47.724244 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722894    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Apr 24 21:16:47.724244 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722896    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Apr 24 21:16:47.724244 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722899    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Apr 24 21:16:47.724244 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722902    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Apr 24 21:16:47.724244 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722905    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Apr 24 21:16:47.724244 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722907    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Apr 24 21:16:47.724244 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722910    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Apr 24 21:16:47.724244 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722912    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Apr 24 21:16:47.724244 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722915    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Apr 24 21:16:47.724244 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722917    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Apr 24 21:16:47.724244 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722920    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Apr 24 21:16:47.724244 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722923    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Apr 24 21:16:47.724244 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722926    2569 feature_gate.go:328] unrecognized feature gate: Example
Apr 24 21:16:47.724244 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722930    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Apr 24 21:16:47.724244 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722934    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Apr 24 21:16:47.724803 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722937    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Apr 24 21:16:47.724803 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722939    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Apr 24 21:16:47.724803 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722942    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Apr 24 21:16:47.724803 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722944    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Apr 24 21:16:47.724803 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722947    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Apr 24 21:16:47.724803 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722950    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Apr 24 21:16:47.724803 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722953    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Apr 24 21:16:47.724803 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722956    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Apr 24 21:16:47.724803 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722959    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Apr 24 21:16:47.724803 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722962    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Apr 24 21:16:47.724803 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722964    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Apr 24 21:16:47.724803 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722967    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Apr 24 21:16:47.724803 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722969    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Apr 24 21:16:47.724803 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722972    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Apr 24 21:16:47.724803 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722975    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Apr 24 21:16:47.724803 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722977    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Apr 24 21:16:47.724803 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722980    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Apr 24 21:16:47.724803 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.722982    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Apr 24 21:16:47.725230 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.722987    2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Apr 24 21:16:47.725230 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723098    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Apr 24 21:16:47.725230 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723103    2569 feature_gate.go:328] unrecognized feature gate: Example
Apr 24 21:16:47.725230 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723106    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Apr 24 21:16:47.725230 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723109    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Apr 24 21:16:47.725230 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723112    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Apr 24 21:16:47.725230 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723114    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Apr 24 21:16:47.725230 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723117    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Apr 24 21:16:47.725230 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723119    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Apr 24 21:16:47.725230 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723122    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Apr 24 21:16:47.725230 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723125    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Apr 24 21:16:47.725230 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723127    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Apr 24 21:16:47.725230 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723130    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Apr 24 21:16:47.725230 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723132    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Apr 24 21:16:47.725230 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723135    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Apr 24 21:16:47.725230 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723138    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Apr 24 21:16:47.725639 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723140    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Apr 24 21:16:47.725639 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723143    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Apr 24 21:16:47.725639 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723146    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Apr 24 21:16:47.725639 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723148    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Apr 24 21:16:47.725639 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723151    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Apr 24 21:16:47.725639 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723154    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Apr 24 21:16:47.725639 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723156    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Apr 24 21:16:47.725639 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723159    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Apr 24 21:16:47.725639 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723161    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Apr 24 21:16:47.725639 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723164    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Apr 24 21:16:47.725639 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723166    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Apr 24 21:16:47.725639 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723169    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Apr 24 21:16:47.725639 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723171    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Apr 24 21:16:47.725639 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723174    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Apr 24 21:16:47.725639 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723177    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Apr 24 21:16:47.725639 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723179    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Apr 24 21:16:47.725639 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723182    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Apr 24 21:16:47.725639 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723184    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Apr 24 21:16:47.725639 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723187    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Apr 24 21:16:47.726087 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723190    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Apr 24 21:16:47.726087 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723193    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Apr 24 21:16:47.726087 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723198    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Apr 24 21:16:47.726087 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723201    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Apr 24 21:16:47.726087 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723204    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Apr 24 21:16:47.726087 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723207    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Apr 24 21:16:47.726087 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723210    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Apr 24 21:16:47.726087 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723213    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Apr 24 21:16:47.726087 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723216    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Apr 24 21:16:47.726087 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723218    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Apr 24 21:16:47.726087 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723221    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Apr 24 21:16:47.726087 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723224    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Apr 24 21:16:47.726087 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723226    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Apr 24 21:16:47.726087 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723229    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Apr 24 21:16:47.726087 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723231    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Apr 24 21:16:47.726087 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723234    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Apr 24 21:16:47.726087 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723236    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Apr 24 21:16:47.726087 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723239    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Apr 24 21:16:47.726087 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723242    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Apr 24 21:16:47.726087 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723244    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Apr 24 21:16:47.726598 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723246    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Apr 24 21:16:47.726598 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723249    2569 feature_gate.go:328] unrecognized feature gate: Example2
Apr 24 21:16:47.726598 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723252    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Apr 24 21:16:47.726598 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723254    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Apr 24 21:16:47.726598 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723257    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Apr 24 21:16:47.726598 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723259    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Apr 24 21:16:47.726598 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723262    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Apr 24 21:16:47.726598 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723264    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Apr 24 21:16:47.726598 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723267    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Apr 24 21:16:47.726598 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723269    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Apr 24 21:16:47.726598 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723273    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Apr 24 21:16:47.726598 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723275    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Apr 24 21:16:47.726598 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723278    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Apr 24 21:16:47.726598 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723281    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Apr 24 21:16:47.726598 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723283    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Apr 24 21:16:47.726598 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723286    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Apr 24 21:16:47.726598 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723288    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Apr 24 21:16:47.726598 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723290    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Apr 24 21:16:47.726598 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723293    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Apr 24 21:16:47.726598 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723296    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Apr 24 21:16:47.727127 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723298    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Apr 24 21:16:47.727127 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723301    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Apr 24 21:16:47.727127 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723304    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Apr 24 21:16:47.727127 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723306    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Apr 24 21:16:47.727127 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723309    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Apr 24 21:16:47.727127 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723312    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Apr 24 21:16:47.727127 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723316    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Apr 24 21:16:47.727127 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723318    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Apr 24 21:16:47.727127 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723321    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Apr 24 21:16:47.727127 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723324    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Apr 24 21:16:47.727127 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723326    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Apr 24 21:16:47.727127 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:47.723329    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Apr 24 21:16:47.727127 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.723333    2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Apr 24 21:16:47.727127 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.724033    2569 server.go:962] "Client rotation is on, will bootstrap in background"
Apr 24 21:16:47.727127 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.726819    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Apr 24 21:16:47.727788 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.727777    2569 server.go:1019] "Starting client certificate rotation"
Apr 24 21:16:47.727886 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.727869    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Apr 24 21:16:47.727924 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.727911    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Apr 24 21:16:47.751759 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.751742    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Apr 24 21:16:47.754443 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.754428    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Apr 24 21:16:47.769706 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.769686    2569 log.go:25] "Validated CRI v1 runtime API"
Apr 24 21:16:47.775278 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.775263    2569 log.go:25] "Validated CRI v1 image API"
Apr 24 21:16:47.776484 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.776468    2569 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Apr 24 21:16:47.780143 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.780110    2569 fs.go:135] Filesystem UUIDs: map[376ce3c5-09a8-4c5d-a4e4-2fe13e482c4f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 97f53c03-d3c4-4c0d-9194-9e67ab60799f:/dev/nvme0n1p4]
Apr 24 21:16:47.780193 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.780144    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Apr 24 21:16:47.784272 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.784254    2569 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Apr 24 21:16:47.786406 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.786273    2569 manager.go:217] Machine: {Timestamp:2026-04-24 21:16:47.784448874 +0000 UTC m=+0.403905491 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098457 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23a7b4e64752947d06b166e313b45b SystemUUID:ec23a7b4-e647-5294-7d06-b166e313b45b BootID:9977787e-52bb-440f-a01b-9047d3453b19 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:23:70:78:81:c7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:23:70:78:81:c7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:ba:b2:66:6d:ef Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Apr 24 21:16:47.786406 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.786401    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Apr 24 21:16:47.786527 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.786511    2569 manager.go:233] Version: {KernelVersion:5.14.0-570.107.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260414-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Apr 24 21:16:47.788266 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.788245    2569 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Apr 24 21:16:47.788483 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.788268    2569 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-162.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Apr 24 21:16:47.788664 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.788645    2569 topology_manager.go:138] "Creating topology manager with none policy"
Apr 24 21:16:47.788721 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.788668    2569 container_manager_linux.go:306] "Creating device plugin manager"
Apr 24 21:16:47.788721 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.788692    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Apr 24 21:16:47.789553 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.789523    2569 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Apr 24 21:16:47.790885 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.790869    2569 state_mem.go:36] "Initialized new in-memory state store"
Apr 24 21:16:47.791171 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.791161    2569 server.go:1267] "Using root directory" path="/var/lib/kubelet"
Apr 24 21:16:47.793569 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.793558    2569 kubelet.go:491] "Attempting to sync node with API server"
Apr 24 21:16:47.793607 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.793574    2569 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
Apr 24 21:16:47.793607 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.793587    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Apr 24 21:16:47.793607 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.793596    2569 kubelet.go:397] "Adding apiserver pod source"
Apr 24 21:16:47.793607 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.793604    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Apr 24 21:16:47.794915 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.794901    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Apr 24 21:16:47.794959 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.794928    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Apr 24 21:16:47.798612 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.798594    2569 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.10-2.rhaos4.20.gita4d0894.el9" apiVersion="v1"
Apr 24 21:16:47.800630 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.800617    2569 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Apr 24 21:16:47.801791 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.801779    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Apr 24 21:16:47.801844 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.801800    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Apr 24 21:16:47.801844 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.801809    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Apr 24 21:16:47.801844 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.801815    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Apr 24 21:16:47.801844 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.801821    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Apr 24 21:16:47.801844 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.801827    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Apr 24 21:16:47.801844 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.801833    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Apr 24 21:16:47.801844 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.801839    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Apr 24 21:16:47.801844 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.801845    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Apr 24 21:16:47.802044 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.801853    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Apr 24 21:16:47.802044 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.801865    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Apr 24 21:16:47.802044 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.801877    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Apr 24 21:16:47.803605 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.803593    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Apr 24 21:16:47.803605 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.803606    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
Apr 24 21:16:47.804034 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.804019    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2pqcg"
Apr 24 21:16:47.805171 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:47.805147    2569 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Apr 24 21:16:47.805348 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:47.805329    2569 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Apr 24 21:16:47.807228 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.807216    2569 watchdog_linux.go:99] "Systemd watchdog is not enabled"
Apr 24 21:16:47.807275 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.807257    2569 server.go:1295] "Started kubelet"
Apr 24 21:16:47.807372 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.807347    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Apr 24 21:16:47.807463 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.807420    2569 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Apr 24 21:16:47.807514 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.807477    2569 server_v1.go:47] "podresources" method="list" useActivePods=true
Apr 24 21:16:47.808143 ip-10-0-131-162 systemd[1]: Started Kubernetes Kubelet.
Apr 24 21:16:47.809106 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.808945    2569 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Apr 24 21:16:47.809498 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.809485    2569 server.go:317] "Adding debug handlers to kubelet server"
Apr 24 21:16:47.811660 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.811643    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2pqcg"
Apr 24 21:16:47.812689 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.812665    2569 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-162.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Apr 24 21:16:47.813339 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.813322    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Apr 24 21:16:47.813779 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.813763    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Apr 24 21:16:47.813866 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:47.812548    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-162.ec2.internal.18a96792b6fc0d9b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-162.ec2.internal,UID:ip-10-0-131-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-162.ec2.internal,},FirstTimestamp:2026-04-24 21:16:47.807229339 +0000 UTC m=+0.426685954,LastTimestamp:2026-04-24 21:16:47.807229339 +0000 UTC m=+0.426685954,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-162.ec2.internal,}"
Apr 24 21:16:47.814394 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.814361    2569 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
Apr 24 21:16:47.814394 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.814371    2569 volume_manager.go:295] "The desired_state_of_world populator starts"
Apr 24 21:16:47.814531 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.814404    2569 volume_manager.go:297] "Starting Kubelet Volume Manager"
Apr 24 21:16:47.814531 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.814495    2569 reconstruct.go:97] "Volume reconstruction finished"
Apr 24 21:16:47.814531 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.814505    2569 reconciler.go:26] "Reconciler: start to sync state"
Apr 24 21:16:47.814711 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:47.814684    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-162.ec2.internal\" not found"
Apr 24 21:16:47.816495 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.816463    2569 factory.go:55] Registering systemd factory
Apr 24 21:16:47.816590 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.816525    2569 factory.go:223] Registration of the systemd container factory successfully
Apr 24 21:16:47.817031 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.817015    2569 factory.go:153] Registering CRI-O factory
Apr 24 21:16:47.817031 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.817032    2569 factory.go:223] Registration of the crio container factory successfully
Apr 24 21:16:47.817179 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.817118    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Apr 24 21:16:47.817179 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.817137    2569 factory.go:103] Registering Raw factory
Apr 24 21:16:47.817179 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.817151    2569 manager.go:1196] Started watching for new ooms in manager
Apr 24 21:16:47.817558 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.817535    2569 manager.go:319] Starting recovery of all containers
Apr 24 21:16:47.820619 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:47.820578    2569 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Apr 24 21:16:47.823023 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.822982    2569 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Apr 24 21:16:47.826586 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:47.826564    2569 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-162.ec2.internal\" not found" node="ip-10-0-131-162.ec2.internal"
Apr 24 21:16:47.831281 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.831264    2569 manager.go:324] Recovery completed
Apr 24 21:16:47.835177 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.835164    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Apr 24 21:16:47.837416 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.837400    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientMemory"
Apr 24 21:16:47.837477 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.837429    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasNoDiskPressure"
Apr 24 21:16:47.837477 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.837443    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientPID"
Apr 24 21:16:47.837901 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.837879    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
Apr 24 21:16:47.837901 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.837893    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Apr 24 21:16:47.838000 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.837917    2569 state_mem.go:36] "Initialized new in-memory state store"
Apr 24 21:16:47.839944 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.839933    2569 policy_none.go:49] "None policy: Start"
Apr 24 21:16:47.839996 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.839948    2569 memory_manager.go:186] "Starting memorymanager" policy="None"
Apr 24 21:16:47.839996 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.839958    2569 state_mem.go:35] "Initializing new in-memory state store"
Apr 24 21:16:47.881917 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.881904    2569 manager.go:341] "Starting Device Plugin manager"
Apr 24 21:16:47.882022 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:47.881963    2569 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Apr 24 21:16:47.882022 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.881976    2569 server.go:85] "Starting device plugin registration server"
Apr 24 21:16:47.882243 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.882231    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
Apr 24 21:16:47.882295 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.882255    2569 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Apr 24 21:16:47.882410 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.882394    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Apr 24 21:16:47.882506 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.882497    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Apr 24 21:16:47.882711 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.882508    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Apr 24 21:16:47.883169 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:47.883144    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Apr 24 21:16:47.883265 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:47.883191    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-162.ec2.internal\" not found"
Apr 24 21:16:47.953945 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.953910    2569 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
Apr 24 21:16:47.955159 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.955131    2569 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
Apr 24 21:16:47.955159 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.955162    2569 status_manager.go:230] "Starting to sync pod status with apiserver"
Apr 24 21:16:47.955317 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.955181    2569 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Apr 24 21:16:47.955317 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.955189    2569 kubelet.go:2451] "Starting kubelet main sync loop"
Apr 24 21:16:47.955317 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:47.955223    2569 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Apr 24 21:16:47.957406 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.957369    2569 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Apr 24 21:16:47.983144 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.983095    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Apr 24 21:16:47.984014 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.983995    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientMemory"
Apr 24 21:16:47.984107 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.984028    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasNoDiskPressure"
Apr 24 21:16:47.984107 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.984042    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientPID"
Apr 24 21:16:47.984107 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.984069    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-162.ec2.internal"
Apr 24 21:16:47.992091 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:47.992075    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-162.ec2.internal"
Apr 24 21:16:47.992184 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:47.992100    2569 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-162.ec2.internal\": node \"ip-10-0-131-162.ec2.internal\" not found"
Apr 24 21:16:48.012087 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:48.012065    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-162.ec2.internal\" not found"
Apr 24 21:16:48.055461 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.055430    2569 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-162.ec2.internal"]
Apr 24 21:16:48.055550 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.055510    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Apr 24 21:16:48.056425 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.056409    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientMemory"
Apr 24 21:16:48.056510 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.056437    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasNoDiskPressure"
Apr 24 21:16:48.056510 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.056451    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientPID"
Apr 24 21:16:48.057660 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.057648    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Apr 24 21:16:48.057805 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.057791    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal"
Apr 24 21:16:48.057847 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.057819    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Apr 24 21:16:48.058413 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.058395    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientMemory"
Apr 24 21:16:48.058488 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.058423    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasNoDiskPressure"
Apr 24 21:16:48.058488 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.058434    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientPID"
Apr 24 21:16:48.058488 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.058396    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientMemory"
Apr 24 21:16:48.058619 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.058520    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasNoDiskPressure"
Apr 24 21:16:48.058619 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.058538    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientPID"
Apr 24 21:16:48.059581 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.059566    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.ec2.internal"
Apr 24 21:16:48.059662 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.059595    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Apr 24 21:16:48.060315 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.060299    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientMemory"
Apr 24 21:16:48.060373 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.060324    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasNoDiskPressure"
Apr 24 21:16:48.060373 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.060340    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeHasSufficientPID"
Apr 24 21:16:48.076002 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:48.075974    2569 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-162.ec2.internal\" not found" node="ip-10-0-131-162.ec2.internal"
Apr 24 21:16:48.080446 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:48.080430    2569 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-162.ec2.internal\" not found" node="ip-10-0-131-162.ec2.internal"
Apr 24 21:16:48.112755 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:48.112728    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-162.ec2.internal\" not found"
Apr 24 21:16:48.117110 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.117093    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7ddc67bd8f4881e0e6709f55e2cff023-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal\" (UID: \"7ddc67bd8f4881e0e6709f55e2cff023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal"
Apr 24 21:16:48.117178 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.117118    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ddc67bd8f4881e0e6709f55e2cff023-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal\" (UID: \"7ddc67bd8f4881e0e6709f55e2cff023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal"
Apr 24 21:16:48.117178 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.117138    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aca2508fa5a89bde3f166bc71272b03f-config\") pod \"kube-apiserver-proxy-ip-10-0-131-162.ec2.internal\" (UID: \"aca2508fa5a89bde3f166bc71272b03f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.ec2.internal"
Apr 24 21:16:48.213665 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:48.213628    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-162.ec2.internal\" not found"
Apr 24 21:16:48.217838 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.217797    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7ddc67bd8f4881e0e6709f55e2cff023-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal\" (UID: \"7ddc67bd8f4881e0e6709f55e2cff023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal"
Apr 24 21:16:48.217940 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.217847    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ddc67bd8f4881e0e6709f55e2cff023-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal\" (UID: \"7ddc67bd8f4881e0e6709f55e2cff023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal"
Apr 24 21:16:48.217940 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.217864    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aca2508fa5a89bde3f166bc71272b03f-config\") pod \"kube-apiserver-proxy-ip-10-0-131-162.ec2.internal\" (UID: \"aca2508fa5a89bde3f166bc71272b03f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.ec2.internal"
Apr 24 21:16:48.217940 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.217902    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aca2508fa5a89bde3f166bc71272b03f-config\") pod \"kube-apiserver-proxy-ip-10-0-131-162.ec2.internal\" (UID: \"aca2508fa5a89bde3f166bc71272b03f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.ec2.internal"
Apr 24 21:16:48.217940 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.217901    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ddc67bd8f4881e0e6709f55e2cff023-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal\" (UID: \"7ddc67bd8f4881e0e6709f55e2cff023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal"
Apr 24 21:16:48.217940 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.217900    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7ddc67bd8f4881e0e6709f55e2cff023-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal\" (UID: \"7ddc67bd8f4881e0e6709f55e2cff023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal"
Apr 24 21:16:48.314685 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:48.314614    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-162.ec2.internal\" not found"
Apr 24 21:16:48.377932 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.377910    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal"
Apr 24 21:16:48.382505 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.382482    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.ec2.internal"
Apr 24 21:16:48.414922 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:48.414891    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-162.ec2.internal\" not found"
Apr 24 21:16:48.515365 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:48.515334    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-162.ec2.internal\" not found"
Apr 24 21:16:48.615817 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:48.615752    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-162.ec2.internal\" not found"
Apr 24 21:16:48.716455 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:48.716426    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-162.ec2.internal\" not found"
Apr 24 21:16:48.727709 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.727687    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Apr 24 21:16:48.727877 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.727860    2569 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Apr 24 21:16:48.727924 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.727860    2569 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Apr 24 21:16:48.791364 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.791331    2569 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Apr 24 21:16:48.794184 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.794166    2569 apiserver.go:52] "Watching apiserver"
Apr 24 21:16:48.807211 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.807187    2569 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Apr 24 21:16:48.808769 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.808748    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj","openshift-cluster-node-tuning-operator/tuned-n7lt2","openshift-image-registry/node-ca-2g4mv","openshift-multus/multus-additional-cni-plugins-ppnfd","openshift-multus/multus-f5cf5","openshift-network-diagnostics/network-check-target-76jvz","kube-system/konnectivity-agent-jf6mk","openshift-dns/node-resolver-fmb76","openshift-multus/network-metrics-daemon-v4zl5","openshift-network-operator/iptables-alerter-j9mkq","openshift-ovn-kubernetes/ovnkube-node-nxnnq"]
Apr 24 21:16:48.811438 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.811417    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jf6mk"
Apr 24 21:16:48.812630 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.812609    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:16:48.812775 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:48.812694    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4zl5" podUID="b2e03e73-fa77-4421-b99b-67c0205f5b37"
Apr 24 21:16:48.813521 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.813504    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Apr 24 21:16:48.813569 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.813530    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj"
Apr 24 21:16:48.813606 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.813596    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.813801 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.813765    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-04-23 21:11:47 +0000 UTC" deadline="2027-12-16 09:09:53.212768647 +0000 UTC"
Apr 24 21:16:48.813801 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.813799    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14411h53m4.398973276s"
Apr 24 21:16:48.813972 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.813959    2569 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal"
Apr 24 21:16:48.814576 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.814559    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2g4mv"
Apr 24 21:16:48.815213 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.815197    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Apr 24 21:16:48.815539 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.815526    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Apr 24 21:16:48.815706 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.815691    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.816088 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.816070    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Apr 24 21:16:48.816183 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.816140    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k77jb\""
Apr 24 21:16:48.816701 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.816678    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:48.817223 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.816865    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Apr 24 21:16:48.817223 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.816913    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Apr 24 21:16:48.817223 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.817034    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Apr 24 21:16:48.817223 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.817050    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pml99\""
Apr 24 21:16:48.817223 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.816871    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Apr 24 21:16:48.817223 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.817148    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Apr 24 21:16:48.817616 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.817300    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tz8dc\""
Apr 24 21:16:48.817616 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.817336    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Apr 24 21:16:48.817616 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.817417    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s2wnh\""
Apr 24 21:16:48.817616 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.817514    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Apr 24 21:16:48.817795 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.817772    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Apr 24 21:16:48.817849 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.817806    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Apr 24 21:16:48.817938 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.817916    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tb85r\""
Apr 24 21:16:48.817938 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.817933    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Apr 24 21:16:48.818237 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.818158    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:16:48.818237 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.818173    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Apr 24 21:16:48.818237 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.818225    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Apr 24 21:16:48.818441 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:48.818232    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76jvz" podUID="d3357c66-9444-4360-a1f9-e8317c53e78d"
Apr 24 21:16:48.818789 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.818773    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vldl6\""
Apr 24 21:16:48.818917 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.818903    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Apr 24 21:16:48.819337 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.819319    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fmb76"
Apr 24 21:16:48.821088 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821067    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-run\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.821181 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821101    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-var-lib-kubelet\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.821181 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821129    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7839eda1-3d78-433b-97b0-9c26491cd037-system-cni-dir\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.821181 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821153    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Apr 24 21:16:48.821181 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821158    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7839eda1-3d78-433b-97b0-9c26491cd037-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.821375 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821188    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs\") pod \"network-metrics-daemon-v4zl5\" (UID: \"b2e03e73-fa77-4421-b99b-67c0205f5b37\") " pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:16:48.821375 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821200    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Apr 24 21:16:48.821375 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821227    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a8973dd-997f-4174-aa44-eab290111884-registration-dir\") pod \"aws-ebs-csi-driver-node-fvjsj\" (UID: \"4a8973dd-997f-4174-aa44-eab290111884\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj"
Apr 24 21:16:48.821375 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821163    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9hfvp\""
Apr 24 21:16:48.821375 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821276    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a8973dd-997f-4174-aa44-eab290111884-etc-selinux\") pod \"aws-ebs-csi-driver-node-fvjsj\" (UID: \"4a8973dd-997f-4174-aa44-eab290111884\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj"
Apr 24 21:16:48.821375 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821301    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-etc-systemd\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.821375 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821341    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7839eda1-3d78-433b-97b0-9c26491cd037-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.821375 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821367    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3616b72-2f2e-4eb6-9ba7-cccb369b747d-konnectivity-ca\") pod \"konnectivity-agent-jf6mk\" (UID: \"a3616b72-2f2e-4eb6-9ba7-cccb369b747d\") " pod="kube-system/konnectivity-agent-jf6mk"
Apr 24 21:16:48.821717 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821411    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-host\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.821717 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821438    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhm5h\" (UniqueName: \"kubernetes.io/projected/b210b5ee-5bf3-436b-85a1-16efd64376cb-kube-api-access-mhm5h\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.821717 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821460    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7839eda1-3d78-433b-97b0-9c26491cd037-cnibin\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.821717 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821499    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7839eda1-3d78-433b-97b0-9c26491cd037-os-release\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.821717 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821541    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7839eda1-3d78-433b-97b0-9c26491cd037-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.821717 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821615    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j9mkq"
Apr 24 21:16:48.821717 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821590    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a8973dd-997f-4174-aa44-eab290111884-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fvjsj\" (UID: \"4a8973dd-997f-4174-aa44-eab290111884\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj"
Apr 24 21:16:48.821717 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821654    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-etc-kubernetes\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.821717 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821690    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-sys\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.821717 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821718    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q27m4\" (UniqueName: \"kubernetes.io/projected/a99b95b2-a4d2-4609-8097-82171a8a84c6-kube-api-access-q27m4\") pod \"node-ca-2g4mv\" (UID: \"a99b95b2-a4d2-4609-8097-82171a8a84c6\") " pod="openshift-image-registry/node-ca-2g4mv"
Apr 24 21:16:48.822141 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821743    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b210b5ee-5bf3-436b-85a1-16efd64376cb-tmp\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.822141 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821815    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-etc-modprobe-d\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.822141 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821856    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-etc-sysctl-conf\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.822141 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821882    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-lib-modules\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.822141 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821919    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7839eda1-3d78-433b-97b0-9c26491cd037-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.822141 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821946    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkh8c\" (UniqueName: \"kubernetes.io/projected/b2e03e73-fa77-4421-b99b-67c0205f5b37-kube-api-access-qkh8c\") pod \"network-metrics-daemon-v4zl5\" (UID: \"b2e03e73-fa77-4421-b99b-67c0205f5b37\") " pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:16:48.822141 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821979    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a8973dd-997f-4174-aa44-eab290111884-socket-dir\") pod \"aws-ebs-csi-driver-node-fvjsj\" (UID: \"4a8973dd-997f-4174-aa44-eab290111884\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj"
Apr 24 21:16:48.822141 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.821998    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a8973dd-997f-4174-aa44-eab290111884-device-dir\") pod \"aws-ebs-csi-driver-node-fvjsj\" (UID: \"4a8973dd-997f-4174-aa44-eab290111884\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj"
Apr 24 21:16:48.822141 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.822019    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b210b5ee-5bf3-436b-85a1-16efd64376cb-etc-tuned\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.822141 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.822043    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a99b95b2-a4d2-4609-8097-82171a8a84c6-host\") pod \"node-ca-2g4mv\" (UID: \"a99b95b2-a4d2-4609-8097-82171a8a84c6\") " pod="openshift-image-registry/node-ca-2g4mv"
Apr 24 21:16:48.822141 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.822066    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a99b95b2-a4d2-4609-8097-82171a8a84c6-serviceca\") pod \"node-ca-2g4mv\" (UID: \"a99b95b2-a4d2-4609-8097-82171a8a84c6\") " pod="openshift-image-registry/node-ca-2g4mv"
Apr 24 21:16:48.822141 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.822088    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3616b72-2f2e-4eb6-9ba7-cccb369b747d-agent-certs\") pod \"konnectivity-agent-jf6mk\" (UID: \"a3616b72-2f2e-4eb6-9ba7-cccb369b747d\") " pod="kube-system/konnectivity-agent-jf6mk"
Apr 24 21:16:48.822141 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.822110    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a8973dd-997f-4174-aa44-eab290111884-sys-fs\") pod \"aws-ebs-csi-driver-node-fvjsj\" (UID: \"4a8973dd-997f-4174-aa44-eab290111884\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj"
Apr 24 21:16:48.822141 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.822134    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw8nc\" (UniqueName: \"kubernetes.io/projected/7839eda1-3d78-433b-97b0-9c26491cd037-kube-api-access-qw8nc\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.822648 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.822162    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdqtp\" (UniqueName: \"kubernetes.io/projected/4a8973dd-997f-4174-aa44-eab290111884-kube-api-access-cdqtp\") pod \"aws-ebs-csi-driver-node-fvjsj\" (UID: \"4a8973dd-997f-4174-aa44-eab290111884\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj"
Apr 24 21:16:48.822648 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.822186    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-etc-sysconfig\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.822648 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.822207    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-etc-sysctl-d\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.822790 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.822757    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:48.823772 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.823750    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Apr 24 21:16:48.823909 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.823869    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Apr 24 21:16:48.824238 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.824216    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n99pp\""
Apr 24 21:16:48.824299 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.824249    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Apr 24 21:16:48.824976 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.824954    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Apr 24 21:16:48.827053 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.825636    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Apr 24 21:16:48.827053 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.825647    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hhs9n\""
Apr 24 21:16:48.827053 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.825640    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Apr 24 21:16:48.827053 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.826106    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Apr 24 21:16:48.827053 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.826418    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Apr 24 21:16:48.827053 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.826664    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Apr 24 21:16:48.827328 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.827123    2569 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Apr 24 21:16:48.829646 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.829630    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal"]
Apr 24 21:16:48.830174 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.830150    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Apr 24 21:16:48.830223 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.830218    2569 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.ec2.internal"
Apr 24 21:16:48.834071 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:48.834045    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaca2508fa5a89bde3f166bc71272b03f.slice/crio-24bb97e0308a0bfa2296b4ab739a67bbe5e3268de96af8147196ff363a31c10e WatchSource:0}: Error finding container 24bb97e0308a0bfa2296b4ab739a67bbe5e3268de96af8147196ff363a31c10e: Status 404 returned error can't find the container with id 24bb97e0308a0bfa2296b4ab739a67bbe5e3268de96af8147196ff363a31c10e
Apr 24 21:16:48.834425 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:48.834408    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ddc67bd8f4881e0e6709f55e2cff023.slice/crio-17bcc02274a9d02bc99cfc776d8c3251ca0ada959384ff2b6e9dc3cbb5944019 WatchSource:0}: Error finding container 17bcc02274a9d02bc99cfc776d8c3251ca0ada959384ff2b6e9dc3cbb5944019: Status 404 returned error can't find the container with id 17bcc02274a9d02bc99cfc776d8c3251ca0ada959384ff2b6e9dc3cbb5944019
Apr 24 21:16:48.838785 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.838767    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-162.ec2.internal"]
Apr 24 21:16:48.838845 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.838775    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Apr 24 21:16:48.840581 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.840568    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Apr 24 21:16:48.848432 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.848412    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6jx5b"
Apr 24 21:16:48.856450 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.856431    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6jx5b"
Apr 24 21:16:48.915477 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.915448    2569 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
Apr 24 21:16:48.923395 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923363    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-system-cni-dir\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:48.923494 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923413    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-multus-socket-dir-parent\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:48.923494 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923468    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-host-var-lib-cni-bin\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:48.923596 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923503    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42whk\" (UniqueName: \"kubernetes.io/projected/58b19563-fa57-4e33-a2f1-dacbdbc79d7b-kube-api-access-42whk\") pod \"iptables-alerter-j9mkq\" (UID: \"58b19563-fa57-4e33-a2f1-dacbdbc79d7b\") " pod="openshift-network-operator/iptables-alerter-j9mkq"
Apr 24 21:16:48.923596 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923520    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-log-socket\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:48.923596 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923540    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a8973dd-997f-4174-aa44-eab290111884-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fvjsj\" (UID: \"4a8973dd-997f-4174-aa44-eab290111884\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj"
Apr 24 21:16:48.923596 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923558    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-etc-kubernetes\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.923596 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923581    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-multus-cni-dir\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:48.923769 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923599    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a8973dd-997f-4174-aa44-eab290111884-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fvjsj\" (UID: \"4a8973dd-997f-4174-aa44-eab290111884\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj"
Apr 24 21:16:48.923769 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923608    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-host-cni-netd\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:48.923769 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923675    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-etc-kubernetes\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.923769 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923707    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kdzg\" (UniqueName: \"kubernetes.io/projected/4b964b87-b54e-473c-8ed3-fc3d270c934b-kube-api-access-2kdzg\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:48.923769 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923730    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q27m4\" (UniqueName: \"kubernetes.io/projected/a99b95b2-a4d2-4609-8097-82171a8a84c6-kube-api-access-q27m4\") pod \"node-ca-2g4mv\" (UID: \"a99b95b2-a4d2-4609-8097-82171a8a84c6\") " pod="openshift-image-registry/node-ca-2g4mv"
Apr 24 21:16:48.923769 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923747    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c63ed2b6-a107-4890-9ffc-6da7fb948b75-multus-daemon-config\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:48.923769 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923761    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-host-run-ovn-kubernetes\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:48.924082 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923784    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-host-cni-bin\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:48.924082 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923838    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-etc-modprobe-d\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.924082 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923858    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-lib-modules\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.924082 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923881    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-systemd-units\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:48.924082 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923896    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b964b87-b54e-473c-8ed3-fc3d270c934b-ovnkube-script-lib\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:48.924082 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923932    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qkh8c\" (UniqueName: \"kubernetes.io/projected/b2e03e73-fa77-4421-b99b-67c0205f5b37-kube-api-access-qkh8c\") pod \"network-metrics-daemon-v4zl5\" (UID: \"b2e03e73-fa77-4421-b99b-67c0205f5b37\") " pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:16:48.924082 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923952    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a8973dd-997f-4174-aa44-eab290111884-socket-dir\") pod \"aws-ebs-csi-driver-node-fvjsj\" (UID: \"4a8973dd-997f-4174-aa44-eab290111884\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj"
Apr 24 21:16:48.924082 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923988    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a8973dd-997f-4174-aa44-eab290111884-device-dir\") pod \"aws-ebs-csi-driver-node-fvjsj\" (UID: \"4a8973dd-997f-4174-aa44-eab290111884\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj"
Apr 24 21:16:48.924082 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.923995    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-etc-modprobe-d\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.924082 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924006    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-lib-modules\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.924469 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924133    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4a8973dd-997f-4174-aa44-eab290111884-socket-dir\") pod \"aws-ebs-csi-driver-node-fvjsj\" (UID: \"4a8973dd-997f-4174-aa44-eab290111884\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj"
Apr 24 21:16:48.924469 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924140    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b210b5ee-5bf3-436b-85a1-16efd64376cb-etc-tuned\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.924469 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924142    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4a8973dd-997f-4174-aa44-eab290111884-device-dir\") pod \"aws-ebs-csi-driver-node-fvjsj\" (UID: \"4a8973dd-997f-4174-aa44-eab290111884\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj"
Apr 24 21:16:48.924469 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924169    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a99b95b2-a4d2-4609-8097-82171a8a84c6-host\") pod \"node-ca-2g4mv\" (UID: \"a99b95b2-a4d2-4609-8097-82171a8a84c6\") " pod="openshift-image-registry/node-ca-2g4mv"
Apr 24 21:16:48.924469 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924187    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3616b72-2f2e-4eb6-9ba7-cccb369b747d-agent-certs\") pod \"konnectivity-agent-jf6mk\" (UID: \"a3616b72-2f2e-4eb6-9ba7-cccb369b747d\") " pod="kube-system/konnectivity-agent-jf6mk"
Apr 24 21:16:48.924469 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924203    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-host-run-netns\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:48.924469 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924225    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-run-systemd\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:48.924469 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924237    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a99b95b2-a4d2-4609-8097-82171a8a84c6-host\") pod \"node-ca-2g4mv\" (UID: \"a99b95b2-a4d2-4609-8097-82171a8a84c6\") " pod="openshift-image-registry/node-ca-2g4mv"
Apr 24 21:16:48.924469 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924250    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a8973dd-997f-4174-aa44-eab290111884-sys-fs\") pod \"aws-ebs-csi-driver-node-fvjsj\" (UID: \"4a8973dd-997f-4174-aa44-eab290111884\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj"
Apr 24 21:16:48.924469 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924275    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qw8nc\" (UniqueName: \"kubernetes.io/projected/7839eda1-3d78-433b-97b0-9c26491cd037-kube-api-access-qw8nc\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.924469 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924302    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/58b19563-fa57-4e33-a2f1-dacbdbc79d7b-iptables-alerter-script\") pod \"iptables-alerter-j9mkq\" (UID: \"58b19563-fa57-4e33-a2f1-dacbdbc79d7b\") " pod="openshift-network-operator/iptables-alerter-j9mkq"
Apr 24 21:16:48.924469 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924317    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4a8973dd-997f-4174-aa44-eab290111884-sys-fs\") pod \"aws-ebs-csi-driver-node-fvjsj\" (UID: \"4a8973dd-997f-4174-aa44-eab290111884\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj"
Apr 24 21:16:48.924469 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924329    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-etc-openvswitch\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:48.924469 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924372    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-run-ovn\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:48.924469 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924413    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b964b87-b54e-473c-8ed3-fc3d270c934b-ovnkube-config\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:48.924469 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924425    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Apr 24 21:16:48.924469 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924450    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b964b87-b54e-473c-8ed3-fc3d270c934b-env-overrides\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:48.925016 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924487    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-etc-sysctl-d\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.925016 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924517    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-run\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.925016 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924564    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7839eda1-3d78-433b-97b0-9c26491cd037-system-cni-dir\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.925016 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924568    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-run\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.925016 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924591    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-os-release\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:48.925016 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924609    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c63ed2b6-a107-4890-9ffc-6da7fb948b75-cni-binary-copy\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:48.925016 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924609    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7839eda1-3d78-433b-97b0-9c26491cd037-system-cni-dir\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.925016 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924632    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-etc-sysctl-d\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.925016 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924648    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9dfaba2-66af-41a3-8243-3c4e5b0c6ceb-tmp-dir\") pod \"node-resolver-fmb76\" (UID: \"a9dfaba2-66af-41a3-8243-3c4e5b0c6ceb\") " pod="openshift-dns/node-resolver-fmb76"
Apr 24 21:16:48.925016 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924679    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-node-log\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:48.925016 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924723    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-host-var-lib-cni-multus\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:48.925016 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924753    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8ffd\" (UniqueName: \"kubernetes.io/projected/c63ed2b6-a107-4890-9ffc-6da7fb948b75-kube-api-access-j8ffd\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:48.925016 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924786    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-etc-systemd\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.925016 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924847    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-etc-systemd\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.925016 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924882    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3616b72-2f2e-4eb6-9ba7-cccb369b747d-konnectivity-ca\") pod \"konnectivity-agent-jf6mk\" (UID: \"a3616b72-2f2e-4eb6-9ba7-cccb369b747d\") " pod="kube-system/konnectivity-agent-jf6mk"
Apr 24 21:16:48.925016 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924913    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-var-lib-openvswitch\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:48.925016 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924949    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mhm5h\" (UniqueName: \"kubernetes.io/projected/b210b5ee-5bf3-436b-85a1-16efd64376cb-kube-api-access-mhm5h\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.925760 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.924980    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7839eda1-3d78-433b-97b0-9c26491cd037-os-release\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.925760 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925008    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-host-var-lib-kubelet\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:48.925760 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925035    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-etc-kubernetes\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:48.925760 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925066    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f7wm\" (UniqueName: \"kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm\") pod \"network-check-target-76jvz\" (UID: \"d3357c66-9444-4360-a1f9-e8317c53e78d\") " pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:16:48.925760 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925093    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-sys\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.925760 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925115    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a9dfaba2-66af-41a3-8243-3c4e5b0c6ceb-hosts-file\") pod \"node-resolver-fmb76\" (UID: \"a9dfaba2-66af-41a3-8243-3c4e5b0c6ceb\") " pod="openshift-dns/node-resolver-fmb76"
Apr 24 21:16:48.925760 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925155    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc4lj\" (UniqueName: \"kubernetes.io/projected/a9dfaba2-66af-41a3-8243-3c4e5b0c6ceb-kube-api-access-nc4lj\") pod \"node-resolver-fmb76\" (UID: \"a9dfaba2-66af-41a3-8243-3c4e5b0c6ceb\") " pod="openshift-dns/node-resolver-fmb76"
Apr 24 21:16:48.925760 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925168    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-sys\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.925760 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925189    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-host-kubelet\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:48.925760 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925216    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-host-slash\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:48.925760 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925240    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-multus-conf-dir\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:48.925760 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925289    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-host-run-multus-certs\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:48.925760 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925404    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b210b5ee-5bf3-436b-85a1-16efd64376cb-tmp\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.925760 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925413    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7839eda1-3d78-433b-97b0-9c26491cd037-os-release\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.925760 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925440    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3616b72-2f2e-4eb6-9ba7-cccb369b747d-konnectivity-ca\") pod \"konnectivity-agent-jf6mk\" (UID: \"a3616b72-2f2e-4eb6-9ba7-cccb369b747d\") " pod="kube-system/konnectivity-agent-jf6mk"
Apr 24 21:16:48.925760 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925442    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-etc-sysctl-conf\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.925760 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925497    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7839eda1-3d78-433b-97b0-9c26491cd037-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.926284 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925525    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-host-run-netns\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:48.926284 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925535    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-etc-sysctl-conf\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.926284 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925568    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:48.926284 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925587    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a99b95b2-a4d2-4609-8097-82171a8a84c6-serviceca\") pod \"node-ca-2g4mv\" (UID: \"a99b95b2-a4d2-4609-8097-82171a8a84c6\") " pod="openshift-image-registry/node-ca-2g4mv"
Apr 24 21:16:48.926284 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925602    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-host-run-k8s-cni-cncf-io\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:48.926284 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925625    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-hostroot\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:48.926284 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925644    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7839eda1-3d78-433b-97b0-9c26491cd037-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.926284 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925717    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58b19563-fa57-4e33-a2f1-dacbdbc79d7b-host-slash\") pod \"iptables-alerter-j9mkq\" (UID: \"58b19563-fa57-4e33-a2f1-dacbdbc79d7b\") " pod="openshift-network-operator/iptables-alerter-j9mkq"
Apr 24 21:16:48.926284 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925749    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-run-openvswitch\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:48.926284 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925775    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cdqtp\" (UniqueName: \"kubernetes.io/projected/4a8973dd-997f-4174-aa44-eab290111884-kube-api-access-cdqtp\") pod \"aws-ebs-csi-driver-node-fvjsj\" (UID: \"4a8973dd-997f-4174-aa44-eab290111884\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj"
Apr 24 21:16:48.926284 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925811    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-etc-sysconfig\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.926284 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925842    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-var-lib-kubelet\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.926284 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925866    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7839eda1-3d78-433b-97b0-9c26491cd037-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.926284 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925903    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-cnibin\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:48.926284 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925928    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b964b87-b54e-473c-8ed3-fc3d270c934b-ovn-node-metrics-cert\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:48.926284 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925954    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs\") pod \"network-metrics-daemon-v4zl5\" (UID: \"b2e03e73-fa77-4421-b99b-67c0205f5b37\") " pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:16:48.926284 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.925987    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a8973dd-997f-4174-aa44-eab290111884-registration-dir\") pod \"aws-ebs-csi-driver-node-fvjsj\" (UID: \"4a8973dd-997f-4174-aa44-eab290111884\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj"
Apr 24 21:16:48.926988 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.926010    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a8973dd-997f-4174-aa44-eab290111884-etc-selinux\") pod \"aws-ebs-csi-driver-node-fvjsj\" (UID: \"4a8973dd-997f-4174-aa44-eab290111884\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj"
Apr 24 21:16:48.926988 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.926014    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-etc-sysconfig\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.926988 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.926017    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a99b95b2-a4d2-4609-8097-82171a8a84c6-serviceca\") pod \"node-ca-2g4mv\" (UID: \"a99b95b2-a4d2-4609-8097-82171a8a84c6\") " pod="openshift-image-registry/node-ca-2g4mv"
Apr 24 21:16:48.926988 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.926033    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7839eda1-3d78-433b-97b0-9c26491cd037-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.926988 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.926058    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-host\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.926988 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.926064    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-var-lib-kubelet\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.926988 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.926360    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7839eda1-3d78-433b-97b0-9c26491cd037-cnibin\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.926988 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:48.926653    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 24 21:16:48.926988 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.926725    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4a8973dd-997f-4174-aa44-eab290111884-etc-selinux\") pod \"aws-ebs-csi-driver-node-fvjsj\" (UID: \"4a8973dd-997f-4174-aa44-eab290111884\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj"
Apr 24 21:16:48.926988 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.926788    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b210b5ee-5bf3-436b-85a1-16efd64376cb-host\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.926988 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.926829    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7839eda1-3d78-433b-97b0-9c26491cd037-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.926988 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.926962    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7839eda1-3d78-433b-97b0-9c26491cd037-cnibin\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.927508 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:48.927196    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs podName:b2e03e73-fa77-4421-b99b-67c0205f5b37 nodeName:}" failed. No retries permitted until 2026-04-24 21:16:49.427151437 +0000 UTC m=+2.046608042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs") pod "network-metrics-daemon-v4zl5" (UID: "b2e03e73-fa77-4421-b99b-67c0205f5b37") : object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 24 21:16:48.927585 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.927562    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7839eda1-3d78-433b-97b0-9c26491cd037-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.927639 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.927595    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7839eda1-3d78-433b-97b0-9c26491cd037-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.927716 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.927679    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b210b5ee-5bf3-436b-85a1-16efd64376cb-etc-tuned\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.927839 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.927681    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7839eda1-3d78-433b-97b0-9c26491cd037-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.927839 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.927731    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b210b5ee-5bf3-436b-85a1-16efd64376cb-tmp\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.927839 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.927743    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4a8973dd-997f-4174-aa44-eab290111884-registration-dir\") pod \"aws-ebs-csi-driver-node-fvjsj\" (UID: \"4a8973dd-997f-4174-aa44-eab290111884\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj"
Apr 24 21:16:48.928010 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.927998    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3616b72-2f2e-4eb6-9ba7-cccb369b747d-agent-certs\") pod \"konnectivity-agent-jf6mk\" (UID: \"a3616b72-2f2e-4eb6-9ba7-cccb369b747d\") " pod="kube-system/konnectivity-agent-jf6mk"
Apr 24 21:16:48.934924 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.934897    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkh8c\" (UniqueName: \"kubernetes.io/projected/b2e03e73-fa77-4421-b99b-67c0205f5b37-kube-api-access-qkh8c\") pod \"network-metrics-daemon-v4zl5\" (UID: \"b2e03e73-fa77-4421-b99b-67c0205f5b37\") " pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:16:48.935329 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.935308    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhm5h\" (UniqueName: \"kubernetes.io/projected/b210b5ee-5bf3-436b-85a1-16efd64376cb-kube-api-access-mhm5h\") pod \"tuned-n7lt2\" (UID: \"b210b5ee-5bf3-436b-85a1-16efd64376cb\") " pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:48.935373 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.935326    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q27m4\" (UniqueName: \"kubernetes.io/projected/a99b95b2-a4d2-4609-8097-82171a8a84c6-kube-api-access-q27m4\") pod \"node-ca-2g4mv\" (UID: \"a99b95b2-a4d2-4609-8097-82171a8a84c6\") " pod="openshift-image-registry/node-ca-2g4mv"
Apr 24 21:16:48.935373 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.935349    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw8nc\" (UniqueName: \"kubernetes.io/projected/7839eda1-3d78-433b-97b0-9c26491cd037-kube-api-access-qw8nc\") pod \"multus-additional-cni-plugins-ppnfd\" (UID: \"7839eda1-3d78-433b-97b0-9c26491cd037\") " pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:48.935977 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.935962    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdqtp\" (UniqueName: \"kubernetes.io/projected/4a8973dd-997f-4174-aa44-eab290111884-kube-api-access-cdqtp\") pod \"aws-ebs-csi-driver-node-fvjsj\" (UID: \"4a8973dd-997f-4174-aa44-eab290111884\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj"
Apr 24 21:16:48.958656 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.958613    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.ec2.internal" event={"ID":"aca2508fa5a89bde3f166bc71272b03f","Type":"ContainerStarted","Data":"24bb97e0308a0bfa2296b4ab739a67bbe5e3268de96af8147196ff363a31c10e"}
Apr 24 21:16:48.959516 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:48.959495    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal" event={"ID":"7ddc67bd8f4881e0e6709f55e2cff023","Type":"ContainerStarted","Data":"17bcc02274a9d02bc99cfc776d8c3251ca0ada959384ff2b6e9dc3cbb5944019"}
Apr 24 21:16:49.027846 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.027821    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-host-run-k8s-cni-cncf-io\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.027846 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.027846    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-hostroot\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.028017 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.027862    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58b19563-fa57-4e33-a2f1-dacbdbc79d7b-host-slash\") pod \"iptables-alerter-j9mkq\" (UID: \"58b19563-fa57-4e33-a2f1-dacbdbc79d7b\") " pod="openshift-network-operator/iptables-alerter-j9mkq"
Apr 24 21:16:49.028017 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.027877    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-run-openvswitch\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.028017 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.027901    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-cnibin\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.028017 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.027918    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-hostroot\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.028017 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.027935    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-host-run-k8s-cni-cncf-io\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.028017 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.027941    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b964b87-b54e-473c-8ed3-fc3d270c934b-ovn-node-metrics-cert\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.028017 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.027978    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-run-openvswitch\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.028017 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.027993    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-cnibin\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.028017 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.027998    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-system-cni-dir\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.028409 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028034    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-multus-socket-dir-parent\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.028409 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028041    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-system-cni-dir\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.028409 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.027945    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58b19563-fa57-4e33-a2f1-dacbdbc79d7b-host-slash\") pod \"iptables-alerter-j9mkq\" (UID: \"58b19563-fa57-4e33-a2f1-dacbdbc79d7b\") " pod="openshift-network-operator/iptables-alerter-j9mkq"
Apr 24 21:16:49.028409 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028074    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-host-var-lib-cni-bin\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.028409 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028088    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-multus-socket-dir-parent\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.028409 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028100    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-42whk\" (UniqueName: \"kubernetes.io/projected/58b19563-fa57-4e33-a2f1-dacbdbc79d7b-kube-api-access-42whk\") pod \"iptables-alerter-j9mkq\" (UID: \"58b19563-fa57-4e33-a2f1-dacbdbc79d7b\") " pod="openshift-network-operator/iptables-alerter-j9mkq"
Apr 24 21:16:49.028409 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028129    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-log-socket\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.028409 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028145    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-multus-cni-dir\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.028409 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028156    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-host-var-lib-cni-bin\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.028409 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028188    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-host-cni-netd\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.028409 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028194    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-multus-cni-dir\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.028409 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028187    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-log-socket\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.028409 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028215    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2kdzg\" (UniqueName: \"kubernetes.io/projected/4b964b87-b54e-473c-8ed3-fc3d270c934b-kube-api-access-2kdzg\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.028409 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028222    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-host-cni-netd\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.028409 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028236    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c63ed2b6-a107-4890-9ffc-6da7fb948b75-multus-daemon-config\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.028409 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028258    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-host-run-ovn-kubernetes\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.028409 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028275    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-host-cni-bin\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.028409 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028303    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-systemd-units\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.029197 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028347    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-host-run-ovn-kubernetes\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.029197 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028362    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-host-cni-bin\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.029197 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028351    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-systemd-units\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.029197 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028407    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b964b87-b54e-473c-8ed3-fc3d270c934b-ovnkube-script-lib\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.029197 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028438    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-host-run-netns\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.029197 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028461    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-run-systemd\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.029197 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028487    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/58b19563-fa57-4e33-a2f1-dacbdbc79d7b-iptables-alerter-script\") pod \"iptables-alerter-j9mkq\" (UID: \"58b19563-fa57-4e33-a2f1-dacbdbc79d7b\") " pod="openshift-network-operator/iptables-alerter-j9mkq"
Apr 24 21:16:49.029197 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028493    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-host-run-netns\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.029197 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028512    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-etc-openvswitch\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.029197 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028528    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-run-systemd\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.029197 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028537    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-run-ovn\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.029197 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028560    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b964b87-b54e-473c-8ed3-fc3d270c934b-ovnkube-config\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.029197 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028575    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-etc-openvswitch\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.029197 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028583    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b964b87-b54e-473c-8ed3-fc3d270c934b-env-overrides\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.029197 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028590    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-run-ovn\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.029197 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028619    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-os-release\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.029197 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028643    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c63ed2b6-a107-4890-9ffc-6da7fb948b75-cni-binary-copy\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.029197 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028672    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9dfaba2-66af-41a3-8243-3c4e5b0c6ceb-tmp-dir\") pod \"node-resolver-fmb76\" (UID: \"a9dfaba2-66af-41a3-8243-3c4e5b0c6ceb\") " pod="openshift-dns/node-resolver-fmb76"
Apr 24 21:16:49.029763 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028693    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-node-log\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.029763 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028717    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-host-var-lib-cni-multus\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.029763 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028740    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j8ffd\" (UniqueName: \"kubernetes.io/projected/c63ed2b6-a107-4890-9ffc-6da7fb948b75-kube-api-access-j8ffd\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.029763 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028764    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-var-lib-openvswitch\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.029763 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028792    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-host-var-lib-kubelet\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.029763 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028820    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-etc-kubernetes\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.029763 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028845    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9f7wm\" (UniqueName: \"kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm\") pod \"network-check-target-76jvz\" (UID: \"d3357c66-9444-4360-a1f9-e8317c53e78d\") " pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:16:49.029763 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028863    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c63ed2b6-a107-4890-9ffc-6da7fb948b75-multus-daemon-config\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.029763 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028870    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a9dfaba2-66af-41a3-8243-3c4e5b0c6ceb-hosts-file\") pod \"node-resolver-fmb76\" (UID: \"a9dfaba2-66af-41a3-8243-3c4e5b0c6ceb\") " pod="openshift-dns/node-resolver-fmb76"
Apr 24 21:16:49.029763 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028894    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nc4lj\" (UniqueName: \"kubernetes.io/projected/a9dfaba2-66af-41a3-8243-3c4e5b0c6ceb-kube-api-access-nc4lj\") pod \"node-resolver-fmb76\" (UID: \"a9dfaba2-66af-41a3-8243-3c4e5b0c6ceb\") " pod="openshift-dns/node-resolver-fmb76"
Apr 24 21:16:49.029763 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028919    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-host-var-lib-kubelet\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.029763 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028920    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-host-kubelet\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.029763 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028958    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-host-kubelet\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.029763 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028961    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-host-slash\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.029763 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028999    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-multus-conf-dir\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.029763 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.029008    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-host-slash\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.029763 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.029024    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-host-run-multus-certs\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.029763 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.029038    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/58b19563-fa57-4e33-a2f1-dacbdbc79d7b-iptables-alerter-script\") pod \"iptables-alerter-j9mkq\" (UID: \"58b19563-fa57-4e33-a2f1-dacbdbc79d7b\") " pod="openshift-network-operator/iptables-alerter-j9mkq"
Apr 24 21:16:49.030331 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.029054    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-host-run-netns\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.030331 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.029048    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-host-var-lib-cni-multus\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.030331 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.029078    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b964b87-b54e-473c-8ed3-fc3d270c934b-env-overrides\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.030331 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.029083    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.030331 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.029100    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a9dfaba2-66af-41a3-8243-3c4e5b0c6ceb-hosts-file\") pod \"node-resolver-fmb76\" (UID: \"a9dfaba2-66af-41a3-8243-3c4e5b0c6ceb\") " pod="openshift-dns/node-resolver-fmb76"
Apr 24 21:16:49.030331 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.029125    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b964b87-b54e-473c-8ed3-fc3d270c934b-ovnkube-script-lib\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.030331 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.029160    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-host-run-multus-certs\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.030331 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.029170    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-var-lib-openvswitch\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.030331 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.029196    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-etc-kubernetes\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.030331 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.029210    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b964b87-b54e-473c-8ed3-fc3d270c934b-ovnkube-config\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.030331 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.029227    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-os-release\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.030331 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.029227    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c63ed2b6-a107-4890-9ffc-6da7fb948b75-multus-conf-dir\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.030331 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.029266    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.030331 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.029272    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-host-run-netns\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.030331 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.028829    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b964b87-b54e-473c-8ed3-fc3d270c934b-node-log\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.030331 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.029522    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c63ed2b6-a107-4890-9ffc-6da7fb948b75-cni-binary-copy\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.030331 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.029534    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9dfaba2-66af-41a3-8243-3c4e5b0c6ceb-tmp-dir\") pod \"node-resolver-fmb76\" (UID: \"a9dfaba2-66af-41a3-8243-3c4e5b0c6ceb\") " pod="openshift-dns/node-resolver-fmb76"
Apr 24 21:16:49.030331 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.030324    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b964b87-b54e-473c-8ed3-fc3d270c934b-ovn-node-metrics-cert\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.036497 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:49.036478    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Apr 24 21:16:49.036598 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:49.036501    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Apr 24 21:16:49.036598 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:49.036513    2569 projected.go:194] Error preparing data for projected volume kube-api-access-9f7wm for pod openshift-network-diagnostics/network-check-target-76jvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 24 21:16:49.036598 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:49.036580    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm podName:d3357c66-9444-4360-a1f9-e8317c53e78d nodeName:}" failed. No retries permitted until 2026-04-24 21:16:49.536562296 +0000 UTC m=+2.156018905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9f7wm" (UniqueName: "kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm") pod "network-check-target-76jvz" (UID: "d3357c66-9444-4360-a1f9-e8317c53e78d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 24 21:16:49.037897 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.037880    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8ffd\" (UniqueName: \"kubernetes.io/projected/c63ed2b6-a107-4890-9ffc-6da7fb948b75-kube-api-access-j8ffd\") pod \"multus-f5cf5\" (UID: \"c63ed2b6-a107-4890-9ffc-6da7fb948b75\") " pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.038213 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.038195    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42whk\" (UniqueName: \"kubernetes.io/projected/58b19563-fa57-4e33-a2f1-dacbdbc79d7b-kube-api-access-42whk\") pod \"iptables-alerter-j9mkq\" (UID: \"58b19563-fa57-4e33-a2f1-dacbdbc79d7b\") " pod="openshift-network-operator/iptables-alerter-j9mkq"
Apr 24 21:16:49.038561 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.038541    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc4lj\" (UniqueName: \"kubernetes.io/projected/a9dfaba2-66af-41a3-8243-3c4e5b0c6ceb-kube-api-access-nc4lj\") pod \"node-resolver-fmb76\" (UID: \"a9dfaba2-66af-41a3-8243-3c4e5b0c6ceb\") " pod="openshift-dns/node-resolver-fmb76"
Apr 24 21:16:49.038636 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.038571    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kdzg\" (UniqueName: \"kubernetes.io/projected/4b964b87-b54e-473c-8ed3-fc3d270c934b-kube-api-access-2kdzg\") pod \"ovnkube-node-nxnnq\" (UID: \"4b964b87-b54e-473c-8ed3-fc3d270c934b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.139374 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.139317    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jf6mk"
Apr 24 21:16:49.144882 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.144862    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj"
Apr 24 21:16:49.145249 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:49.145223    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3616b72_2f2e_4eb6_9ba7_cccb369b747d.slice/crio-484ca71e0fc6ad9ea4411645eca78a37ae45f01698f7b6bf237c9889494640ba WatchSource:0}: Error finding container 484ca71e0fc6ad9ea4411645eca78a37ae45f01698f7b6bf237c9889494640ba: Status 404 returned error can't find the container with id 484ca71e0fc6ad9ea4411645eca78a37ae45f01698f7b6bf237c9889494640ba
Apr 24 21:16:49.151035 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.151014    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n7lt2"
Apr 24 21:16:49.151547 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:49.151408    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a8973dd_997f_4174_aa44_eab290111884.slice/crio-8411b68c890cdc233d6da1d20b8df7e5471ecc28624ca3e9c92dba324d18dfcd WatchSource:0}: Error finding container 8411b68c890cdc233d6da1d20b8df7e5471ecc28624ca3e9c92dba324d18dfcd: Status 404 returned error can't find the container with id 8411b68c890cdc233d6da1d20b8df7e5471ecc28624ca3e9c92dba324d18dfcd
Apr 24 21:16:49.156421 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.156404    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2g4mv"
Apr 24 21:16:49.156698 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:49.156661    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb210b5ee_5bf3_436b_85a1_16efd64376cb.slice/crio-b2f83e81e3c356e51b81d8f209d7849be2666491d2d8e681396c5393eb3396db WatchSource:0}: Error finding container b2f83e81e3c356e51b81d8f209d7849be2666491d2d8e681396c5393eb3396db: Status 404 returned error can't find the container with id b2f83e81e3c356e51b81d8f209d7849be2666491d2d8e681396c5393eb3396db
Apr 24 21:16:49.161610 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.161462    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ppnfd"
Apr 24 21:16:49.163001 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:49.162979    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda99b95b2_a4d2_4609_8097_82171a8a84c6.slice/crio-403f2c2d6f9758148b5afb9e9d859090c85a70228e3cc9c70fdbabc4e318ac64 WatchSource:0}: Error finding container 403f2c2d6f9758148b5afb9e9d859090c85a70228e3cc9c70fdbabc4e318ac64: Status 404 returned error can't find the container with id 403f2c2d6f9758148b5afb9e9d859090c85a70228e3cc9c70fdbabc4e318ac64
Apr 24 21:16:49.167443 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.167422    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f5cf5"
Apr 24 21:16:49.168080 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:49.168058    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7839eda1_3d78_433b_97b0_9c26491cd037.slice/crio-df11315580b73357b21e81f57da36fa751748b362488c3687993e8032f5bfaad WatchSource:0}: Error finding container df11315580b73357b21e81f57da36fa751748b362488c3687993e8032f5bfaad: Status 404 returned error can't find the container with id df11315580b73357b21e81f57da36fa751748b362488c3687993e8032f5bfaad
Apr 24 21:16:49.173762 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.173484    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fmb76"
Apr 24 21:16:49.175797 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:49.175775    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc63ed2b6_a107_4890_9ffc_6da7fb948b75.slice/crio-f6bef08eabc0a537712c3011159ec86d48efe8b1db7f1e8d92548cdfdd522b2e WatchSource:0}: Error finding container f6bef08eabc0a537712c3011159ec86d48efe8b1db7f1e8d92548cdfdd522b2e: Status 404 returned error can't find the container with id f6bef08eabc0a537712c3011159ec86d48efe8b1db7f1e8d92548cdfdd522b2e
Apr 24 21:16:49.179185 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.179165    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j9mkq"
Apr 24 21:16:49.182056 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:49.182034    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9dfaba2_66af_41a3_8243_3c4e5b0c6ceb.slice/crio-e038c36ec445cb21e6f3d532f51d83db5a32eb3470fe5a3e38fe36edfd46f178 WatchSource:0}: Error finding container e038c36ec445cb21e6f3d532f51d83db5a32eb3470fe5a3e38fe36edfd46f178: Status 404 returned error can't find the container with id e038c36ec445cb21e6f3d532f51d83db5a32eb3470fe5a3e38fe36edfd46f178
Apr 24 21:16:49.182743 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.182727    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:16:49.189121 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:49.189071    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b19563_fa57_4e33_a2f1_dacbdbc79d7b.slice/crio-dc6334a193965b9ca7dfc1261bef6eb2ba0ab83f18d84bb7ea15003a1986b560 WatchSource:0}: Error finding container dc6334a193965b9ca7dfc1261bef6eb2ba0ab83f18d84bb7ea15003a1986b560: Status 404 returned error can't find the container with id dc6334a193965b9ca7dfc1261bef6eb2ba0ab83f18d84bb7ea15003a1986b560
Apr 24 21:16:49.194052 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:16:49.194028    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b964b87_b54e_473c_8ed3_fc3d270c934b.slice/crio-ea8e55de09a10d951f9de565b79697d2325159fe4edc09ce8f53310a5247fc18 WatchSource:0}: Error finding container ea8e55de09a10d951f9de565b79697d2325159fe4edc09ce8f53310a5247fc18: Status 404 returned error can't find the container with id ea8e55de09a10d951f9de565b79697d2325159fe4edc09ce8f53310a5247fc18
Apr 24 21:16:49.294055 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.294021    2569 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Apr 24 21:16:49.432598 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.432468    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs\") pod \"network-metrics-daemon-v4zl5\" (UID: \"b2e03e73-fa77-4421-b99b-67c0205f5b37\") " pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:16:49.432753 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:49.432615    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 24 21:16:49.432753 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:49.432700    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs podName:b2e03e73-fa77-4421-b99b-67c0205f5b37 nodeName:}" failed. No retries permitted until 2026-04-24 21:16:50.432679493 +0000 UTC m=+3.052136118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs") pod "network-metrics-daemon-v4zl5" (UID: "b2e03e73-fa77-4421-b99b-67c0205f5b37") : object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 24 21:16:49.634392 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.634182    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9f7wm\" (UniqueName: \"kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm\") pod \"network-check-target-76jvz\" (UID: \"d3357c66-9444-4360-a1f9-e8317c53e78d\") " pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:16:49.634392 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:49.634347    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Apr 24 21:16:49.634392 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:49.634366    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Apr 24 21:16:49.634392 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:49.634396    2569 projected.go:194] Error preparing data for projected volume kube-api-access-9f7wm for pod openshift-network-diagnostics/network-check-target-76jvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 24 21:16:49.634735 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:49.634455    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm podName:d3357c66-9444-4360-a1f9-e8317c53e78d nodeName:}" failed. No retries permitted until 2026-04-24 21:16:50.634435166 +0000 UTC m=+3.253891773 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9f7wm" (UniqueName: "kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm") pod "network-check-target-76jvz" (UID: "d3357c66-9444-4360-a1f9-e8317c53e78d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 24 21:16:49.857279 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.857095    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-23 21:11:48 +0000 UTC" deadline="2027-09-26 14:57:05.639945114 +0000 UTC"
Apr 24 21:16:49.857279 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.857134    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12473h40m15.782814842s"
Apr 24 21:16:49.929911 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.929700    2569 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Apr 24 21:16:49.958668 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.958640    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:16:49.958832 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:49.958748    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76jvz" podUID="d3357c66-9444-4360-a1f9-e8317c53e78d"
Apr 24 21:16:49.959228 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.959206    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:16:49.959339 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:49.959320    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4zl5" podUID="b2e03e73-fa77-4421-b99b-67c0205f5b37"
Apr 24 21:16:49.969271 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.969250    2569 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Apr 24 21:16:49.975158 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.975107    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq" event={"ID":"4b964b87-b54e-473c-8ed3-fc3d270c934b","Type":"ContainerStarted","Data":"ea8e55de09a10d951f9de565b79697d2325159fe4edc09ce8f53310a5247fc18"}
Apr 24 21:16:49.983531 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.983504    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f5cf5" event={"ID":"c63ed2b6-a107-4890-9ffc-6da7fb948b75","Type":"ContainerStarted","Data":"f6bef08eabc0a537712c3011159ec86d48efe8b1db7f1e8d92548cdfdd522b2e"}
Apr 24 21:16:49.985028 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:49.985004    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2g4mv" event={"ID":"a99b95b2-a4d2-4609-8097-82171a8a84c6","Type":"ContainerStarted","Data":"403f2c2d6f9758148b5afb9e9d859090c85a70228e3cc9c70fdbabc4e318ac64"}
Apr 24 21:16:50.000670 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:50.000642    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n7lt2" event={"ID":"b210b5ee-5bf3-436b-85a1-16efd64376cb","Type":"ContainerStarted","Data":"b2f83e81e3c356e51b81d8f209d7849be2666491d2d8e681396c5393eb3396db"}
Apr 24 21:16:50.003344 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:50.003320    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj" event={"ID":"4a8973dd-997f-4174-aa44-eab290111884","Type":"ContainerStarted","Data":"8411b68c890cdc233d6da1d20b8df7e5471ecc28624ca3e9c92dba324d18dfcd"}
Apr 24 21:16:50.014106 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:50.014044    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j9mkq" event={"ID":"58b19563-fa57-4e33-a2f1-dacbdbc79d7b","Type":"ContainerStarted","Data":"dc6334a193965b9ca7dfc1261bef6eb2ba0ab83f18d84bb7ea15003a1986b560"}
Apr 24 21:16:50.019627 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:50.019603    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fmb76" event={"ID":"a9dfaba2-66af-41a3-8243-3c4e5b0c6ceb","Type":"ContainerStarted","Data":"e038c36ec445cb21e6f3d532f51d83db5a32eb3470fe5a3e38fe36edfd46f178"}
Apr 24 21:16:50.033766 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:50.033735    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppnfd" event={"ID":"7839eda1-3d78-433b-97b0-9c26491cd037","Type":"ContainerStarted","Data":"df11315580b73357b21e81f57da36fa751748b362488c3687993e8032f5bfaad"}
Apr 24 21:16:50.059881 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:50.059834    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jf6mk" event={"ID":"a3616b72-2f2e-4eb6-9ba7-cccb369b747d","Type":"ContainerStarted","Data":"484ca71e0fc6ad9ea4411645eca78a37ae45f01698f7b6bf237c9889494640ba"}
Apr 24 21:16:50.442027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:50.441719    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs\") pod \"network-metrics-daemon-v4zl5\" (UID: \"b2e03e73-fa77-4421-b99b-67c0205f5b37\") " pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:16:50.442027 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:50.441854    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 24 21:16:50.442027 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:50.441914    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs podName:b2e03e73-fa77-4421-b99b-67c0205f5b37 nodeName:}" failed. No retries permitted until 2026-04-24 21:16:52.44189601 +0000 UTC m=+5.061352620 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs") pod "network-metrics-daemon-v4zl5" (UID: "b2e03e73-fa77-4421-b99b-67c0205f5b37") : object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 24 21:16:50.644063 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:50.644009    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9f7wm\" (UniqueName: \"kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm\") pod \"network-check-target-76jvz\" (UID: \"d3357c66-9444-4360-a1f9-e8317c53e78d\") " pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:16:50.644296 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:50.644226    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Apr 24 21:16:50.644296 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:50.644247    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Apr 24 21:16:50.644296 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:50.644263    2569 projected.go:194] Error preparing data for projected volume kube-api-access-9f7wm for pod openshift-network-diagnostics/network-check-target-76jvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 24 21:16:50.644605 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:50.644329    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm podName:d3357c66-9444-4360-a1f9-e8317c53e78d nodeName:}" failed. No retries permitted until 2026-04-24 21:16:52.644309114 +0000 UTC m=+5.263765720 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9f7wm" (UniqueName: "kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm") pod "network-check-target-76jvz" (UID: "d3357c66-9444-4360-a1f9-e8317c53e78d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 24 21:16:50.857542 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:50.857406    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-23 21:11:48 +0000 UTC" deadline="2028-01-06 20:10:14.557587328 +0000 UTC"
Apr 24 21:16:50.857542 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:50.857443    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14926h53m23.700147716s"
Apr 24 21:16:51.958153 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:51.957564    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:16:51.958153 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:51.957691    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76jvz" podUID="d3357c66-9444-4360-a1f9-e8317c53e78d"
Apr 24 21:16:51.959116 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:51.958854    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:16:51.959116 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:51.958979    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4zl5" podUID="b2e03e73-fa77-4421-b99b-67c0205f5b37"
Apr 24 21:16:52.460156 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:52.460116    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs\") pod \"network-metrics-daemon-v4zl5\" (UID: \"b2e03e73-fa77-4421-b99b-67c0205f5b37\") " pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:16:52.460348 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:52.460334    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 24 21:16:52.460439 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:52.460419    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs podName:b2e03e73-fa77-4421-b99b-67c0205f5b37 nodeName:}" failed. No retries permitted until 2026-04-24 21:16:56.460399 +0000 UTC m=+9.079855620 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs") pod "network-metrics-daemon-v4zl5" (UID: "b2e03e73-fa77-4421-b99b-67c0205f5b37") : object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 24 21:16:52.662915 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:52.662498    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9f7wm\" (UniqueName: \"kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm\") pod \"network-check-target-76jvz\" (UID: \"d3357c66-9444-4360-a1f9-e8317c53e78d\") " pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:16:52.662915 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:52.662747    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Apr 24 21:16:52.662915 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:52.662770    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Apr 24 21:16:52.662915 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:52.662783    2569 projected.go:194] Error preparing data for projected volume kube-api-access-9f7wm for pod openshift-network-diagnostics/network-check-target-76jvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 24 21:16:52.662915 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:52.662838    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm podName:d3357c66-9444-4360-a1f9-e8317c53e78d nodeName:}" failed. No retries permitted until 2026-04-24 21:16:56.662819996 +0000 UTC m=+9.282276604 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9f7wm" (UniqueName: "kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm") pod "network-check-target-76jvz" (UID: "d3357c66-9444-4360-a1f9-e8317c53e78d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 24 21:16:53.956480 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:53.956441    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:16:53.956945 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:53.956591    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4zl5" podUID="b2e03e73-fa77-4421-b99b-67c0205f5b37"
Apr 24 21:16:53.957127 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:53.957107    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:16:53.957260 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:53.957239    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76jvz" podUID="d3357c66-9444-4360-a1f9-e8317c53e78d"
Apr 24 21:16:55.956193 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:55.956041    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:16:55.956698 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:55.956198    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4zl5" podUID="b2e03e73-fa77-4421-b99b-67c0205f5b37"
Apr 24 21:16:55.956698 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:55.956541    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:16:55.956698 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:55.956633    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76jvz" podUID="d3357c66-9444-4360-a1f9-e8317c53e78d"
Apr 24 21:16:56.494680 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:56.494641    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs\") pod \"network-metrics-daemon-v4zl5\" (UID: \"b2e03e73-fa77-4421-b99b-67c0205f5b37\") " pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:16:56.494875 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:56.494797    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 24 21:16:56.494875 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:56.494861    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs podName:b2e03e73-fa77-4421-b99b-67c0205f5b37 nodeName:}" failed. No retries permitted until 2026-04-24 21:17:04.494841885 +0000 UTC m=+17.114298494 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs") pod "network-metrics-daemon-v4zl5" (UID: "b2e03e73-fa77-4421-b99b-67c0205f5b37") : object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 24 21:16:56.696813 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:56.696757    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9f7wm\" (UniqueName: \"kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm\") pod \"network-check-target-76jvz\" (UID: \"d3357c66-9444-4360-a1f9-e8317c53e78d\") " pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:16:56.696991 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:56.696938    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Apr 24 21:16:56.696991 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:56.696963    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Apr 24 21:16:56.696991 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:56.696977    2569 projected.go:194] Error preparing data for projected volume kube-api-access-9f7wm for pod openshift-network-diagnostics/network-check-target-76jvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 24 21:16:56.697161 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:56.697044    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm podName:d3357c66-9444-4360-a1f9-e8317c53e78d nodeName:}" failed. No retries permitted until 2026-04-24 21:17:04.697025583 +0000 UTC m=+17.316482191 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9f7wm" (UniqueName: "kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm") pod "network-check-target-76jvz" (UID: "d3357c66-9444-4360-a1f9-e8317c53e78d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 24 21:16:57.956617 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:57.956366    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:16:57.956617 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:57.956428    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:16:57.956617 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:57.956529    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4zl5" podUID="b2e03e73-fa77-4421-b99b-67c0205f5b37"
Apr 24 21:16:57.957417 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:57.957352    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76jvz" podUID="d3357c66-9444-4360-a1f9-e8317c53e78d"
Apr 24 21:16:59.955960 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:59.955927    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:16:59.956430 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:59.956037    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76jvz" podUID="d3357c66-9444-4360-a1f9-e8317c53e78d"
Apr 24 21:16:59.956430 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:16:59.956139    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:16:59.956430 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:16:59.956264    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4zl5" podUID="b2e03e73-fa77-4421-b99b-67c0205f5b37"
Apr 24 21:17:01.956424 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:01.956375    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:17:01.956424 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:01.956408    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:17:01.957001 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:01.956534    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4zl5" podUID="b2e03e73-fa77-4421-b99b-67c0205f5b37"
Apr 24 21:17:01.957001 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:01.956620    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76jvz" podUID="d3357c66-9444-4360-a1f9-e8317c53e78d"
Apr 24 21:17:03.956466 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:03.956432    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:17:03.956914 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:03.956445    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:17:03.956914 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:03.956548    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4zl5" podUID="b2e03e73-fa77-4421-b99b-67c0205f5b37"
Apr 24 21:17:03.956914 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:03.956603    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76jvz" podUID="d3357c66-9444-4360-a1f9-e8317c53e78d"
Apr 24 21:17:04.551456 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:04.551421    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs\") pod \"network-metrics-daemon-v4zl5\" (UID: \"b2e03e73-fa77-4421-b99b-67c0205f5b37\") " pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:17:04.551692 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:04.551558    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 24 21:17:04.551692 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:04.551620    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs podName:b2e03e73-fa77-4421-b99b-67c0205f5b37 nodeName:}" failed. No retries permitted until 2026-04-24 21:17:20.551600059 +0000 UTC m=+33.171056667 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs") pod "network-metrics-daemon-v4zl5" (UID: "b2e03e73-fa77-4421-b99b-67c0205f5b37") : object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 24 21:17:04.752299 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:04.752267    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9f7wm\" (UniqueName: \"kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm\") pod \"network-check-target-76jvz\" (UID: \"d3357c66-9444-4360-a1f9-e8317c53e78d\") " pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:17:04.752547 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:04.752464    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Apr 24 21:17:04.752547 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:04.752490    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Apr 24 21:17:04.752547 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:04.752504    2569 projected.go:194] Error preparing data for projected volume kube-api-access-9f7wm for pod openshift-network-diagnostics/network-check-target-76jvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 24 21:17:04.752674 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:04.752571    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm podName:d3357c66-9444-4360-a1f9-e8317c53e78d nodeName:}" failed. No retries permitted until 2026-04-24 21:17:20.752550906 +0000 UTC m=+33.372007514 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9f7wm" (UniqueName: "kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm") pod "network-check-target-76jvz" (UID: "d3357c66-9444-4360-a1f9-e8317c53e78d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 24 21:17:05.955979 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:05.955945    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:17:05.956477 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:05.955945    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:17:05.956477 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:05.956082    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76jvz" podUID="d3357c66-9444-4360-a1f9-e8317c53e78d"
Apr 24 21:17:05.956477 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:05.956179    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4zl5" podUID="b2e03e73-fa77-4421-b99b-67c0205f5b37"
Apr 24 21:17:07.956905 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:07.956879    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:17:07.957677 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:07.956997    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:17:07.957677 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:07.957021    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4zl5" podUID="b2e03e73-fa77-4421-b99b-67c0205f5b37"
Apr 24 21:17:07.957677 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:07.957068    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76jvz" podUID="d3357c66-9444-4360-a1f9-e8317c53e78d"
Apr 24 21:17:08.095122 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:08.095080    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fmb76" event={"ID":"a9dfaba2-66af-41a3-8243-3c4e5b0c6ceb","Type":"ContainerStarted","Data":"4c10e430e61d2f10d159783b95132e380dbe55ab722838c0872096c71d20b164"}
Apr 24 21:17:08.097988 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:08.097960    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq" event={"ID":"4b964b87-b54e-473c-8ed3-fc3d270c934b","Type":"ContainerStarted","Data":"ccba571d7f89591ae15d5d1fc5fc85422d35e3be1b8bee931d09cf4e1eb8a5be"}
Apr 24 21:17:08.097988 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:08.097992    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq" event={"ID":"4b964b87-b54e-473c-8ed3-fc3d270c934b","Type":"ContainerStarted","Data":"ba1cd07fcb391ec8c32efe9a153ca09951f8b6ca2cfa698612d80718ae336cc3"}
Apr 24 21:17:08.098151 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:08.098005    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq" event={"ID":"4b964b87-b54e-473c-8ed3-fc3d270c934b","Type":"ContainerStarted","Data":"2030ce38f21f527be8092f3221d8c729539ca5270a6c31205cd14aca293b5c8f"}
Apr 24 21:17:08.098151 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:08.098017    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq" event={"ID":"4b964b87-b54e-473c-8ed3-fc3d270c934b","Type":"ContainerStarted","Data":"23ea6c97884b398b01fe0a8da652a3f90fc1b32bb1039a5e92e64917b72c4d0d"}
Apr 24 21:17:08.098151 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:08.098027    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq" event={"ID":"4b964b87-b54e-473c-8ed3-fc3d270c934b","Type":"ContainerStarted","Data":"c4f6efd9adb047dce2c4967e8787d1820d317cd346005f56732a46c247c47862"}
Apr 24 21:17:08.098151 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:08.098038    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq" event={"ID":"4b964b87-b54e-473c-8ed3-fc3d270c934b","Type":"ContainerStarted","Data":"383129ddf739e7d996d93d380a88af54e88bb15202b5b5bb6c44a03b097ad7d4"}
Apr 24 21:17:08.102446 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:08.102420    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f5cf5" event={"ID":"c63ed2b6-a107-4890-9ffc-6da7fb948b75","Type":"ContainerStarted","Data":"e635e1bfe94f204dfcf6e9cf81ccd975ce89c909ea1dde309270829eb9be2491"}
Apr 24 21:17:08.104033 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:08.104010    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2g4mv" event={"ID":"a99b95b2-a4d2-4609-8097-82171a8a84c6","Type":"ContainerStarted","Data":"d16d726beab161acce7a34decaeed99cc3fe8c62794c0880956da185ab999572"}
Apr 24 21:17:08.105142 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:08.105122    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n7lt2" event={"ID":"b210b5ee-5bf3-436b-85a1-16efd64376cb","Type":"ContainerStarted","Data":"d6f7081823a5eaee6095b3661bfc4ebe4f6a710e7dbf738ea5c25e377a0f7d4c"}
Apr 24 21:17:08.106329 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:08.106310    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj" event={"ID":"4a8973dd-997f-4174-aa44-eab290111884","Type":"ContainerStarted","Data":"470ce886b04627d251d024acbb44e9393275e16073dd4f95e41a3d6f9999747c"}
Apr 24 21:17:08.107318 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:08.107300    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.ec2.internal" event={"ID":"aca2508fa5a89bde3f166bc71272b03f","Type":"ContainerStarted","Data":"2a9ec3e86128df4fe5c9aca6aa8bb16bbb51b7aa8a0fa2adcd6442522c5ef78c"}
Apr 24 21:17:08.132077 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:08.132039    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2g4mv" podStartSLOduration=2.426447542 podStartE2EDuration="20.132029072s" podCreationTimestamp="2026-04-24 21:16:48 +0000 UTC" firstStartedPulling="2026-04-24 21:16:49.164623186 +0000 UTC m=+1.784079789" lastFinishedPulling="2026-04-24 21:17:06.87020471 +0000 UTC m=+19.489661319" observedRunningTime="2026-04-24 21:17:08.131659157 +0000 UTC m=+20.751115785" watchObservedRunningTime="2026-04-24 21:17:08.132029072 +0000 UTC m=+20.751485697"
Apr 24 21:17:08.132342 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:08.132319    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-fmb76" podStartSLOduration=2.438523269 podStartE2EDuration="20.132313249s" podCreationTimestamp="2026-04-24 21:16:48 +0000 UTC" firstStartedPulling="2026-04-24 21:16:49.184682797 +0000 UTC m=+1.804139401" lastFinishedPulling="2026-04-24 21:17:06.878472772 +0000 UTC m=+19.497929381" observedRunningTime="2026-04-24 21:17:08.111816408 +0000 UTC m=+20.731273032" watchObservedRunningTime="2026-04-24 21:17:08.132313249 +0000 UTC m=+20.751769874"
Apr 24 21:17:08.154337 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:08.154297    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-f5cf5" podStartSLOduration=2.415938405 podStartE2EDuration="20.154286354s" podCreationTimestamp="2026-04-24 21:16:48 +0000 UTC" firstStartedPulling="2026-04-24 21:16:49.177530491 +0000 UTC m=+1.796987101" lastFinishedPulling="2026-04-24 21:17:06.915878447 +0000 UTC m=+19.535335050" observedRunningTime="2026-04-24 21:17:08.154081323 +0000 UTC m=+20.773537947" watchObservedRunningTime="2026-04-24 21:17:08.154286354 +0000 UTC m=+20.773742978"
Apr 24 21:17:08.174927 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:08.174883    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.ec2.internal" podStartSLOduration=20.174865737 podStartE2EDuration="20.174865737s" podCreationTimestamp="2026-04-24 21:16:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:17:08.172528745 +0000 UTC m=+20.791985369" watchObservedRunningTime="2026-04-24 21:17:08.174865737 +0000 UTC m=+20.794322365"
Apr 24 21:17:08.968903 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:08.968876    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Apr 24 21:17:09.110534 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:09.110459    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j9mkq" event={"ID":"58b19563-fa57-4e33-a2f1-dacbdbc79d7b","Type":"ContainerStarted","Data":"f0ef9c71a8d69d1a868ba3ed2c94f7b9b3724bb83542057adcf536a607865c66"}
Apr 24 21:17:09.111768 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:09.111745    2569 generic.go:358] "Generic (PLEG): container finished" podID="7839eda1-3d78-433b-97b0-9c26491cd037" containerID="09e6cd26afbd71150e2952968bfae0ec24021b4a7bb77ec0c2567ca1402fd81e" exitCode=0
Apr 24 21:17:09.111885 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:09.111800    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppnfd" event={"ID":"7839eda1-3d78-433b-97b0-9c26491cd037","Type":"ContainerDied","Data":"09e6cd26afbd71150e2952968bfae0ec24021b4a7bb77ec0c2567ca1402fd81e"}
Apr 24 21:17:09.113126 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:09.113100    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jf6mk" event={"ID":"a3616b72-2f2e-4eb6-9ba7-cccb369b747d","Type":"ContainerStarted","Data":"58a2e9e55d48682d3c7791c1f5e21e817ce131fcaff8724420caba0f20d6eff1"}
Apr 24 21:17:09.114832 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:09.114807    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj" event={"ID":"4a8973dd-997f-4174-aa44-eab290111884","Type":"ContainerStarted","Data":"e0241fc9f1576fdde26f30dd42e09fe498a03d3c463d462d7412042fb6a57483"}
Apr 24 21:17:09.115988 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:09.115965    2569 generic.go:358] "Generic (PLEG): container finished" podID="7ddc67bd8f4881e0e6709f55e2cff023" containerID="3b02263ca4ae1bc5264e8eb7aa0f0d5bd76148defd8a95c159e6df675c498261" exitCode=0
Apr 24 21:17:09.116149 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:09.116077    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal" event={"ID":"7ddc67bd8f4881e0e6709f55e2cff023","Type":"ContainerDied","Data":"3b02263ca4ae1bc5264e8eb7aa0f0d5bd76148defd8a95c159e6df675c498261"}
Apr 24 21:17:09.128246 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:09.128209    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-n7lt2" podStartSLOduration=3.405738575 podStartE2EDuration="21.128198413s" podCreationTimestamp="2026-04-24 21:16:48 +0000 UTC" firstStartedPulling="2026-04-24 21:16:49.159003569 +0000 UTC m=+1.778460172" lastFinishedPulling="2026-04-24 21:17:06.881463403 +0000 UTC m=+19.500920010" observedRunningTime="2026-04-24 21:17:08.19258682 +0000 UTC m=+20.812043456" watchObservedRunningTime="2026-04-24 21:17:09.128198413 +0000 UTC m=+21.747655101"
Apr 24 21:17:09.128658 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:09.128630    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-j9mkq" podStartSLOduration=3.450461929 podStartE2EDuration="21.128624163s" podCreationTimestamp="2026-04-24 21:16:48 +0000 UTC" firstStartedPulling="2026-04-24 21:16:49.192131578 +0000 UTC m=+1.811588181" lastFinishedPulling="2026-04-24 21:17:06.870293796 +0000 UTC m=+19.489750415" observedRunningTime="2026-04-24 21:17:09.128029736 +0000 UTC m=+21.747486361" watchObservedRunningTime="2026-04-24 21:17:09.128624163 +0000 UTC m=+21.748080788"
Apr 24 21:17:09.209938 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:09.209894    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jf6mk" podStartSLOduration=4.487116406 podStartE2EDuration="22.209876783s" podCreationTimestamp="2026-04-24 21:16:47 +0000 UTC" firstStartedPulling="2026-04-24 21:16:49.147451338 +0000 UTC m=+1.766907941" lastFinishedPulling="2026-04-24 21:17:06.870211702 +0000 UTC m=+19.489668318" observedRunningTime="2026-04-24 21:17:09.184396441 +0000 UTC m=+21.803853062" watchObservedRunningTime="2026-04-24 21:17:09.209876783 +0000 UTC m=+21.829333410"
Apr 24 21:17:09.893397 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:09.893300    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-04-24T21:17:08.968897948Z","UUID":"a01d6f5f-c164-4cd6-b4c1-7e0390139eab","Handler":null,"Name":"","Endpoint":""}
Apr 24 21:17:09.895092 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:09.895071    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Apr 24 21:17:09.895092 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:09.895101    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Apr 24 21:17:09.956235 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:09.956058    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:17:09.956452 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:09.956068    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:17:09.956452 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:09.956338    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4zl5" podUID="b2e03e73-fa77-4421-b99b-67c0205f5b37"
Apr 24 21:17:09.956452 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:09.956410    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76jvz" podUID="d3357c66-9444-4360-a1f9-e8317c53e78d"
Apr 24 21:17:10.122767 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:10.122735    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj" event={"ID":"4a8973dd-997f-4174-aa44-eab290111884","Type":"ContainerStarted","Data":"f31dd675a68e607ce5b428b8425acb39d01afa6b3e568c802ec15aaff93f7988"}
Apr 24 21:17:10.124436 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:10.124413    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal" event={"ID":"7ddc67bd8f4881e0e6709f55e2cff023","Type":"ContainerStarted","Data":"e88555b80a90cf83569ad3e5088037664775a1f8716a75c9746c60a63032db05"}
Apr 24 21:17:10.144044 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:10.144003    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fvjsj" podStartSLOduration=1.5071327650000002 podStartE2EDuration="22.143987354s" podCreationTimestamp="2026-04-24 21:16:48 +0000 UTC" firstStartedPulling="2026-04-24 21:16:49.153929352 +0000 UTC m=+1.773385956" lastFinishedPulling="2026-04-24 21:17:09.790783937 +0000 UTC m=+22.410240545" observedRunningTime="2026-04-24 21:17:10.143524078 +0000 UTC m=+22.762980716" watchObservedRunningTime="2026-04-24 21:17:10.143987354 +0000 UTC m=+22.763444015"
Apr 24 21:17:10.158739 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:10.158681    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.ec2.internal" podStartSLOduration=22.158661585 podStartE2EDuration="22.158661585s" podCreationTimestamp="2026-04-24 21:16:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:17:10.158218182 +0000 UTC m=+22.777674808" watchObservedRunningTime="2026-04-24 21:17:10.158661585 +0000 UTC m=+22.778118229"
Apr 24 21:17:11.129835 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:11.129798    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq" event={"ID":"4b964b87-b54e-473c-8ed3-fc3d270c934b","Type":"ContainerStarted","Data":"b5c9d789ea0183abea62992ae86fe87511fd7754852246f8fb37f30133ebb05e"}
Apr 24 21:17:11.955659 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:11.955623    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:17:11.955659 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:11.955656    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:17:11.955876 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:11.955745    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76jvz" podUID="d3357c66-9444-4360-a1f9-e8317c53e78d"
Apr 24 21:17:11.955932 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:11.955896    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4zl5" podUID="b2e03e73-fa77-4421-b99b-67c0205f5b37"
Apr 24 21:17:12.930374 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:12.930343    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jf6mk"
Apr 24 21:17:12.931036 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:12.931018    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jf6mk"
Apr 24 21:17:13.955985 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:13.955811    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:17:13.956430 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:13.955817    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:17:13.956430 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:13.956072    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4zl5" podUID="b2e03e73-fa77-4421-b99b-67c0205f5b37"
Apr 24 21:17:13.956430 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:13.956161    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76jvz" podUID="d3357c66-9444-4360-a1f9-e8317c53e78d"
Apr 24 21:17:14.138737 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:14.138699    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq" event={"ID":"4b964b87-b54e-473c-8ed3-fc3d270c934b","Type":"ContainerStarted","Data":"81a5a582a14edcd4eafe4413562e3186ead44161da23ff70261d870bc9c5ac55"}
Apr 24 21:17:14.139028 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:14.138989    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:17:14.139169 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:14.139026    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:17:14.140292 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:14.140270    2569 generic.go:358] "Generic (PLEG): container finished" podID="7839eda1-3d78-433b-97b0-9c26491cd037" containerID="e224726b9d13fa0839993c1398b08b1242cb491eb59fa1a17541ecbd788d3a6d" exitCode=0
Apr 24 21:17:14.140432 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:14.140298    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppnfd" event={"ID":"7839eda1-3d78-433b-97b0-9c26491cd037","Type":"ContainerDied","Data":"e224726b9d13fa0839993c1398b08b1242cb491eb59fa1a17541ecbd788d3a6d"}
Apr 24 21:17:14.154549 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:14.154530    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:17:14.166692 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:14.166652    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq" podStartSLOduration=7.906196584 podStartE2EDuration="26.166641255s" podCreationTimestamp="2026-04-24 21:16:48 +0000 UTC" firstStartedPulling="2026-04-24 21:16:49.196881325 +0000 UTC m=+1.816337936" lastFinishedPulling="2026-04-24 21:17:07.457325985 +0000 UTC m=+20.076782607" observedRunningTime="2026-04-24 21:17:14.166559007 +0000 UTC m=+26.786015632" watchObservedRunningTime="2026-04-24 21:17:14.166641255 +0000 UTC m=+26.786097881"
Apr 24 21:17:15.031540 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:15.031447    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jf6mk"
Apr 24 21:17:15.031961 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:15.031595    2569 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Apr 24 21:17:15.032076 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:15.032056    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jf6mk"
Apr 24 21:17:15.143734 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:15.143700    2569 generic.go:358] "Generic (PLEG): container finished" podID="7839eda1-3d78-433b-97b0-9c26491cd037" containerID="e692e6290afaedb03b50cb7b75d399aa3835645b75a2a501ff8644a082ca7dc1" exitCode=0
Apr 24 21:17:15.143890 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:15.143798    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppnfd" event={"ID":"7839eda1-3d78-433b-97b0-9c26491cd037","Type":"ContainerDied","Data":"e692e6290afaedb03b50cb7b75d399aa3835645b75a2a501ff8644a082ca7dc1"}
Apr 24 21:17:15.144692 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:15.144611    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:17:15.158791 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:15.158763    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:17:15.955749 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:15.955722    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:17:15.955893 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:15.955725    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:17:15.955893 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:15.955816    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76jvz" podUID="d3357c66-9444-4360-a1f9-e8317c53e78d"
Apr 24 21:17:15.956002 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:15.955933    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4zl5" podUID="b2e03e73-fa77-4421-b99b-67c0205f5b37"
Apr 24 21:17:16.147910 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:16.147885    2569 generic.go:358] "Generic (PLEG): container finished" podID="7839eda1-3d78-433b-97b0-9c26491cd037" containerID="de619d6362c10da4bab2975688d1bbb4b2db98d9e909e428ce24032c2a4c9c5e" exitCode=0
Apr 24 21:17:16.148277 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:16.147971    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppnfd" event={"ID":"7839eda1-3d78-433b-97b0-9c26491cd037","Type":"ContainerDied","Data":"de619d6362c10da4bab2975688d1bbb4b2db98d9e909e428ce24032c2a4c9c5e"}
Apr 24 21:17:17.956074 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:17.956036    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:17:17.956635 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:17.956215    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4zl5" podUID="b2e03e73-fa77-4421-b99b-67c0205f5b37"
Apr 24 21:17:17.958482 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:17.958458    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:17:17.958777 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:17.958745    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76jvz" podUID="d3357c66-9444-4360-a1f9-e8317c53e78d"
Apr 24 21:17:18.248917 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:18.248831    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v4zl5"]
Apr 24 21:17:18.249097 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:18.248949    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:17:18.249097 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:18.249078    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4zl5" podUID="b2e03e73-fa77-4421-b99b-67c0205f5b37"
Apr 24 21:17:18.253760 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:18.253523    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-76jvz"]
Apr 24 21:17:18.253760 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:18.253607    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:17:18.253760 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:18.253715    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76jvz" podUID="d3357c66-9444-4360-a1f9-e8317c53e78d"
Apr 24 21:17:19.701879 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:19.701845    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-9gh4c"]
Apr 24 21:17:19.724640 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:19.724617    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9gh4c"]
Apr 24 21:17:19.724785 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:19.724740    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gh4c"
Apr 24 21:17:19.724856 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:19.724807    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gh4c" podUID="fccfd4cf-bc0a-486b-8821-5a6a8737cd44"
Apr 24 21:17:19.869637 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:19.869599    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fccfd4cf-bc0a-486b-8821-5a6a8737cd44-original-pull-secret\") pod \"global-pull-secret-syncer-9gh4c\" (UID: \"fccfd4cf-bc0a-486b-8821-5a6a8737cd44\") " pod="kube-system/global-pull-secret-syncer-9gh4c"
Apr 24 21:17:19.869807 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:19.869646    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fccfd4cf-bc0a-486b-8821-5a6a8737cd44-kubelet-config\") pod \"global-pull-secret-syncer-9gh4c\" (UID: \"fccfd4cf-bc0a-486b-8821-5a6a8737cd44\") " pod="kube-system/global-pull-secret-syncer-9gh4c"
Apr 24 21:17:19.869807 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:19.869676    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fccfd4cf-bc0a-486b-8821-5a6a8737cd44-dbus\") pod \"global-pull-secret-syncer-9gh4c\" (UID: \"fccfd4cf-bc0a-486b-8821-5a6a8737cd44\") " pod="kube-system/global-pull-secret-syncer-9gh4c"
Apr 24 21:17:19.955526 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:19.955444    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:17:19.955526 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:19.955485    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:17:19.955727 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:19.955588    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4zl5" podUID="b2e03e73-fa77-4421-b99b-67c0205f5b37"
Apr 24 21:17:19.955781 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:19.955714    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76jvz" podUID="d3357c66-9444-4360-a1f9-e8317c53e78d"
Apr 24 21:17:19.970461 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:19.970437    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fccfd4cf-bc0a-486b-8821-5a6a8737cd44-original-pull-secret\") pod \"global-pull-secret-syncer-9gh4c\" (UID: \"fccfd4cf-bc0a-486b-8821-5a6a8737cd44\") " pod="kube-system/global-pull-secret-syncer-9gh4c"
Apr 24 21:17:19.970461 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:19.970466    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fccfd4cf-bc0a-486b-8821-5a6a8737cd44-kubelet-config\") pod \"global-pull-secret-syncer-9gh4c\" (UID: \"fccfd4cf-bc0a-486b-8821-5a6a8737cd44\") " pod="kube-system/global-pull-secret-syncer-9gh4c"
Apr 24 21:17:19.970672 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:19.970489    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fccfd4cf-bc0a-486b-8821-5a6a8737cd44-dbus\") pod \"global-pull-secret-syncer-9gh4c\" (UID: \"fccfd4cf-bc0a-486b-8821-5a6a8737cd44\") " pod="kube-system/global-pull-secret-syncer-9gh4c"
Apr 24 21:17:19.970672 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:19.970579    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fccfd4cf-bc0a-486b-8821-5a6a8737cd44-kubelet-config\") pod \"global-pull-secret-syncer-9gh4c\" (UID: \"fccfd4cf-bc0a-486b-8821-5a6a8737cd44\") " pod="kube-system/global-pull-secret-syncer-9gh4c"
Apr 24 21:17:19.970672 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:19.970616    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Apr 24 21:17:19.970808 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:19.970694    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fccfd4cf-bc0a-486b-8821-5a6a8737cd44-original-pull-secret podName:fccfd4cf-bc0a-486b-8821-5a6a8737cd44 nodeName:}" failed. No retries permitted until 2026-04-24 21:17:20.470674329 +0000 UTC m=+33.090130937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fccfd4cf-bc0a-486b-8821-5a6a8737cd44-original-pull-secret") pod "global-pull-secret-syncer-9gh4c" (UID: "fccfd4cf-bc0a-486b-8821-5a6a8737cd44") : object "kube-system"/"original-pull-secret" not registered
Apr 24 21:17:19.970808 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:19.970716    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fccfd4cf-bc0a-486b-8821-5a6a8737cd44-dbus\") pod \"global-pull-secret-syncer-9gh4c\" (UID: \"fccfd4cf-bc0a-486b-8821-5a6a8737cd44\") " pod="kube-system/global-pull-secret-syncer-9gh4c"
Apr 24 21:17:20.473646 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:20.473614    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fccfd4cf-bc0a-486b-8821-5a6a8737cd44-original-pull-secret\") pod \"global-pull-secret-syncer-9gh4c\" (UID: \"fccfd4cf-bc0a-486b-8821-5a6a8737cd44\") " pod="kube-system/global-pull-secret-syncer-9gh4c"
Apr 24 21:17:20.473860 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:20.473747    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Apr 24 21:17:20.473860 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:20.473817    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fccfd4cf-bc0a-486b-8821-5a6a8737cd44-original-pull-secret podName:fccfd4cf-bc0a-486b-8821-5a6a8737cd44 nodeName:}" failed. No retries permitted until 2026-04-24 21:17:21.473797894 +0000 UTC m=+34.093254516 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fccfd4cf-bc0a-486b-8821-5a6a8737cd44-original-pull-secret") pod "global-pull-secret-syncer-9gh4c" (UID: "fccfd4cf-bc0a-486b-8821-5a6a8737cd44") : object "kube-system"/"original-pull-secret" not registered
Apr 24 21:17:20.574836 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:20.574803    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs\") pod \"network-metrics-daemon-v4zl5\" (UID: \"b2e03e73-fa77-4421-b99b-67c0205f5b37\") " pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:17:20.575021 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:20.574923    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 24 21:17:20.575021 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:20.574980    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs podName:b2e03e73-fa77-4421-b99b-67c0205f5b37 nodeName:}" failed. No retries permitted until 2026-04-24 21:17:52.574966447 +0000 UTC m=+65.194423053 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs") pod "network-metrics-daemon-v4zl5" (UID: "b2e03e73-fa77-4421-b99b-67c0205f5b37") : object "openshift-multus"/"metrics-daemon-secret" not registered
Apr 24 21:17:20.776568 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:20.776538    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9f7wm\" (UniqueName: \"kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm\") pod \"network-check-target-76jvz\" (UID: \"d3357c66-9444-4360-a1f9-e8317c53e78d\") " pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:17:20.777009 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:20.776677    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Apr 24 21:17:20.777009 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:20.776692    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Apr 24 21:17:20.777009 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:20.776702    2569 projected.go:194] Error preparing data for projected volume kube-api-access-9f7wm for pod openshift-network-diagnostics/network-check-target-76jvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 24 21:17:20.777009 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:20.776751    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm podName:d3357c66-9444-4360-a1f9-e8317c53e78d nodeName:}" failed. No retries permitted until 2026-04-24 21:17:52.776738025 +0000 UTC m=+65.396194629 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9f7wm" (UniqueName: "kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm") pod "network-check-target-76jvz" (UID: "d3357c66-9444-4360-a1f9-e8317c53e78d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Apr 24 21:17:21.482852 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:21.482816    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fccfd4cf-bc0a-486b-8821-5a6a8737cd44-original-pull-secret\") pod \"global-pull-secret-syncer-9gh4c\" (UID: \"fccfd4cf-bc0a-486b-8821-5a6a8737cd44\") " pod="kube-system/global-pull-secret-syncer-9gh4c"
Apr 24 21:17:21.483100 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:21.482955    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Apr 24 21:17:21.483100 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:21.483027    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fccfd4cf-bc0a-486b-8821-5a6a8737cd44-original-pull-secret podName:fccfd4cf-bc0a-486b-8821-5a6a8737cd44 nodeName:}" failed. No retries permitted until 2026-04-24 21:17:23.483008278 +0000 UTC m=+36.102464899 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fccfd4cf-bc0a-486b-8821-5a6a8737cd44-original-pull-secret") pod "global-pull-secret-syncer-9gh4c" (UID: "fccfd4cf-bc0a-486b-8821-5a6a8737cd44") : object "kube-system"/"original-pull-secret" not registered
Apr 24 21:17:21.956040 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:21.956019    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gh4c"
Apr 24 21:17:21.956529 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:21.956019    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:17:21.956529 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:21.956135    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gh4c" podUID="fccfd4cf-bc0a-486b-8821-5a6a8737cd44"
Apr 24 21:17:21.956529 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:21.956234    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4zl5" podUID="b2e03e73-fa77-4421-b99b-67c0205f5b37"
Apr 24 21:17:21.956529 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:21.956019    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:17:21.956529 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:21.956341    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76jvz" podUID="d3357c66-9444-4360-a1f9-e8317c53e78d"
Apr 24 21:17:22.260206 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.260185    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-162.ec2.internal" event="NodeReady"
Apr 24 21:17:22.260319 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.260308    2569 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
Apr 24 21:17:22.305723 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.305700    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5595d687-bktl2"]
Apr 24 21:17:22.321215 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.321195    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xxlvr"]
Apr 24 21:17:22.321364 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.321343    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.325427 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.323770    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Apr 24 21:17:22.325427 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.323906    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fbr4t\""
Apr 24 21:17:22.325427 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.324063    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Apr 24 21:17:22.325427 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.324287    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Apr 24 21:17:22.331642 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.331618    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Apr 24 21:17:22.339154 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.339135    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5595d687-bktl2"]
Apr 24 21:17:22.339264 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.339162    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qbgk9"]
Apr 24 21:17:22.339317 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.339286    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xxlvr"
Apr 24 21:17:22.364402 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.356979    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xxlvr"]
Apr 24 21:17:22.364402 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.357122    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qbgk9"
Apr 24 21:17:22.366394 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.365011    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Apr 24 21:17:22.366394 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.365317    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Apr 24 21:17:22.366394 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.365413    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vh4z7\""
Apr 24 21:17:22.366394 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.365637    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bqlv4\""
Apr 24 21:17:22.366394 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.365872    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Apr 24 21:17:22.366394 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.366070    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Apr 24 21:17:22.366394 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.366277    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Apr 24 21:17:22.366760 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.366641    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Apr 24 21:17:22.366826 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.366810    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qbgk9"]
Apr 24 21:17:22.426445 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.426422    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7tfnv"]
Apr 24 21:17:22.456329 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.456310    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7tfnv"]
Apr 24 21:17:22.456462 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.456450    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7tfnv"
Apr 24 21:17:22.458958 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.458938    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rt6g8\""
Apr 24 21:17:22.459071 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.458961    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Apr 24 21:17:22.459347 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.459332    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Apr 24 21:17:22.459423 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.459332    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Apr 24 21:17:22.491785 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.491731    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/114be5a4-3fea-42af-a519-695fa4f7239d-data-volume\") pod \"insights-runtime-extractor-qbgk9\" (UID: \"114be5a4-3fea-42af-a519-695fa4f7239d\") " pod="openshift-insights/insights-runtime-extractor-qbgk9"
Apr 24 21:17:22.491785 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.491779    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/114be5a4-3fea-42af-a519-695fa4f7239d-crio-socket\") pod \"insights-runtime-extractor-qbgk9\" (UID: \"114be5a4-3fea-42af-a519-695fa4f7239d\") " pod="openshift-insights/insights-runtime-extractor-qbgk9"
Apr 24 21:17:22.491913 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.491809    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dd895c12-8a8d-4d68-9770-2a8d4c33a960-installation-pull-secrets\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.491913 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.491827    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dd895c12-8a8d-4d68-9770-2a8d4c33a960-image-registry-private-configuration\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.491913 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.491844    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dd895c12-8a8d-4d68-9770-2a8d4c33a960-ca-trust-extracted\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.491913 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.491860    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8mrp\" (UniqueName: \"kubernetes.io/projected/dd895c12-8a8d-4d68-9770-2a8d4c33a960-kube-api-access-q8mrp\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.491913 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.491877    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7db9a801-20a2-407a-9a59-4ac27c130673-config-volume\") pod \"dns-default-xxlvr\" (UID: \"7db9a801-20a2-407a-9a59-4ac27c130673\") " pod="openshift-dns/dns-default-xxlvr"
Apr 24 21:17:22.492081 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.491907    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7db9a801-20a2-407a-9a59-4ac27c130673-tmp-dir\") pod \"dns-default-xxlvr\" (UID: \"7db9a801-20a2-407a-9a59-4ac27c130673\") " pod="openshift-dns/dns-default-xxlvr"
Apr 24 21:17:22.492081 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.491986    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25tr4\" (UniqueName: \"kubernetes.io/projected/114be5a4-3fea-42af-a519-695fa4f7239d-kube-api-access-25tr4\") pod \"insights-runtime-extractor-qbgk9\" (UID: \"114be5a4-3fea-42af-a519-695fa4f7239d\") " pod="openshift-insights/insights-runtime-extractor-qbgk9"
Apr 24 21:17:22.492081 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.492005    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd895c12-8a8d-4d68-9770-2a8d4c33a960-bound-sa-token\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.492081 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.492020    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7db9a801-20a2-407a-9a59-4ac27c130673-metrics-tls\") pod \"dns-default-xxlvr\" (UID: \"7db9a801-20a2-407a-9a59-4ac27c130673\") " pod="openshift-dns/dns-default-xxlvr"
Apr 24 21:17:22.492081 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.492036    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5qtc\" (UniqueName: \"kubernetes.io/projected/7db9a801-20a2-407a-9a59-4ac27c130673-kube-api-access-t5qtc\") pod \"dns-default-xxlvr\" (UID: \"7db9a801-20a2-407a-9a59-4ac27c130673\") " pod="openshift-dns/dns-default-xxlvr"
Apr 24 21:17:22.492081 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.492060    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/114be5a4-3fea-42af-a519-695fa4f7239d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qbgk9\" (UID: \"114be5a4-3fea-42af-a519-695fa4f7239d\") " pod="openshift-insights/insights-runtime-extractor-qbgk9"
Apr 24 21:17:22.492081 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.492080    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd895c12-8a8d-4d68-9770-2a8d4c33a960-registry-tls\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.492319 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.492102    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd895c12-8a8d-4d68-9770-2a8d4c33a960-trusted-ca\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.492319 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.492144    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/114be5a4-3fea-42af-a519-695fa4f7239d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qbgk9\" (UID: \"114be5a4-3fea-42af-a519-695fa4f7239d\") " pod="openshift-insights/insights-runtime-extractor-qbgk9"
Apr 24 21:17:22.492319 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.492168    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dd895c12-8a8d-4d68-9770-2a8d4c33a960-registry-certificates\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.593164 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.593142    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/114be5a4-3fea-42af-a519-695fa4f7239d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qbgk9\" (UID: \"114be5a4-3fea-42af-a519-695fa4f7239d\") " pod="openshift-insights/insights-runtime-extractor-qbgk9"
Apr 24 21:17:22.593264 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.593171    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brbr8\" (UniqueName: \"kubernetes.io/projected/1028dec7-5f59-4430-92d0-574694e101b1-kube-api-access-brbr8\") pod \"ingress-canary-7tfnv\" (UID: \"1028dec7-5f59-4430-92d0-574694e101b1\") " pod="openshift-ingress-canary/ingress-canary-7tfnv"
Apr 24 21:17:22.593264 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.593190    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd895c12-8a8d-4d68-9770-2a8d4c33a960-registry-tls\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.593264 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.593205    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd895c12-8a8d-4d68-9770-2a8d4c33a960-trusted-ca\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.593264 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.593223    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/114be5a4-3fea-42af-a519-695fa4f7239d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qbgk9\" (UID: \"114be5a4-3fea-42af-a519-695fa4f7239d\") " pod="openshift-insights/insights-runtime-extractor-qbgk9"
Apr 24 21:17:22.593264 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.593238    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dd895c12-8a8d-4d68-9770-2a8d4c33a960-registry-certificates\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.593264 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.593255    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/114be5a4-3fea-42af-a519-695fa4f7239d-data-volume\") pod \"insights-runtime-extractor-qbgk9\" (UID: \"114be5a4-3fea-42af-a519-695fa4f7239d\") " pod="openshift-insights/insights-runtime-extractor-qbgk9"
Apr 24 21:17:22.593561 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.593300    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/114be5a4-3fea-42af-a519-695fa4f7239d-crio-socket\") pod \"insights-runtime-extractor-qbgk9\" (UID: \"114be5a4-3fea-42af-a519-695fa4f7239d\") " pod="openshift-insights/insights-runtime-extractor-qbgk9"
Apr 24 21:17:22.593561 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.593320    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dd895c12-8a8d-4d68-9770-2a8d4c33a960-installation-pull-secrets\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.593561 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.593337    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dd895c12-8a8d-4d68-9770-2a8d4c33a960-image-registry-private-configuration\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.593561 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.593357    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dd895c12-8a8d-4d68-9770-2a8d4c33a960-ca-trust-extracted\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.593561 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.593397    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q8mrp\" (UniqueName: \"kubernetes.io/projected/dd895c12-8a8d-4d68-9770-2a8d4c33a960-kube-api-access-q8mrp\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.593561 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.593422    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7db9a801-20a2-407a-9a59-4ac27c130673-config-volume\") pod \"dns-default-xxlvr\" (UID: \"7db9a801-20a2-407a-9a59-4ac27c130673\") " pod="openshift-dns/dns-default-xxlvr"
Apr 24 21:17:22.593561 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.593439    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7db9a801-20a2-407a-9a59-4ac27c130673-tmp-dir\") pod \"dns-default-xxlvr\" (UID: \"7db9a801-20a2-407a-9a59-4ac27c130673\") " pod="openshift-dns/dns-default-xxlvr"
Apr 24 21:17:22.593561 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.593461    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1028dec7-5f59-4430-92d0-574694e101b1-cert\") pod \"ingress-canary-7tfnv\" (UID: \"1028dec7-5f59-4430-92d0-574694e101b1\") " pod="openshift-ingress-canary/ingress-canary-7tfnv"
Apr 24 21:17:22.593561 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.593489    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-25tr4\" (UniqueName: \"kubernetes.io/projected/114be5a4-3fea-42af-a519-695fa4f7239d-kube-api-access-25tr4\") pod \"insights-runtime-extractor-qbgk9\" (UID: \"114be5a4-3fea-42af-a519-695fa4f7239d\") " pod="openshift-insights/insights-runtime-extractor-qbgk9"
Apr 24 21:17:22.593561 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.593507    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd895c12-8a8d-4d68-9770-2a8d4c33a960-bound-sa-token\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.593561 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.593525    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7db9a801-20a2-407a-9a59-4ac27c130673-metrics-tls\") pod \"dns-default-xxlvr\" (UID: \"7db9a801-20a2-407a-9a59-4ac27c130673\") " pod="openshift-dns/dns-default-xxlvr"
Apr 24 21:17:22.593561 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.593545    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t5qtc\" (UniqueName: \"kubernetes.io/projected/7db9a801-20a2-407a-9a59-4ac27c130673-kube-api-access-t5qtc\") pod \"dns-default-xxlvr\" (UID: \"7db9a801-20a2-407a-9a59-4ac27c130673\") " pod="openshift-dns/dns-default-xxlvr"
Apr 24 21:17:22.594177 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.593871    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/114be5a4-3fea-42af-a519-695fa4f7239d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qbgk9\" (UID: \"114be5a4-3fea-42af-a519-695fa4f7239d\") " pod="openshift-insights/insights-runtime-extractor-qbgk9"
Apr 24 21:17:22.594177 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.593968    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/114be5a4-3fea-42af-a519-695fa4f7239d-data-volume\") pod \"insights-runtime-extractor-qbgk9\" (UID: \"114be5a4-3fea-42af-a519-695fa4f7239d\") " pod="openshift-insights/insights-runtime-extractor-qbgk9"
Apr 24 21:17:22.594177 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.594126    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dd895c12-8a8d-4d68-9770-2a8d4c33a960-registry-certificates\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.594177 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.594158    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd895c12-8a8d-4d68-9770-2a8d4c33a960-trusted-ca\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.594361 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.594339    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7db9a801-20a2-407a-9a59-4ac27c130673-tmp-dir\") pod \"dns-default-xxlvr\" (UID: \"7db9a801-20a2-407a-9a59-4ac27c130673\") " pod="openshift-dns/dns-default-xxlvr"
Apr 24 21:17:22.594434 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.594392    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7db9a801-20a2-407a-9a59-4ac27c130673-config-volume\") pod \"dns-default-xxlvr\" (UID: \"7db9a801-20a2-407a-9a59-4ac27c130673\") " pod="openshift-dns/dns-default-xxlvr"
Apr 24 21:17:22.594567 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.594475    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/114be5a4-3fea-42af-a519-695fa4f7239d-crio-socket\") pod \"insights-runtime-extractor-qbgk9\" (UID: \"114be5a4-3fea-42af-a519-695fa4f7239d\") " pod="openshift-insights/insights-runtime-extractor-qbgk9"
Apr 24 21:17:22.594567 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.594493    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dd895c12-8a8d-4d68-9770-2a8d4c33a960-ca-trust-extracted\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.597521 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.597495    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7db9a801-20a2-407a-9a59-4ac27c130673-metrics-tls\") pod \"dns-default-xxlvr\" (UID: \"7db9a801-20a2-407a-9a59-4ac27c130673\") " pod="openshift-dns/dns-default-xxlvr"
Apr 24 21:17:22.597602 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.597520    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/114be5a4-3fea-42af-a519-695fa4f7239d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qbgk9\" (UID: \"114be5a4-3fea-42af-a519-695fa4f7239d\") " pod="openshift-insights/insights-runtime-extractor-qbgk9"
Apr 24 21:17:22.597602 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.597526    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dd895c12-8a8d-4d68-9770-2a8d4c33a960-image-registry-private-configuration\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.597602 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.597586    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd895c12-8a8d-4d68-9770-2a8d4c33a960-registry-tls\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.597700 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.597616    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dd895c12-8a8d-4d68-9770-2a8d4c33a960-installation-pull-secrets\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.601914 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.601891    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25tr4\" (UniqueName: \"kubernetes.io/projected/114be5a4-3fea-42af-a519-695fa4f7239d-kube-api-access-25tr4\") pod \"insights-runtime-extractor-qbgk9\" (UID: \"114be5a4-3fea-42af-a519-695fa4f7239d\") " pod="openshift-insights/insights-runtime-extractor-qbgk9"
Apr 24 21:17:22.602094 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.602076    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd895c12-8a8d-4d68-9770-2a8d4c33a960-bound-sa-token\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.602372 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.602354    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8mrp\" (UniqueName: \"kubernetes.io/projected/dd895c12-8a8d-4d68-9770-2a8d4c33a960-kube-api-access-q8mrp\") pod \"image-registry-5595d687-bktl2\" (UID: \"dd895c12-8a8d-4d68-9770-2a8d4c33a960\") " pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.612850 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.612827    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5qtc\" (UniqueName: \"kubernetes.io/projected/7db9a801-20a2-407a-9a59-4ac27c130673-kube-api-access-t5qtc\") pod \"dns-default-xxlvr\" (UID: \"7db9a801-20a2-407a-9a59-4ac27c130673\") " pod="openshift-dns/dns-default-xxlvr"
Apr 24 21:17:22.634816 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.634794    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:22.678736 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.678710    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xxlvr"
Apr 24 21:17:22.684369 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.684351    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qbgk9"
Apr 24 21:17:22.694145 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.694080    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-brbr8\" (UniqueName: \"kubernetes.io/projected/1028dec7-5f59-4430-92d0-574694e101b1-kube-api-access-brbr8\") pod \"ingress-canary-7tfnv\" (UID: \"1028dec7-5f59-4430-92d0-574694e101b1\") " pod="openshift-ingress-canary/ingress-canary-7tfnv"
Apr 24 21:17:22.694221 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.694138    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1028dec7-5f59-4430-92d0-574694e101b1-cert\") pod \"ingress-canary-7tfnv\" (UID: \"1028dec7-5f59-4430-92d0-574694e101b1\") " pod="openshift-ingress-canary/ingress-canary-7tfnv"
Apr 24 21:17:22.696340 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.696320    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1028dec7-5f59-4430-92d0-574694e101b1-cert\") pod \"ingress-canary-7tfnv\" (UID: \"1028dec7-5f59-4430-92d0-574694e101b1\") " pod="openshift-ingress-canary/ingress-canary-7tfnv"
Apr 24 21:17:22.702536 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.702512    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brbr8\" (UniqueName: \"kubernetes.io/projected/1028dec7-5f59-4430-92d0-574694e101b1-kube-api-access-brbr8\") pod \"ingress-canary-7tfnv\" (UID: \"1028dec7-5f59-4430-92d0-574694e101b1\") " pod="openshift-ingress-canary/ingress-canary-7tfnv"
Apr 24 21:17:22.809474 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.809445    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7tfnv"
Apr 24 21:17:22.813633 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.813600    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xxlvr"]
Apr 24 21:17:22.819541 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.819508    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qbgk9"]
Apr 24 21:17:22.819631 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.819554    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5595d687-bktl2"]
Apr 24 21:17:22.825062 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:17:22.825036    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod114be5a4_3fea_42af_a519_695fa4f7239d.slice/crio-26b45515e9183ba84f13bbad4ea8239e023886b8e0322fc5015c73c47ace76ac WatchSource:0}: Error finding container 26b45515e9183ba84f13bbad4ea8239e023886b8e0322fc5015c73c47ace76ac: Status 404 returned error can't find the container with id 26b45515e9183ba84f13bbad4ea8239e023886b8e0322fc5015c73c47ace76ac
Apr 24 21:17:22.826013 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:17:22.825987    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd895c12_8a8d_4d68_9770_2a8d4c33a960.slice/crio-2c164a59bde4e78b707d09b87e3f4859fe83cd75ce4e778446be59fb877e26a2 WatchSource:0}: Error finding container 2c164a59bde4e78b707d09b87e3f4859fe83cd75ce4e778446be59fb877e26a2: Status 404 returned error can't find the container with id 2c164a59bde4e78b707d09b87e3f4859fe83cd75ce4e778446be59fb877e26a2
Apr 24 21:17:22.934822 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:22.934782    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7tfnv"]
Apr 24 21:17:22.938338 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:17:22.938312    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1028dec7_5f59_4430_92d0_574694e101b1.slice/crio-d8c70fbd0be26e184601f396ddd3c3d18c1b4317e965b7d692c52680cf326cbe WatchSource:0}: Error finding container d8c70fbd0be26e184601f396ddd3c3d18c1b4317e965b7d692c52680cf326cbe: Status 404 returned error can't find the container with id d8c70fbd0be26e184601f396ddd3c3d18c1b4317e965b7d692c52680cf326cbe
Apr 24 21:17:23.163063 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:23.163028    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xxlvr" event={"ID":"7db9a801-20a2-407a-9a59-4ac27c130673","Type":"ContainerStarted","Data":"8e8de0698b6310c98c89a2441f35e3bfa2421b2de64bf1bf3bd0286c495a7f63"}
Apr 24 21:17:23.165795 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:23.165763    2569 generic.go:358] "Generic (PLEG): container finished" podID="7839eda1-3d78-433b-97b0-9c26491cd037" containerID="86837f7ace218f921f7c6ffbc0f9a688b5404507f753ae5f73491398e9469b6d" exitCode=0
Apr 24 21:17:23.165924 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:23.165811    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppnfd" event={"ID":"7839eda1-3d78-433b-97b0-9c26491cd037","Type":"ContainerDied","Data":"86837f7ace218f921f7c6ffbc0f9a688b5404507f753ae5f73491398e9469b6d"}
Apr 24 21:17:23.167666 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:23.167646    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5595d687-bktl2" event={"ID":"dd895c12-8a8d-4d68-9770-2a8d4c33a960","Type":"ContainerStarted","Data":"bcc42f05150c8ff92ee7dd8d7fcb151045bed5c3fbd89d01552aff3bbcd9fca5"}
Apr 24 21:17:23.167772 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:23.167676    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:23.167772 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:23.167689    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5595d687-bktl2" event={"ID":"dd895c12-8a8d-4d68-9770-2a8d4c33a960","Type":"ContainerStarted","Data":"2c164a59bde4e78b707d09b87e3f4859fe83cd75ce4e778446be59fb877e26a2"}
Apr 24 21:17:23.169535 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:23.169252    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7tfnv" event={"ID":"1028dec7-5f59-4430-92d0-574694e101b1","Type":"ContainerStarted","Data":"d8c70fbd0be26e184601f396ddd3c3d18c1b4317e965b7d692c52680cf326cbe"}
Apr 24 21:17:23.170715 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:23.170685    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qbgk9" event={"ID":"114be5a4-3fea-42af-a519-695fa4f7239d","Type":"ContainerStarted","Data":"01d5d4cd0e3435098ac6eff58e72ad65ec65d2d8b721a823bee089e7c1b4759e"}
Apr 24 21:17:23.170715 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:23.170707    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qbgk9" event={"ID":"114be5a4-3fea-42af-a519-695fa4f7239d","Type":"ContainerStarted","Data":"26b45515e9183ba84f13bbad4ea8239e023886b8e0322fc5015c73c47ace76ac"}
Apr 24 21:17:23.204887 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:23.204836    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5595d687-bktl2" podStartSLOduration=7.204819955 podStartE2EDuration="7.204819955s" podCreationTimestamp="2026-04-24 21:17:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:17:23.204088549 +0000 UTC m=+35.823545175" watchObservedRunningTime="2026-04-24 21:17:23.204819955 +0000 UTC m=+35.824276581"
Apr 24 21:17:23.501823 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:23.501578    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fccfd4cf-bc0a-486b-8821-5a6a8737cd44-original-pull-secret\") pod \"global-pull-secret-syncer-9gh4c\" (UID: \"fccfd4cf-bc0a-486b-8821-5a6a8737cd44\") " pod="kube-system/global-pull-secret-syncer-9gh4c"
Apr 24 21:17:23.501823 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:23.501715    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Apr 24 21:17:23.502029 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:23.501872    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fccfd4cf-bc0a-486b-8821-5a6a8737cd44-original-pull-secret podName:fccfd4cf-bc0a-486b-8821-5a6a8737cd44 nodeName:}" failed. No retries permitted until 2026-04-24 21:17:27.50185713 +0000 UTC m=+40.121313754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fccfd4cf-bc0a-486b-8821-5a6a8737cd44-original-pull-secret") pod "global-pull-secret-syncer-9gh4c" (UID: "fccfd4cf-bc0a-486b-8821-5a6a8737cd44") : object "kube-system"/"original-pull-secret" not registered
Apr 24 21:17:23.956073 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:23.956040    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:17:23.956256 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:23.956041    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gh4c"
Apr 24 21:17:23.956417 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:23.956368    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:17:23.959858 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:23.959623    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Apr 24 21:17:23.959858 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:23.959833    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Apr 24 21:17:23.959858 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:23.959848    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8v42p\""
Apr 24 21:17:23.961242 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:23.959898    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Apr 24 21:17:23.961242 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:23.959932    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dd9qw\""
Apr 24 21:17:23.961242 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:23.960129    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Apr 24 21:17:24.176070 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:24.176034    2569 generic.go:358] "Generic (PLEG): container finished" podID="7839eda1-3d78-433b-97b0-9c26491cd037" containerID="15c1d0c3e5584771b39276f2c6eda4a2868082e674dfa59069732a209cd87cf7" exitCode=0
Apr 24 21:17:24.176693 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:24.176133    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppnfd" event={"ID":"7839eda1-3d78-433b-97b0-9c26491cd037","Type":"ContainerDied","Data":"15c1d0c3e5584771b39276f2c6eda4a2868082e674dfa59069732a209cd87cf7"}
Apr 24 21:17:26.183476 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:26.183231    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xxlvr" event={"ID":"7db9a801-20a2-407a-9a59-4ac27c130673","Type":"ContainerStarted","Data":"dddc725bc028e5b15919076dccb5514f19e56a1af203af15816a8e89d8015d17"}
Apr 24 21:17:26.184192 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:26.183486    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xxlvr" event={"ID":"7db9a801-20a2-407a-9a59-4ac27c130673","Type":"ContainerStarted","Data":"e7dd7e7d4ef03da453e49e9cd0dc9542909f0ba5e8e4017ba21bb3e49b751502"}
Apr 24 21:17:26.184192 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:26.183509    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xxlvr"
Apr 24 21:17:26.186435 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:26.186406    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppnfd" event={"ID":"7839eda1-3d78-433b-97b0-9c26491cd037","Type":"ContainerStarted","Data":"0d82c4ae872e23e925f422073e17a93a6fc6eadc3e870586af81d1175fbdfbea"}
Apr 24 21:17:26.187890 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:26.187868    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7tfnv" event={"ID":"1028dec7-5f59-4430-92d0-574694e101b1","Type":"ContainerStarted","Data":"9ec5ce84e0dc2b5a8777b0fe5f882cd8700b59b2f3882f9228e66443beb53cc0"}
Apr 24 21:17:26.189438 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:26.189416    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qbgk9" event={"ID":"114be5a4-3fea-42af-a519-695fa4f7239d","Type":"ContainerStarted","Data":"3737aa05d4d87c8495b0d6c74b5b14ac885489f1f6140d851efb62ebbd0c80d9"}
Apr 24 21:17:26.203959 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:26.203916    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-xxlvr" podStartSLOduration=1.767097041 podStartE2EDuration="4.203903554s" podCreationTimestamp="2026-04-24 21:17:22 +0000 UTC" firstStartedPulling="2026-04-24 21:17:22.822790009 +0000 UTC m=+35.442246625" lastFinishedPulling="2026-04-24 21:17:25.259596534 +0000 UTC m=+37.879053138" observedRunningTime="2026-04-24 21:17:26.202521836 +0000 UTC m=+38.821978461" watchObservedRunningTime="2026-04-24 21:17:26.203903554 +0000 UTC m=+38.823360208"
Apr 24 21:17:26.218769 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:26.218732    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7tfnv" podStartSLOduration=1.895802245 podStartE2EDuration="4.218721491s" podCreationTimestamp="2026-04-24 21:17:22 +0000 UTC" firstStartedPulling="2026-04-24 21:17:22.940188588 +0000 UTC m=+35.559645191" lastFinishedPulling="2026-04-24 21:17:25.263107832 +0000 UTC m=+37.882564437" observedRunningTime="2026-04-24 21:17:26.217222882 +0000 UTC m=+38.836679517" watchObservedRunningTime="2026-04-24 21:17:26.218721491 +0000 UTC m=+38.838178116"
Apr 24 21:17:26.244808 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:26.243885    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ppnfd" podStartSLOduration=5.277949065 podStartE2EDuration="38.243869796s" podCreationTimestamp="2026-04-24 21:16:48 +0000 UTC" firstStartedPulling="2026-04-24 21:16:49.170308524 +0000 UTC m=+1.789765128" lastFinishedPulling="2026-04-24 21:17:22.13622924 +0000 UTC m=+34.755685859" observedRunningTime="2026-04-24 21:17:26.242120387 +0000 UTC m=+38.861577013" watchObservedRunningTime="2026-04-24 21:17:26.243869796 +0000 UTC m=+38.863326424"
Apr 24 21:17:27.266218 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.266187    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b6d476f45-d7jzl"]
Apr 24 21:17:27.288774 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.288750    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b6d476f45-d7jzl"]
Apr 24 21:17:27.288957 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.288853    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:27.293898 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.293870    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Apr 24 21:17:27.294010 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.293997    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Apr 24 21:17:27.294599 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.294580    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-stf74\""
Apr 24 21:17:27.294712 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.294666    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Apr 24 21:17:27.294712 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.294676    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Apr 24 21:17:27.294712 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.294688    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Apr 24 21:17:27.294878 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.294728    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Apr 24 21:17:27.296002 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.295985    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Apr 24 21:17:27.301537 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.301517    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Apr 24 21:17:27.347626 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.347595    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-69db897b98-x7rd5"]
Apr 24 21:17:27.375760 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.375735    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-qpm5s"]
Apr 24 21:17:27.375908 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.375886    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5"
Apr 24 21:17:27.379097 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.379076    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Apr 24 21:17:27.379240 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.379217    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-2578n\""
Apr 24 21:17:27.379240 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.379233    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Apr 24 21:17:27.379329 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.379216    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Apr 24 21:17:27.379848 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.379833    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Apr 24 21:17:27.379906 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.379840    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Apr 24 21:17:27.379960 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.379886    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Apr 24 21:17:27.397868 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.397849    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-qpm5s"]
Apr 24 21:17:27.397868 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.397871    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-69db897b98-x7rd5"]
Apr 24 21:17:27.397997 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.397974    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qpm5s"
Apr 24 21:17:27.400240 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.400223    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Apr 24 21:17:27.400355 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.400248    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Apr 24 21:17:27.400355 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.400248    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-78b4t\""
Apr 24 21:17:27.431554 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.431529    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-console-config\") pod \"console-7b6d476f45-d7jzl\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") " pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:27.431703 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.431684    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-trusted-ca-bundle\") pod \"console-7b6d476f45-d7jzl\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") " pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:27.431773 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.431738    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0803663-ccce-442d-8b7d-c15efe642b15-console-oauth-config\") pod \"console-7b6d476f45-d7jzl\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") " pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:27.431830 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.431781    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-service-ca\") pod \"console-7b6d476f45-d7jzl\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") " pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:27.431830 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.431822    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-oauth-serving-cert\") pod \"console-7b6d476f45-d7jzl\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") " pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:27.431936 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.431858    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0803663-ccce-442d-8b7d-c15efe642b15-console-serving-cert\") pod \"console-7b6d476f45-d7jzl\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") " pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:27.431983 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.431939    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-przl9\" (UniqueName: \"kubernetes.io/projected/b0803663-ccce-442d-8b7d-c15efe642b15-kube-api-access-przl9\") pod \"console-7b6d476f45-d7jzl\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") " pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:27.477700 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.477670    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dpzm9"]
Apr 24 21:17:27.499815 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.499792    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.502208 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.502190    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Apr 24 21:17:27.502308 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.502190    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Apr 24 21:17:27.502725 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.502712    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Apr 24 21:17:27.502897 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.502886    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2svx2\""
Apr 24 21:17:27.533077 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.533053    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/af9903e0-3459-4bde-b42b-715b24c9a4fa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-qpm5s\" (UID: \"af9903e0-3459-4bde-b42b-715b24c9a4fa\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qpm5s"
Apr 24 21:17:27.533175 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.533087    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-console-config\") pod \"console-7b6d476f45-d7jzl\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") " pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:27.533175 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.533113    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/30fe1833-7b51-45f1-80fd-e27b25a5e82a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-69db897b98-x7rd5\" (UID: \"30fe1833-7b51-45f1-80fd-e27b25a5e82a\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5"
Apr 24 21:17:27.533175 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.533141    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0803663-ccce-442d-8b7d-c15efe642b15-console-oauth-config\") pod \"console-7b6d476f45-d7jzl\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") " pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:27.533355 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.533173    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfcfr\" (UniqueName: \"kubernetes.io/projected/30fe1833-7b51-45f1-80fd-e27b25a5e82a-kube-api-access-hfcfr\") pod \"kube-state-metrics-69db897b98-x7rd5\" (UID: \"30fe1833-7b51-45f1-80fd-e27b25a5e82a\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5"
Apr 24 21:17:27.533355 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.533211    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0803663-ccce-442d-8b7d-c15efe642b15-console-serving-cert\") pod \"console-7b6d476f45-d7jzl\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") " pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:27.533355 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.533231    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/30fe1833-7b51-45f1-80fd-e27b25a5e82a-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-x7rd5\" (UID: \"30fe1833-7b51-45f1-80fd-e27b25a5e82a\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5"
Apr 24 21:17:27.533355 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.533268    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30fe1833-7b51-45f1-80fd-e27b25a5e82a-metrics-client-ca\") pod \"kube-state-metrics-69db897b98-x7rd5\" (UID: \"30fe1833-7b51-45f1-80fd-e27b25a5e82a\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5"
Apr 24 21:17:27.533355 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.533302    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af9903e0-3459-4bde-b42b-715b24c9a4fa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-qpm5s\" (UID: \"af9903e0-3459-4bde-b42b-715b24c9a4fa\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qpm5s"
Apr 24 21:17:27.533628 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.533438    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af9903e0-3459-4bde-b42b-715b24c9a4fa-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-qpm5s\" (UID: \"af9903e0-3459-4bde-b42b-715b24c9a4fa\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qpm5s"
Apr 24 21:17:27.533628 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.533477    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-service-ca\") pod \"console-7b6d476f45-d7jzl\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") " pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:27.533628 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.533526    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-oauth-serving-cert\") pod \"console-7b6d476f45-d7jzl\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") " pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:27.533628 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.533561    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30fe1833-7b51-45f1-80fd-e27b25a5e82a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-69db897b98-x7rd5\" (UID: \"30fe1833-7b51-45f1-80fd-e27b25a5e82a\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5"
Apr 24 21:17:27.533628 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.533608    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fccfd4cf-bc0a-486b-8821-5a6a8737cd44-original-pull-secret\") pod \"global-pull-secret-syncer-9gh4c\" (UID: \"fccfd4cf-bc0a-486b-8821-5a6a8737cd44\") " pod="kube-system/global-pull-secret-syncer-9gh4c"
Apr 24 21:17:27.533849 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.533643    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trrrk\" (UniqueName: \"kubernetes.io/projected/af9903e0-3459-4bde-b42b-715b24c9a4fa-kube-api-access-trrrk\") pod \"openshift-state-metrics-9d44df66c-qpm5s\" (UID: \"af9903e0-3459-4bde-b42b-715b24c9a4fa\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qpm5s"
Apr 24 21:17:27.533849 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.533675    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-przl9\" (UniqueName: \"kubernetes.io/projected/b0803663-ccce-442d-8b7d-c15efe642b15-kube-api-access-przl9\") pod \"console-7b6d476f45-d7jzl\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") " pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:27.533849 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.533709    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-console-config\") pod \"console-7b6d476f45-d7jzl\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") " pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:27.533849 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.533733    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/30fe1833-7b51-45f1-80fd-e27b25a5e82a-volume-directive-shadow\") pod \"kube-state-metrics-69db897b98-x7rd5\" (UID: \"30fe1833-7b51-45f1-80fd-e27b25a5e82a\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5"
Apr 24 21:17:27.533849 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.533760    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-trusted-ca-bundle\") pod \"console-7b6d476f45-d7jzl\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") " pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:27.534787 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.534719    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-trusted-ca-bundle\") pod \"console-7b6d476f45-d7jzl\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") " pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:27.537637 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.537618    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0803663-ccce-442d-8b7d-c15efe642b15-console-oauth-config\") pod \"console-7b6d476f45-d7jzl\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") " pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:27.537725 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.537646    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fccfd4cf-bc0a-486b-8821-5a6a8737cd44-original-pull-secret\") pod \"global-pull-secret-syncer-9gh4c\" (UID: \"fccfd4cf-bc0a-486b-8821-5a6a8737cd44\") " pod="kube-system/global-pull-secret-syncer-9gh4c"
Apr 24 21:17:27.537788 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.537770    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0803663-ccce-442d-8b7d-c15efe642b15-console-serving-cert\") pod \"console-7b6d476f45-d7jzl\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") " pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:27.542053 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.542030    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-service-ca\") pod \"console-7b6d476f45-d7jzl\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") " pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:27.544501 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.544486    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-oauth-serving-cert\") pod \"console-7b6d476f45-d7jzl\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") " pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:27.546286 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.546269    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-przl9\" (UniqueName: \"kubernetes.io/projected/b0803663-ccce-442d-8b7d-c15efe642b15-kube-api-access-przl9\") pod \"console-7b6d476f45-d7jzl\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") " pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:27.579244 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.579226    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gh4c"
Apr 24 21:17:27.598114 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.598090    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:27.634940 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.634872    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af9903e0-3459-4bde-b42b-715b24c9a4fa-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-qpm5s\" (UID: \"af9903e0-3459-4bde-b42b-715b24c9a4fa\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qpm5s"
Apr 24 21:17:27.634940 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.634935    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe14e9fb-5dfc-4c4d-83de-cb303b918323-root\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.635084 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.634974    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30fe1833-7b51-45f1-80fd-e27b25a5e82a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-69db897b98-x7rd5\" (UID: \"30fe1833-7b51-45f1-80fd-e27b25a5e82a\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5"
Apr 24 21:17:27.635084 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.635006    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe14e9fb-5dfc-4c4d-83de-cb303b918323-node-exporter-accelerators-collector-config\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.635084 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.635067    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-trrrk\" (UniqueName: \"kubernetes.io/projected/af9903e0-3459-4bde-b42b-715b24c9a4fa-kube-api-access-trrrk\") pod \"openshift-state-metrics-9d44df66c-qpm5s\" (UID: \"af9903e0-3459-4bde-b42b-715b24c9a4fa\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qpm5s"
Apr 24 21:17:27.635197 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.635099    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe14e9fb-5dfc-4c4d-83de-cb303b918323-node-exporter-textfile\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.635628 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.635602    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/30fe1833-7b51-45f1-80fd-e27b25a5e82a-volume-directive-shadow\") pod \"kube-state-metrics-69db897b98-x7rd5\" (UID: \"30fe1833-7b51-45f1-80fd-e27b25a5e82a\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5"
Apr 24 21:17:27.635719 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.635657    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe14e9fb-5dfc-4c4d-83de-cb303b918323-node-exporter-wtmp\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.635719 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.635689    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe14e9fb-5dfc-4c4d-83de-cb303b918323-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.635828 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.635728    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/af9903e0-3459-4bde-b42b-715b24c9a4fa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-qpm5s\" (UID: \"af9903e0-3459-4bde-b42b-715b24c9a4fa\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qpm5s"
Apr 24 21:17:27.635828 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.635762    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/30fe1833-7b51-45f1-80fd-e27b25a5e82a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-69db897b98-x7rd5\" (UID: \"30fe1833-7b51-45f1-80fd-e27b25a5e82a\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5"
Apr 24 21:17:27.635828 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.635790    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe14e9fb-5dfc-4c4d-83de-cb303b918323-sys\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.635828 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.635815    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe14e9fb-5dfc-4c4d-83de-cb303b918323-node-exporter-tls\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.636031 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.635854    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfcfr\" (UniqueName: \"kubernetes.io/projected/30fe1833-7b51-45f1-80fd-e27b25a5e82a-kube-api-access-hfcfr\") pod \"kube-state-metrics-69db897b98-x7rd5\" (UID: \"30fe1833-7b51-45f1-80fd-e27b25a5e82a\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5"
Apr 24 21:17:27.636031 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.635892    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/30fe1833-7b51-45f1-80fd-e27b25a5e82a-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-x7rd5\" (UID: \"30fe1833-7b51-45f1-80fd-e27b25a5e82a\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5"
Apr 24 21:17:27.636031 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.635920    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe14e9fb-5dfc-4c4d-83de-cb303b918323-metrics-client-ca\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.636031 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.635958    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f92hq\" (UniqueName: \"kubernetes.io/projected/fe14e9fb-5dfc-4c4d-83de-cb303b918323-kube-api-access-f92hq\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.636031 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.635997    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30fe1833-7b51-45f1-80fd-e27b25a5e82a-metrics-client-ca\") pod \"kube-state-metrics-69db897b98-x7rd5\" (UID: \"30fe1833-7b51-45f1-80fd-e27b25a5e82a\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5"
Apr 24 21:17:27.636281 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.636037    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af9903e0-3459-4bde-b42b-715b24c9a4fa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-qpm5s\" (UID: \"af9903e0-3459-4bde-b42b-715b24c9a4fa\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qpm5s"
Apr 24 21:17:27.636281 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.636233    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af9903e0-3459-4bde-b42b-715b24c9a4fa-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-qpm5s\" (UID: \"af9903e0-3459-4bde-b42b-715b24c9a4fa\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qpm5s"
Apr 24 21:17:27.636611 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.636583    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/30fe1833-7b51-45f1-80fd-e27b25a5e82a-volume-directive-shadow\") pod \"kube-state-metrics-69db897b98-x7rd5\" (UID: \"30fe1833-7b51-45f1-80fd-e27b25a5e82a\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5"
Apr 24 21:17:27.637250 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.637223    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/30fe1833-7b51-45f1-80fd-e27b25a5e82a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-69db897b98-x7rd5\" (UID: \"30fe1833-7b51-45f1-80fd-e27b25a5e82a\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5"
Apr 24 21:17:27.637773 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.637750    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30fe1833-7b51-45f1-80fd-e27b25a5e82a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-69db897b98-x7rd5\" (UID: \"30fe1833-7b51-45f1-80fd-e27b25a5e82a\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5"
Apr 24 21:17:27.638516 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.638495    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af9903e0-3459-4bde-b42b-715b24c9a4fa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-qpm5s\" (UID: \"af9903e0-3459-4bde-b42b-715b24c9a4fa\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qpm5s"
Apr 24 21:17:27.640941 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.640897    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30fe1833-7b51-45f1-80fd-e27b25a5e82a-metrics-client-ca\") pod \"kube-state-metrics-69db897b98-x7rd5\" (UID: \"30fe1833-7b51-45f1-80fd-e27b25a5e82a\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5"
Apr 24 21:17:27.641272 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.641074    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/af9903e0-3459-4bde-b42b-715b24c9a4fa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-qpm5s\" (UID: \"af9903e0-3459-4bde-b42b-715b24c9a4fa\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qpm5s"
Apr 24 21:17:27.642170 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.642145    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/30fe1833-7b51-45f1-80fd-e27b25a5e82a-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-x7rd5\" (UID: \"30fe1833-7b51-45f1-80fd-e27b25a5e82a\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5"
Apr 24 21:17:27.644614 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.644564    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trrrk\" (UniqueName: \"kubernetes.io/projected/af9903e0-3459-4bde-b42b-715b24c9a4fa-kube-api-access-trrrk\") pod \"openshift-state-metrics-9d44df66c-qpm5s\" (UID: \"af9903e0-3459-4bde-b42b-715b24c9a4fa\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qpm5s"
Apr 24 21:17:27.645713 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.645667    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfcfr\" (UniqueName: \"kubernetes.io/projected/30fe1833-7b51-45f1-80fd-e27b25a5e82a-kube-api-access-hfcfr\") pod \"kube-state-metrics-69db897b98-x7rd5\" (UID: \"30fe1833-7b51-45f1-80fd-e27b25a5e82a\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5"
Apr 24 21:17:27.684176 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.684127    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5"
Apr 24 21:17:27.706255 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.706226    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qpm5s"
Apr 24 21:17:27.724202 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.724169    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9gh4c"]
Apr 24 21:17:27.727896 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:17:27.727863    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfccfd4cf_bc0a_486b_8821_5a6a8737cd44.slice/crio-10d768b13bc7b310e5ead97fe82eb69b18c25b8c7860788ca49c559a57576807 WatchSource:0}: Error finding container 10d768b13bc7b310e5ead97fe82eb69b18c25b8c7860788ca49c559a57576807: Status 404 returned error can't find the container with id 10d768b13bc7b310e5ead97fe82eb69b18c25b8c7860788ca49c559a57576807
Apr 24 21:17:27.738402 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.737772    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b6d476f45-d7jzl"]
Apr 24 21:17:27.738402 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.738121    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe14e9fb-5dfc-4c4d-83de-cb303b918323-node-exporter-textfile\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.738402 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.738158    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe14e9fb-5dfc-4c4d-83de-cb303b918323-node-exporter-wtmp\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.738402 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.738190    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe14e9fb-5dfc-4c4d-83de-cb303b918323-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.738402 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.738227    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe14e9fb-5dfc-4c4d-83de-cb303b918323-sys\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.738402 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.738255    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe14e9fb-5dfc-4c4d-83de-cb303b918323-node-exporter-tls\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.738402 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.738295    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe14e9fb-5dfc-4c4d-83de-cb303b918323-metrics-client-ca\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.738402 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.738325    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f92hq\" (UniqueName: \"kubernetes.io/projected/fe14e9fb-5dfc-4c4d-83de-cb303b918323-kube-api-access-f92hq\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.738850 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.738698    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe14e9fb-5dfc-4c4d-83de-cb303b918323-root\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.738850 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.738747    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe14e9fb-5dfc-4c4d-83de-cb303b918323-node-exporter-accelerators-collector-config\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.738956 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:27.738938    2569 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Apr 24 21:17:27.739010 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:27.739002    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe14e9fb-5dfc-4c4d-83de-cb303b918323-node-exporter-tls podName:fe14e9fb-5dfc-4c4d-83de-cb303b918323 nodeName:}" failed. No retries permitted until 2026-04-24 21:17:28.238982217 +0000 UTC m=+40.858438821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fe14e9fb-5dfc-4c4d-83de-cb303b918323-node-exporter-tls") pod "node-exporter-dpzm9" (UID: "fe14e9fb-5dfc-4c4d-83de-cb303b918323") : secret "node-exporter-tls" not found
Apr 24 21:17:27.739234 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.739201    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe14e9fb-5dfc-4c4d-83de-cb303b918323-node-exporter-textfile\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.739319 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.739297    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe14e9fb-5dfc-4c4d-83de-cb303b918323-sys\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.739473 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.739450    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe14e9fb-5dfc-4c4d-83de-cb303b918323-node-exporter-wtmp\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.739546 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.739469    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe14e9fb-5dfc-4c4d-83de-cb303b918323-node-exporter-accelerators-collector-config\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.739546 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.739506    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe14e9fb-5dfc-4c4d-83de-cb303b918323-root\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.739799 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.739778    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe14e9fb-5dfc-4c4d-83de-cb303b918323-metrics-client-ca\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.741621 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.741575    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe14e9fb-5dfc-4c4d-83de-cb303b918323-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.745414 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:17:27.745365    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0803663_ccce_442d_8b7d_c15efe642b15.slice/crio-e31216b0adaf9d5d620b565dc6215cd8734cf2cab81f93232fdeffe051021628 WatchSource:0}: Error finding container e31216b0adaf9d5d620b565dc6215cd8734cf2cab81f93232fdeffe051021628: Status 404 returned error can't find the container with id e31216b0adaf9d5d620b565dc6215cd8734cf2cab81f93232fdeffe051021628
Apr 24 21:17:27.755885 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.755865    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f92hq\" (UniqueName: \"kubernetes.io/projected/fe14e9fb-5dfc-4c4d-83de-cb303b918323-kube-api-access-f92hq\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:27.819528 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.819497    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-69db897b98-x7rd5"]
Apr 24 21:17:27.823180 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:17:27.823143    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30fe1833_7b51_45f1_80fd_e27b25a5e82a.slice/crio-a35f67c5508529cd05730c48c1e9d3c09ee80a18e8ea7b29a33544cf67bbf379 WatchSource:0}: Error finding container a35f67c5508529cd05730c48c1e9d3c09ee80a18e8ea7b29a33544cf67bbf379: Status 404 returned error can't find the container with id a35f67c5508529cd05730c48c1e9d3c09ee80a18e8ea7b29a33544cf67bbf379
Apr 24 21:17:27.834056 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:27.834031    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-qpm5s"]
Apr 24 21:17:27.838267 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:17:27.838243    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf9903e0_3459_4bde_b42b_715b24c9a4fa.slice/crio-c8ba3b00100d46adb8289856ee42a90c154dfc5fe5b53feade910c64b1de933a WatchSource:0}: Error finding container c8ba3b00100d46adb8289856ee42a90c154dfc5fe5b53feade910c64b1de933a: Status 404 returned error can't find the container with id c8ba3b00100d46adb8289856ee42a90c154dfc5fe5b53feade910c64b1de933a
Apr 24 21:17:28.196815 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.196741    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9gh4c" event={"ID":"fccfd4cf-bc0a-486b-8821-5a6a8737cd44","Type":"ContainerStarted","Data":"10d768b13bc7b310e5ead97fe82eb69b18c25b8c7860788ca49c559a57576807"}
Apr 24 21:17:28.198609 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.198448    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5" event={"ID":"30fe1833-7b51-45f1-80fd-e27b25a5e82a","Type":"ContainerStarted","Data":"a35f67c5508529cd05730c48c1e9d3c09ee80a18e8ea7b29a33544cf67bbf379"}
Apr 24 21:17:28.200460 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.200416    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6d476f45-d7jzl" event={"ID":"b0803663-ccce-442d-8b7d-c15efe642b15","Type":"ContainerStarted","Data":"e31216b0adaf9d5d620b565dc6215cd8734cf2cab81f93232fdeffe051021628"}
Apr 24 21:17:28.202867 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.202838    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qbgk9" event={"ID":"114be5a4-3fea-42af-a519-695fa4f7239d","Type":"ContainerStarted","Data":"9f97d4b25832103ed738aeb09b04bf91afdc7d99487b38d7ac59597e8f81f982"}
Apr 24 21:17:28.204992 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.204966    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qpm5s" event={"ID":"af9903e0-3459-4bde-b42b-715b24c9a4fa","Type":"ContainerStarted","Data":"5f6e9b79095dde39c61494b223cddad4ded2be37de3100c9ae1a60d4b51183c3"}
Apr 24 21:17:28.205097 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.205002    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qpm5s" event={"ID":"af9903e0-3459-4bde-b42b-715b24c9a4fa","Type":"ContainerStarted","Data":"2544186683d3113b10814c14cc6164b68ce3ad8b512d3e9f51d0c3ccb8979b7e"}
Apr 24 21:17:28.205097 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.205017    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qpm5s" event={"ID":"af9903e0-3459-4bde-b42b-715b24c9a4fa","Type":"ContainerStarted","Data":"c8ba3b00100d46adb8289856ee42a90c154dfc5fe5b53feade910c64b1de933a"}
Apr 24 21:17:28.225805 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.225345    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qbgk9" podStartSLOduration=2.066887218 podStartE2EDuration="6.225330025s" podCreationTimestamp="2026-04-24 21:17:22 +0000 UTC" firstStartedPulling="2026-04-24 21:17:22.957421891 +0000 UTC m=+35.576878494" lastFinishedPulling="2026-04-24 21:17:27.115864699 +0000 UTC m=+39.735321301" observedRunningTime="2026-04-24 21:17:28.223586418 +0000 UTC m=+40.843043041" watchObservedRunningTime="2026-04-24 21:17:28.225330025 +0000 UTC m=+40.844786656"
Apr 24 21:17:28.243099 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.243071    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe14e9fb-5dfc-4c4d-83de-cb303b918323-node-exporter-tls\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:28.246855 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.245906    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe14e9fb-5dfc-4c4d-83de-cb303b918323-node-exporter-tls\") pod \"node-exporter-dpzm9\" (UID: \"fe14e9fb-5dfc-4c4d-83de-cb303b918323\") " pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:28.408166 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.408131    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dpzm9"
Apr 24 21:17:28.429910 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:17:28.429865    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe14e9fb_5dfc_4c4d_83de_cb303b918323.slice/crio-c5060d95477b742bab9318f5f43ef1ec1889998ab19524806dcab22663ca8e76 WatchSource:0}: Error finding container c5060d95477b742bab9318f5f43ef1ec1889998ab19524806dcab22663ca8e76: Status 404 returned error can't find the container with id c5060d95477b742bab9318f5f43ef1ec1889998ab19524806dcab22663ca8e76
Apr 24 21:17:28.488374 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.488101    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Apr 24 21:17:28.499305 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.499273    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.503106 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.503030    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Apr 24 21:17:28.503483 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.503287    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Apr 24 21:17:28.503908 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.503886    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Apr 24 21:17:28.504005 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.503971    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Apr 24 21:17:28.504651 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.504469    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Apr 24 21:17:28.504651 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.504468    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Apr 24 21:17:28.504799 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.504670    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Apr 24 21:17:28.504799 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.504683    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Apr 24 21:17:28.504799 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.504740    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tjbks\""
Apr 24 21:17:28.504942 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.504806    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Apr 24 21:17:28.509290 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.509061    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Apr 24 21:17:28.647656 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.647580    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbe592f7-616c-4382-b3e8-284718f95d30-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.647656 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.647631    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-config-volume\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.647656 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.647657    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.647942 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.647686    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbe592f7-616c-4382-b3e8-284718f95d30-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.647942 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.647723    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbe592f7-616c-4382-b3e8-284718f95d30-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.647942 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.647755    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbe592f7-616c-4382-b3e8-284718f95d30-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.647942 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.647793    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbe592f7-616c-4382-b3e8-284718f95d30-config-out\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.647942 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.647817    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.647942 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.647852    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcrcr\" (UniqueName: \"kubernetes.io/projected/dbe592f7-616c-4382-b3e8-284718f95d30-kube-api-access-qcrcr\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.647942 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.647911    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-web-config\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.647942 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.647939    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.648294 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.647985    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.648294 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.648014    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.750150 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.749273    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbe592f7-616c-4382-b3e8-284718f95d30-config-out\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.750150 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.749318    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.750150 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.749358    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qcrcr\" (UniqueName: \"kubernetes.io/projected/dbe592f7-616c-4382-b3e8-284718f95d30-kube-api-access-qcrcr\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.750150 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.749431    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-web-config\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.750150 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.749466    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.750150 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.749499    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.750150 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.749524    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.750150 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.749565    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbe592f7-616c-4382-b3e8-284718f95d30-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.750150 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.749594    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-config-volume\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.750150 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.749623    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.750150 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.749650    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbe592f7-616c-4382-b3e8-284718f95d30-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.750150 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.749694    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbe592f7-616c-4382-b3e8-284718f95d30-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.750150 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.749732    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbe592f7-616c-4382-b3e8-284718f95d30-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.752439 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.752312    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbe592f7-616c-4382-b3e8-284718f95d30-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.752755 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.752586    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbe592f7-616c-4382-b3e8-284718f95d30-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.753521 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.752890    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbe592f7-616c-4382-b3e8-284718f95d30-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.753521 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:28.752946    2569 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Apr 24 21:17:28.753521 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:28.753009    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-main-tls podName:dbe592f7-616c-4382-b3e8-284718f95d30 nodeName:}" failed. No retries permitted until 2026-04-24 21:17:29.25299141 +0000 UTC m=+41.872448022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "dbe592f7-616c-4382-b3e8-284718f95d30") : secret "alertmanager-main-tls" not found
Apr 24 21:17:28.755565 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.755540    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-web-config\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.758684 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.758643    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbe592f7-616c-4382-b3e8-284718f95d30-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.760801 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.760759    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.760902 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.760817    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.762501 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.760962    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.762501 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.761225    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbe592f7-616c-4382-b3e8-284718f95d30-config-out\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.762501 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.762015    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcrcr\" (UniqueName: \"kubernetes.io/projected/dbe592f7-616c-4382-b3e8-284718f95d30-kube-api-access-qcrcr\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.762501 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.762460    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-config-volume\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:28.763486 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:28.763331    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:29.212595 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:29.212438    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dpzm9" event={"ID":"fe14e9fb-5dfc-4c4d-83de-cb303b918323","Type":"ContainerStarted","Data":"c5060d95477b742bab9318f5f43ef1ec1889998ab19524806dcab22663ca8e76"}
Apr 24 21:17:29.254570 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:29.254474    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:29.258174 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:29.257949    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:29.412288 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:29.412249    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:17:30.405999 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.405968    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"]
Apr 24 21:17:30.429243 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.429215    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"]
Apr 24 21:17:30.429597 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.429289    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.431752 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.431729    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8c3o65rh4ri65\""
Apr 24 21:17:30.431867 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.431779    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Apr 24 21:17:30.431867 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.431731    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-gfzbl\""
Apr 24 21:17:30.431867 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.431807    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Apr 24 21:17:30.432048 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.431730    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Apr 24 21:17:30.432188 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.432172    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Apr 24 21:17:30.432275 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.432201    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Apr 24 21:17:30.465422 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.465370    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1e7fe9e3-f045-4684-a90a-a332ae16b229-secret-thanos-querier-tls\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.465572 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.465430    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e7fe9e3-f045-4684-a90a-a332ae16b229-metrics-client-ca\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.465572 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.465461    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e7fe9e3-f045-4684-a90a-a332ae16b229-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.465572 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.465485    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e7fe9e3-f045-4684-a90a-a332ae16b229-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.465572 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.465511    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1e7fe9e3-f045-4684-a90a-a332ae16b229-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.465572 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.465571    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2lsd\" (UniqueName: \"kubernetes.io/projected/1e7fe9e3-f045-4684-a90a-a332ae16b229-kube-api-access-f2lsd\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.465746 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.465590    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e7fe9e3-f045-4684-a90a-a332ae16b229-secret-grpc-tls\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.465746 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.465606    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1e7fe9e3-f045-4684-a90a-a332ae16b229-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.566946 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.566783    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e7fe9e3-f045-4684-a90a-a332ae16b229-secret-grpc-tls\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.566946 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.566834    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1e7fe9e3-f045-4684-a90a-a332ae16b229-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.566946 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.566898    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1e7fe9e3-f045-4684-a90a-a332ae16b229-secret-thanos-querier-tls\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.566946 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.566930    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e7fe9e3-f045-4684-a90a-a332ae16b229-metrics-client-ca\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.567202 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.566975    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e7fe9e3-f045-4684-a90a-a332ae16b229-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.567240 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.567205    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e7fe9e3-f045-4684-a90a-a332ae16b229-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.567291 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.567272    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1e7fe9e3-f045-4684-a90a-a332ae16b229-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.567483 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.567345    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f2lsd\" (UniqueName: \"kubernetes.io/projected/1e7fe9e3-f045-4684-a90a-a332ae16b229-kube-api-access-f2lsd\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.569727 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.569698    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e7fe9e3-f045-4684-a90a-a332ae16b229-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.569727 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.569718    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1e7fe9e3-f045-4684-a90a-a332ae16b229-secret-thanos-querier-tls\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.569988 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.569961    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e7fe9e3-f045-4684-a90a-a332ae16b229-secret-grpc-tls\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.570311 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.570292    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1e7fe9e3-f045-4684-a90a-a332ae16b229-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.570507 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.570482    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1e7fe9e3-f045-4684-a90a-a332ae16b229-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.570889 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.570868    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e7fe9e3-f045-4684-a90a-a332ae16b229-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.574784 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.574764    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2lsd\" (UniqueName: \"kubernetes.io/projected/1e7fe9e3-f045-4684-a90a-a332ae16b229-kube-api-access-f2lsd\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.574890 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.574834    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e7fe9e3-f045-4684-a90a-a332ae16b229-metrics-client-ca\") pod \"thanos-querier-7d86fc6796-gc8qh\" (UID: \"1e7fe9e3-f045-4684-a90a-a332ae16b229\") " pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:30.739246 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:30.739158    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:31.880992 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:31.880935    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"]
Apr 24 21:17:31.896990 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:31.896967    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"]
Apr 24 21:17:31.897125 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:31.897068    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:31.900374 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:31.900352    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xdcq6\""
Apr 24 21:17:31.900374 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:31.900360    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Apr 24 21:17:31.900542 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:31.900455    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Apr 24 21:17:31.900542 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:31.900519    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Apr 24 21:17:31.900721 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:31.900707    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Apr 24 21:17:31.900757 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:31.900709    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8a0i6u6ojedeb\""
Apr 24 21:17:31.980309 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:31.980287    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d241d572-d4e3-40b6-a749-c692a1d1ca24-client-ca-bundle\") pod \"metrics-server-6fd764c9f6-wvdt6\" (UID: \"d241d572-d4e3-40b6-a749-c692a1d1ca24\") " pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:31.980463 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:31.980327    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d241d572-d4e3-40b6-a749-c692a1d1ca24-secret-metrics-server-client-certs\") pod \"metrics-server-6fd764c9f6-wvdt6\" (UID: \"d241d572-d4e3-40b6-a749-c692a1d1ca24\") " pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:31.980463 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:31.980363    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d241d572-d4e3-40b6-a749-c692a1d1ca24-secret-metrics-server-tls\") pod \"metrics-server-6fd764c9f6-wvdt6\" (UID: \"d241d572-d4e3-40b6-a749-c692a1d1ca24\") " pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:31.980463 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:31.980430    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d241d572-d4e3-40b6-a749-c692a1d1ca24-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fd764c9f6-wvdt6\" (UID: \"d241d572-d4e3-40b6-a749-c692a1d1ca24\") " pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:31.980553 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:31.980472    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d241d572-d4e3-40b6-a749-c692a1d1ca24-metrics-server-audit-profiles\") pod \"metrics-server-6fd764c9f6-wvdt6\" (UID: \"d241d572-d4e3-40b6-a749-c692a1d1ca24\") " pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:31.980553 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:31.980509    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d241d572-d4e3-40b6-a749-c692a1d1ca24-audit-log\") pod \"metrics-server-6fd764c9f6-wvdt6\" (UID: \"d241d572-d4e3-40b6-a749-c692a1d1ca24\") " pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:31.980553 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:31.980526    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rprcl\" (UniqueName: \"kubernetes.io/projected/d241d572-d4e3-40b6-a749-c692a1d1ca24-kube-api-access-rprcl\") pod \"metrics-server-6fd764c9f6-wvdt6\" (UID: \"d241d572-d4e3-40b6-a749-c692a1d1ca24\") " pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:32.051085 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.051054    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-6hk4n"]
Apr 24 21:17:32.074580 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.074560    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-6hk4n"]
Apr 24 21:17:32.074673 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.074658    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-6hk4n"
Apr 24 21:17:32.077108 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.077085    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-7xjzc\""
Apr 24 21:17:32.077202 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.077130    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Apr 24 21:17:32.081514 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.081495    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d241d572-d4e3-40b6-a749-c692a1d1ca24-audit-log\") pod \"metrics-server-6fd764c9f6-wvdt6\" (UID: \"d241d572-d4e3-40b6-a749-c692a1d1ca24\") " pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:32.081611 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.081527    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rprcl\" (UniqueName: \"kubernetes.io/projected/d241d572-d4e3-40b6-a749-c692a1d1ca24-kube-api-access-rprcl\") pod \"metrics-server-6fd764c9f6-wvdt6\" (UID: \"d241d572-d4e3-40b6-a749-c692a1d1ca24\") " pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:32.081611 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.081560    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d241d572-d4e3-40b6-a749-c692a1d1ca24-client-ca-bundle\") pod \"metrics-server-6fd764c9f6-wvdt6\" (UID: \"d241d572-d4e3-40b6-a749-c692a1d1ca24\") " pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:32.081716 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.081611    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d241d572-d4e3-40b6-a749-c692a1d1ca24-secret-metrics-server-client-certs\") pod \"metrics-server-6fd764c9f6-wvdt6\" (UID: \"d241d572-d4e3-40b6-a749-c692a1d1ca24\") " pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:32.081716 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.081647    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d241d572-d4e3-40b6-a749-c692a1d1ca24-secret-metrics-server-tls\") pod \"metrics-server-6fd764c9f6-wvdt6\" (UID: \"d241d572-d4e3-40b6-a749-c692a1d1ca24\") " pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:32.081716 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.081686    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d241d572-d4e3-40b6-a749-c692a1d1ca24-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fd764c9f6-wvdt6\" (UID: \"d241d572-d4e3-40b6-a749-c692a1d1ca24\") " pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:32.081852 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.081750    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d241d572-d4e3-40b6-a749-c692a1d1ca24-metrics-server-audit-profiles\") pod \"metrics-server-6fd764c9f6-wvdt6\" (UID: \"d241d572-d4e3-40b6-a749-c692a1d1ca24\") " pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:32.081933 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.081909    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d241d572-d4e3-40b6-a749-c692a1d1ca24-audit-log\") pod \"metrics-server-6fd764c9f6-wvdt6\" (UID: \"d241d572-d4e3-40b6-a749-c692a1d1ca24\") " pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:32.082701 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.082675    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d241d572-d4e3-40b6-a749-c692a1d1ca24-metrics-server-audit-profiles\") pod \"metrics-server-6fd764c9f6-wvdt6\" (UID: \"d241d572-d4e3-40b6-a749-c692a1d1ca24\") " pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:32.084060 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.084042    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d241d572-d4e3-40b6-a749-c692a1d1ca24-secret-metrics-server-tls\") pod \"metrics-server-6fd764c9f6-wvdt6\" (UID: \"d241d572-d4e3-40b6-a749-c692a1d1ca24\") " pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:32.084281 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.084263    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d241d572-d4e3-40b6-a749-c692a1d1ca24-client-ca-bundle\") pod \"metrics-server-6fd764c9f6-wvdt6\" (UID: \"d241d572-d4e3-40b6-a749-c692a1d1ca24\") " pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:32.084326 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.084283    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d241d572-d4e3-40b6-a749-c692a1d1ca24-secret-metrics-server-client-certs\") pod \"metrics-server-6fd764c9f6-wvdt6\" (UID: \"d241d572-d4e3-40b6-a749-c692a1d1ca24\") " pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:32.089586 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.089568    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d241d572-d4e3-40b6-a749-c692a1d1ca24-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fd764c9f6-wvdt6\" (UID: \"d241d572-d4e3-40b6-a749-c692a1d1ca24\") " pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:32.091574 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.091552    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rprcl\" (UniqueName: \"kubernetes.io/projected/d241d572-d4e3-40b6-a749-c692a1d1ca24-kube-api-access-rprcl\") pod \"metrics-server-6fd764c9f6-wvdt6\" (UID: \"d241d572-d4e3-40b6-a749-c692a1d1ca24\") " pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:32.182641 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.182559    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f8679814-3c77-4a01-a7c5-e4064536711f-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-6hk4n\" (UID: \"f8679814-3c77-4a01-a7c5-e4064536711f\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-6hk4n"
Apr 24 21:17:32.206557 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.206519    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:32.283592 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.283554    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f8679814-3c77-4a01-a7c5-e4064536711f-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-6hk4n\" (UID: \"f8679814-3c77-4a01-a7c5-e4064536711f\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-6hk4n"
Apr 24 21:17:32.283785 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:32.283768    2569 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Apr 24 21:17:32.283857 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:32.283845    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8679814-3c77-4a01-a7c5-e4064536711f-monitoring-plugin-cert podName:f8679814-3c77-4a01-a7c5-e4064536711f nodeName:}" failed. No retries permitted until 2026-04-24 21:17:32.78382471 +0000 UTC m=+45.403281316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/f8679814-3c77-4a01-a7c5-e4064536711f-monitoring-plugin-cert") pod "monitoring-plugin-7dccd58f55-6hk4n" (UID: "f8679814-3c77-4a01-a7c5-e4064536711f") : secret "monitoring-plugin-cert" not found
Apr 24 21:17:32.585536 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.585453    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-68d84d7d56-rb9td"]
Apr 24 21:17:32.605697 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.605669    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-68d84d7d56-rb9td"]
Apr 24 21:17:32.605854 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.605809    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.608523 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.608497    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6hcv2\""
Apr 24 21:17:32.608660 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.608545    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Apr 24 21:17:32.608732 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.608682    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Apr 24 21:17:32.608851 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.608828    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Apr 24 21:17:32.609464 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.609416    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Apr 24 21:17:32.609576 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.609474    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Apr 24 21:17:32.614472 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.614450    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Apr 24 21:17:32.687390 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.687325    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70235cbe-8222-476f-82f9-dac384f31fc5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.687540 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.687413    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/70235cbe-8222-476f-82f9-dac384f31fc5-secret-telemeter-client\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.687540 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.687470    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70235cbe-8222-476f-82f9-dac384f31fc5-serving-certs-ca-bundle\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.687540 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.687504    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtr2h\" (UniqueName: \"kubernetes.io/projected/70235cbe-8222-476f-82f9-dac384f31fc5-kube-api-access-mtr2h\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.687697 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.687551    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/70235cbe-8222-476f-82f9-dac384f31fc5-telemeter-client-tls\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.687697 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.687659    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70235cbe-8222-476f-82f9-dac384f31fc5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.687799 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.687703    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70235cbe-8222-476f-82f9-dac384f31fc5-metrics-client-ca\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.687799 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.687735    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/70235cbe-8222-476f-82f9-dac384f31fc5-federate-client-tls\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.788680 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.788643    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mtr2h\" (UniqueName: \"kubernetes.io/projected/70235cbe-8222-476f-82f9-dac384f31fc5-kube-api-access-mtr2h\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.788899 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.788706    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/70235cbe-8222-476f-82f9-dac384f31fc5-telemeter-client-tls\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.788899 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.788765    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70235cbe-8222-476f-82f9-dac384f31fc5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.788899 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.788796    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70235cbe-8222-476f-82f9-dac384f31fc5-metrics-client-ca\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.788899 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.788826    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f8679814-3c77-4a01-a7c5-e4064536711f-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-6hk4n\" (UID: \"f8679814-3c77-4a01-a7c5-e4064536711f\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-6hk4n"
Apr 24 21:17:32.788899 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.788850    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/70235cbe-8222-476f-82f9-dac384f31fc5-federate-client-tls\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.788899 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.788876    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70235cbe-8222-476f-82f9-dac384f31fc5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.789233 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.788915    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/70235cbe-8222-476f-82f9-dac384f31fc5-secret-telemeter-client\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.789233 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.788975    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70235cbe-8222-476f-82f9-dac384f31fc5-serving-certs-ca-bundle\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.789233 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:32.788996    2569 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Apr 24 21:17:32.789233 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:17:32.789099    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8679814-3c77-4a01-a7c5-e4064536711f-monitoring-plugin-cert podName:f8679814-3c77-4a01-a7c5-e4064536711f nodeName:}" failed. No retries permitted until 2026-04-24 21:17:33.789072877 +0000 UTC m=+46.408529482 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/f8679814-3c77-4a01-a7c5-e4064536711f-monitoring-plugin-cert") pod "monitoring-plugin-7dccd58f55-6hk4n" (UID: "f8679814-3c77-4a01-a7c5-e4064536711f") : secret "monitoring-plugin-cert" not found
Apr 24 21:17:32.789764 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.789715    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70235cbe-8222-476f-82f9-dac384f31fc5-serving-certs-ca-bundle\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.789764 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.789726    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70235cbe-8222-476f-82f9-dac384f31fc5-metrics-client-ca\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.794967 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.794939    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70235cbe-8222-476f-82f9-dac384f31fc5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.795083 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.794941    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/70235cbe-8222-476f-82f9-dac384f31fc5-federate-client-tls\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.795083 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.794990    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70235cbe-8222-476f-82f9-dac384f31fc5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.795191 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.795119    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/70235cbe-8222-476f-82f9-dac384f31fc5-secret-telemeter-client\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.795191 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.795182    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/70235cbe-8222-476f-82f9-dac384f31fc5-telemeter-client-tls\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.805701 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.805678    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtr2h\" (UniqueName: \"kubernetes.io/projected/70235cbe-8222-476f-82f9-dac384f31fc5-kube-api-access-mtr2h\") pod \"telemeter-client-68d84d7d56-rb9td\" (UID: \"70235cbe-8222-476f-82f9-dac384f31fc5\") " pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:32.917621 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:32.917593    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td"
Apr 24 21:17:33.614291 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.614140    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Apr 24 21:17:33.647554 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.645836    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.678671 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.677839    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Apr 24 21:17:33.683398 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.680591    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Apr 24 21:17:33.683398 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.680848    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vpp99\""
Apr 24 21:17:33.683398 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.681050    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Apr 24 21:17:33.683398 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.681448    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Apr 24 21:17:33.683398 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.681642    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Apr 24 21:17:33.683398 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.681852    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8fkri8tut005u\""
Apr 24 21:17:33.683398 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.682034    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Apr 24 21:17:33.683398 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.682601    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Apr 24 21:17:33.683398 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.682803    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Apr 24 21:17:33.687598 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.684045    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Apr 24 21:17:33.687598 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.685775    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Apr 24 21:17:33.687598 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.686056    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Apr 24 21:17:33.695996 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.695946    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Apr 24 21:17:33.697823 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.697139    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.697823 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.697178    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-web-config\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.697823 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.697201    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/90e76aa8-68aa-4a31-86df-00197ce187b3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.697823 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.697226    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.697823 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.697248    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.697823 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.697274    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/90e76aa8-68aa-4a31-86df-00197ce187b3-config-out\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.697823 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.697368    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/90e76aa8-68aa-4a31-86df-00197ce187b3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.697823 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.697405    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.697823 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.697432    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r8sl\" (UniqueName: \"kubernetes.io/projected/90e76aa8-68aa-4a31-86df-00197ce187b3-kube-api-access-4r8sl\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.697823 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.697479    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.697823 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.697502    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.697823 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.697525    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.697823 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.697563    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-config\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.697823 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.697605    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.697823 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.697628    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.697823 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.697673    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.698633 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.697694    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.698633 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.697815    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.702294 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.702069    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Apr 24 21:17:33.768816 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.767867    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b6d476f45-d7jzl"]
Apr 24 21:17:33.788855 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.788819    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-b4fcd778d-6wgtb"]
Apr 24 21:17:33.798372 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.798345    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-web-config\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.798512 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.798408    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/90e76aa8-68aa-4a31-86df-00197ce187b3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.798512 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.798439    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.798512 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.798466    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.798512 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.798496    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/90e76aa8-68aa-4a31-86df-00197ce187b3-config-out\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.798782 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.798526    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f8679814-3c77-4a01-a7c5-e4064536711f-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-6hk4n\" (UID: \"f8679814-3c77-4a01-a7c5-e4064536711f\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-6hk4n"
Apr 24 21:17:33.798782 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.798596    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/90e76aa8-68aa-4a31-86df-00197ce187b3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.798782 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.798621    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.798782 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.798651    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4r8sl\" (UniqueName: \"kubernetes.io/projected/90e76aa8-68aa-4a31-86df-00197ce187b3-kube-api-access-4r8sl\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.798782 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.798683    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.798782 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.798712    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.798782 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.798736    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.798782 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.798778    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-config\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.799162 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.798812    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/90e76aa8-68aa-4a31-86df-00197ce187b3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.799162 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.798825    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.799162 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.798852    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.799162 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.798898    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.799162 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.798924    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.799162 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.798976    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.799162 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.799017    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.800053 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.799735    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.802165 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.802138    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.804529 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.804449    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.804680 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.804633    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/90e76aa8-68aa-4a31-86df-00197ce187b3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.806086 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.805746    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.806086 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.806047    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.806678 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.806637    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/90e76aa8-68aa-4a31-86df-00197ce187b3-config-out\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.806915 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.806891    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f8679814-3c77-4a01-a7c5-e4064536711f-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-6hk4n\" (UID: \"f8679814-3c77-4a01-a7c5-e4064536711f\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-6hk4n"
Apr 24 21:17:33.806996 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.806951    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.808370 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.808344    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.809063 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.808831    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-web-config\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.809063 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.808853    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.809063 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.808933    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.809231 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.809105    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-config\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.809621 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.809574    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.809968 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.809867    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.810050 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.810027    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.814553 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.813906    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b4fcd778d-6wgtb"]
Apr 24 21:17:33.814553 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.814037    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:33.818649 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.818006    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Apr 24 21:17:33.819146 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.819125    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r8sl\" (UniqueName: \"kubernetes.io/projected/90e76aa8-68aa-4a31-86df-00197ce187b3-kube-api-access-4r8sl\") pod \"prometheus-k8s-0\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:33.865529 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.864249    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"]
Apr 24 21:17:33.884252 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.883987    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-6hk4n"
Apr 24 21:17:33.899955 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.899931    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-trusted-ca-bundle\") pod \"console-b4fcd778d-6wgtb\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") " pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:33.900114 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.900084    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-console-serving-cert\") pod \"console-b4fcd778d-6wgtb\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") " pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:33.900190 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.900160    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-console-oauth-config\") pod \"console-b4fcd778d-6wgtb\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") " pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:33.900254 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.900196    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h2mq\" (UniqueName: \"kubernetes.io/projected/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-kube-api-access-2h2mq\") pod \"console-b4fcd778d-6wgtb\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") " pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:33.900315 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.900256    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-service-ca\") pod \"console-b4fcd778d-6wgtb\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") " pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:33.900375 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.900316    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-oauth-serving-cert\") pod \"console-b4fcd778d-6wgtb\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") " pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:33.900375 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.900356    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-console-config\") pod \"console-b4fcd778d-6wgtb\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") " pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:33.960494 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:17:33.959677    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd241d572_d4e3_40b6_a749_c692a1d1ca24.slice/crio-60d012059eda7c268d15b9835f6e35609b691a8de189526f4aeacd2517a822de WatchSource:0}: Error finding container 60d012059eda7c268d15b9835f6e35609b691a8de189526f4aeacd2517a822de: Status 404 returned error can't find the container with id 60d012059eda7c268d15b9835f6e35609b691a8de189526f4aeacd2517a822de
Apr 24 21:17:33.960494 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:17:33.959949    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbe592f7_616c_4382_b3e8_284718f95d30.slice/crio-62450b5df0cda24671e9466df1daa48f2890a69fd8548a1ce95665ea3888417b WatchSource:0}: Error finding container 62450b5df0cda24671e9466df1daa48f2890a69fd8548a1ce95665ea3888417b: Status 404 returned error can't find the container with id 62450b5df0cda24671e9466df1daa48f2890a69fd8548a1ce95665ea3888417b
Apr 24 21:17:33.960494 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:33.960058    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:34.002174 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.002144    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-oauth-serving-cert\") pod \"console-b4fcd778d-6wgtb\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") " pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:34.002300 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.002230    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-console-config\") pod \"console-b4fcd778d-6wgtb\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") " pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:34.002577 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.002403    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-trusted-ca-bundle\") pod \"console-b4fcd778d-6wgtb\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") " pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:34.002577 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.002459    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-console-serving-cert\") pod \"console-b4fcd778d-6wgtb\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") " pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:34.002577 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.002495    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-console-oauth-config\") pod \"console-b4fcd778d-6wgtb\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") " pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:34.002577 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.002528    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2h2mq\" (UniqueName: \"kubernetes.io/projected/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-kube-api-access-2h2mq\") pod \"console-b4fcd778d-6wgtb\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") " pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:34.003005 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.002964    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-service-ca\") pod \"console-b4fcd778d-6wgtb\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") " pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:34.003087 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.003040    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-oauth-serving-cert\") pod \"console-b4fcd778d-6wgtb\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") " pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:34.003174 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.003147    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-console-config\") pod \"console-b4fcd778d-6wgtb\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") " pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:34.003174 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.003677    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-service-ca\") pod \"console-b4fcd778d-6wgtb\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") " pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:34.004096 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.004053    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-trusted-ca-bundle\") pod \"console-b4fcd778d-6wgtb\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") " pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:34.005946 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.005923    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-console-serving-cert\") pod \"console-b4fcd778d-6wgtb\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") " pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:34.006288 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.006265    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-console-oauth-config\") pod \"console-b4fcd778d-6wgtb\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") " pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:34.012081 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.012035    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h2mq\" (UniqueName: \"kubernetes.io/projected/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-kube-api-access-2h2mq\") pod \"console-b4fcd778d-6wgtb\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") " pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:34.048471 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.048336    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"]
Apr 24 21:17:34.052366 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.052338    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-68d84d7d56-rb9td"]
Apr 24 21:17:34.064881 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:17:34.064839    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70235cbe_8222_476f_82f9_dac384f31fc5.slice/crio-e3dcb7088ee1bd0f7a87a8522d049c3bdf20ea3135d3a812a5b350339ed8fb8d WatchSource:0}: Error finding container e3dcb7088ee1bd0f7a87a8522d049c3bdf20ea3135d3a812a5b350339ed8fb8d: Status 404 returned error can't find the container with id e3dcb7088ee1bd0f7a87a8522d049c3bdf20ea3135d3a812a5b350339ed8fb8d
Apr 24 21:17:34.128761 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.127609    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:34.169869 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.169823    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-6hk4n"]
Apr 24 21:17:34.173179 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.172617    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Apr 24 21:17:34.176620 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:17:34.176569    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8679814_3c77_4a01_a7c5_e4064536711f.slice/crio-f8a40362abae2b741bd19ff091312ab5eefa1e38f0c5fba5e17cd8fdeb9fea78 WatchSource:0}: Error finding container f8a40362abae2b741bd19ff091312ab5eefa1e38f0c5fba5e17cd8fdeb9fea78: Status 404 returned error can't find the container with id f8a40362abae2b741bd19ff091312ab5eefa1e38f0c5fba5e17cd8fdeb9fea78
Apr 24 21:17:34.178729 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:17:34.178523    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90e76aa8_68aa_4a31_86df_00197ce187b3.slice/crio-0d16c17d30a66a01aca2d7d8391bb234e1994fab837f17558b3a0530a5532067 WatchSource:0}: Error finding container 0d16c17d30a66a01aca2d7d8391bb234e1994fab837f17558b3a0530a5532067: Status 404 returned error can't find the container with id 0d16c17d30a66a01aca2d7d8391bb234e1994fab837f17558b3a0530a5532067
Apr 24 21:17:34.230492 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.230448    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"90e76aa8-68aa-4a31-86df-00197ce187b3","Type":"ContainerStarted","Data":"0d16c17d30a66a01aca2d7d8391bb234e1994fab837f17558b3a0530a5532067"}
Apr 24 21:17:34.236064 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.236005    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td" event={"ID":"70235cbe-8222-476f-82f9-dac384f31fc5","Type":"ContainerStarted","Data":"e3dcb7088ee1bd0f7a87a8522d049c3bdf20ea3135d3a812a5b350339ed8fb8d"}
Apr 24 21:17:34.238436 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.238231    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh" event={"ID":"1e7fe9e3-f045-4684-a90a-a332ae16b229","Type":"ContainerStarted","Data":"b110af5ee1b7456f5ab12cee2ae4cede3679aa59b28064e1178d7433dc9e8042"}
Apr 24 21:17:34.241470 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.241445    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qpm5s" event={"ID":"af9903e0-3459-4bde-b42b-715b24c9a4fa","Type":"ContainerStarted","Data":"19cffbde0a2edc9cfd985b7ea963820f38c922e4f3afbf2bc138f04b2f1e4756"}
Apr 24 21:17:34.243448 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.243399    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-6hk4n" event={"ID":"f8679814-3c77-4a01-a7c5-e4064536711f","Type":"ContainerStarted","Data":"f8a40362abae2b741bd19ff091312ab5eefa1e38f0c5fba5e17cd8fdeb9fea78"}
Apr 24 21:17:34.244873 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.244788    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6" event={"ID":"d241d572-d4e3-40b6-a749-c692a1d1ca24","Type":"ContainerStarted","Data":"60d012059eda7c268d15b9835f6e35609b691a8de189526f4aeacd2517a822de"}
Apr 24 21:17:34.248369 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.248293    2569 generic.go:358] "Generic (PLEG): container finished" podID="fe14e9fb-5dfc-4c4d-83de-cb303b918323" containerID="d135651dc6f67730b38032446940532407eed703edddeb3f4a3d69b691947f1b" exitCode=0
Apr 24 21:17:34.248597 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.248506    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dpzm9" event={"ID":"fe14e9fb-5dfc-4c4d-83de-cb303b918323","Type":"ContainerDied","Data":"d135651dc6f67730b38032446940532407eed703edddeb3f4a3d69b691947f1b"}
Apr 24 21:17:34.251598 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.251518    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5" event={"ID":"30fe1833-7b51-45f1-80fd-e27b25a5e82a","Type":"ContainerStarted","Data":"ea3b63370e12c330dd3f39221e176c69fa68ff6ceddf5890f799710a085c91c6"}
Apr 24 21:17:34.251598 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.251572    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5" event={"ID":"30fe1833-7b51-45f1-80fd-e27b25a5e82a","Type":"ContainerStarted","Data":"804ff244749c5547277a1030561c35a129c98d2d721dbe4227eea90d73ab616f"}
Apr 24 21:17:34.253341 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.253312    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6d476f45-d7jzl" event={"ID":"b0803663-ccce-442d-8b7d-c15efe642b15","Type":"ContainerStarted","Data":"c88e7aadce8e9b0b92e423e912eb67d3acf2b1439300079458235ba945fce8ff"}
Apr 24 21:17:34.255014 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.254940    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe592f7-616c-4382-b3e8-284718f95d30","Type":"ContainerStarted","Data":"62450b5df0cda24671e9466df1daa48f2890a69fd8548a1ce95665ea3888417b"}
Apr 24 21:17:34.266478 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.266418    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qpm5s" podStartSLOduration=1.664289787 podStartE2EDuration="7.266403227s" podCreationTimestamp="2026-04-24 21:17:27 +0000 UTC" firstStartedPulling="2026-04-24 21:17:28.000572536 +0000 UTC m=+40.620029162" lastFinishedPulling="2026-04-24 21:17:33.602685995 +0000 UTC m=+46.222142602" observedRunningTime="2026-04-24 21:17:34.26516304 +0000 UTC m=+46.884619677" watchObservedRunningTime="2026-04-24 21:17:34.266403227 +0000 UTC m=+46.885859850"
Apr 24 21:17:34.289579 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.289515    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b4fcd778d-6wgtb"]
Apr 24 21:17:34.291096 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:34.290597    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7b6d476f45-d7jzl" podStartSLOduration=1.4243180020000001 podStartE2EDuration="7.290580816s" podCreationTimestamp="2026-04-24 21:17:27 +0000 UTC" firstStartedPulling="2026-04-24 21:17:27.748483809 +0000 UTC m=+40.367940420" lastFinishedPulling="2026-04-24 21:17:33.614746631 +0000 UTC m=+46.234203234" observedRunningTime="2026-04-24 21:17:34.286097574 +0000 UTC m=+46.905554202" watchObservedRunningTime="2026-04-24 21:17:34.290580816 +0000 UTC m=+46.910037442"
Apr 24 21:17:34.295103 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:17:34.295075    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6325b9b7_1c93_49c2_aff2_0242a7bfe6a1.slice/crio-687fbde1a82c7d8b2397da6d181d86001af69bce78a64ccfe0608ff623d1db80 WatchSource:0}: Error finding container 687fbde1a82c7d8b2397da6d181d86001af69bce78a64ccfe0608ff623d1db80: Status 404 returned error can't find the container with id 687fbde1a82c7d8b2397da6d181d86001af69bce78a64ccfe0608ff623d1db80
Apr 24 21:17:35.263991 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:35.263950    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4fcd778d-6wgtb" event={"ID":"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1","Type":"ContainerStarted","Data":"8923766aabf031ddd820b444b4e6e816a10aa013efe02b06975346513e0af4e5"}
Apr 24 21:17:35.264456 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:35.264000    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4fcd778d-6wgtb" event={"ID":"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1","Type":"ContainerStarted","Data":"687fbde1a82c7d8b2397da6d181d86001af69bce78a64ccfe0608ff623d1db80"}
Apr 24 21:17:35.267364 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:35.266861    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9gh4c" event={"ID":"fccfd4cf-bc0a-486b-8821-5a6a8737cd44","Type":"ContainerStarted","Data":"5c3e087fbe0a23d86a77b5c4889ab151e65a23a0dfa773981f72fc11fb80ff47"}
Apr 24 21:17:35.272412 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:35.271739    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dpzm9" event={"ID":"fe14e9fb-5dfc-4c4d-83de-cb303b918323","Type":"ContainerStarted","Data":"73a5be8e279b8bab100bfc9c200b96fdaf3f1dc71e8be671737c862d1bb458fb"}
Apr 24 21:17:35.272412 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:35.271770    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dpzm9" event={"ID":"fe14e9fb-5dfc-4c4d-83de-cb303b918323","Type":"ContainerStarted","Data":"2fd8d5e4599e2656ac9ff7ca94b44e60381500acb699ac4ca164bc88c7494342"}
Apr 24 21:17:35.276236 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:35.276194    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5" event={"ID":"30fe1833-7b51-45f1-80fd-e27b25a5e82a","Type":"ContainerStarted","Data":"4df58582799c38796704892c46bd2be8db409db1f104e0ff9d8283c768473b33"}
Apr 24 21:17:35.381891 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:35.381620    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dpzm9" podStartSLOduration=3.211155713 podStartE2EDuration="8.381602673s" podCreationTimestamp="2026-04-24 21:17:27 +0000 UTC" firstStartedPulling="2026-04-24 21:17:28.432240572 +0000 UTC m=+41.051697175" lastFinishedPulling="2026-04-24 21:17:33.602687528 +0000 UTC m=+46.222144135" observedRunningTime="2026-04-24 21:17:35.377766466 +0000 UTC m=+47.997223093" watchObservedRunningTime="2026-04-24 21:17:35.381602673 +0000 UTC m=+48.001059299"
Apr 24 21:17:35.382641 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:35.382554    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-b4fcd778d-6wgtb" podStartSLOduration=2.382542171 podStartE2EDuration="2.382542171s" podCreationTimestamp="2026-04-24 21:17:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:17:35.30786173 +0000 UTC m=+47.927318358" watchObservedRunningTime="2026-04-24 21:17:35.382542171 +0000 UTC m=+48.001998776"
Apr 24 21:17:35.407223 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:35.405976    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9gh4c" podStartSLOduration=10.151414702 podStartE2EDuration="16.405960637s" podCreationTimestamp="2026-04-24 21:17:19 +0000 UTC" firstStartedPulling="2026-04-24 21:17:27.729507427 +0000 UTC m=+40.348964033" lastFinishedPulling="2026-04-24 21:17:33.984053363 +0000 UTC m=+46.603509968" observedRunningTime="2026-04-24 21:17:35.404828234 +0000 UTC m=+48.024284861" watchObservedRunningTime="2026-04-24 21:17:35.405960637 +0000 UTC m=+48.025417264"
Apr 24 21:17:35.440391 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:35.438764    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-69db897b98-x7rd5" podStartSLOduration=2.65245754 podStartE2EDuration="8.438746943s" podCreationTimestamp="2026-04-24 21:17:27 +0000 UTC" firstStartedPulling="2026-04-24 21:17:27.825138944 +0000 UTC m=+40.444595548" lastFinishedPulling="2026-04-24 21:17:33.611428337 +0000 UTC m=+46.230884951" observedRunningTime="2026-04-24 21:17:35.438460607 +0000 UTC m=+48.057917226" watchObservedRunningTime="2026-04-24 21:17:35.438746943 +0000 UTC m=+48.058203564"
Apr 24 21:17:36.194749 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:36.194722    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xxlvr"
Apr 24 21:17:37.599219 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:37.599188    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:39.291348 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:39.291317    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-6hk4n" event={"ID":"f8679814-3c77-4a01-a7c5-e4064536711f","Type":"ContainerStarted","Data":"2a79cfbbf5edae0cc17a4cd93ec25abeb70b56eca63328ead1a1e5f201fb5e78"}
Apr 24 21:17:39.291694 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:39.291677    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-6hk4n"
Apr 24 21:17:39.292968 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:39.292945    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6" event={"ID":"d241d572-d4e3-40b6-a749-c692a1d1ca24","Type":"ContainerStarted","Data":"86a06dc73d02710ce20a9faaf5b889303d3e40d4b42a98f3db4a20f8ac5968cb"}
Apr 24 21:17:39.294355 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:39.294333    2569 generic.go:358] "Generic (PLEG): container finished" podID="dbe592f7-616c-4382-b3e8-284718f95d30" containerID="9e60ebc0f1379a215496f4a566fca3df911b60c4a24936ad87b5e50020ae8603" exitCode=0
Apr 24 21:17:39.294467 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:39.294412    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe592f7-616c-4382-b3e8-284718f95d30","Type":"ContainerDied","Data":"9e60ebc0f1379a215496f4a566fca3df911b60c4a24936ad87b5e50020ae8603"}
Apr 24 21:17:39.296025 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:39.295929    2569 generic.go:358] "Generic (PLEG): container finished" podID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerID="cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63" exitCode=0
Apr 24 21:17:39.296025 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:39.295996    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"90e76aa8-68aa-4a31-86df-00197ce187b3","Type":"ContainerDied","Data":"cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63"}
Apr 24 21:17:39.297817 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:39.297791    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-6hk4n"
Apr 24 21:17:39.298395 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:39.298355    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td" event={"ID":"70235cbe-8222-476f-82f9-dac384f31fc5","Type":"ContainerStarted","Data":"c608f80e99d7aba0716cba665a4a841cf0ad2889a3b53eb94bedb3ef42e0b8dc"}
Apr 24 21:17:39.298480 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:39.298399    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td" event={"ID":"70235cbe-8222-476f-82f9-dac384f31fc5","Type":"ContainerStarted","Data":"11642a05e4044337b56b7110641b27ae7aa455e15d0bb3921a59476510a443c9"}
Apr 24 21:17:39.298480 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:39.298417    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td" event={"ID":"70235cbe-8222-476f-82f9-dac384f31fc5","Type":"ContainerStarted","Data":"9667536501b4eff0c404b994bc98a45df1405caa028c7ed59a68aa85574b2004"}
Apr 24 21:17:39.300352 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:39.300333    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh" event={"ID":"1e7fe9e3-f045-4684-a90a-a332ae16b229","Type":"ContainerStarted","Data":"b143b4c4e941e200b1ef99198941de611f797e15173c0945048c99bb649250d9"}
Apr 24 21:17:39.300468 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:39.300358    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh" event={"ID":"1e7fe9e3-f045-4684-a90a-a332ae16b229","Type":"ContainerStarted","Data":"e9705c11bc4b76c95cd554456b0ef18069eb0a4f1a162967623312150adc7902"}
Apr 24 21:17:39.300468 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:39.300368    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh" event={"ID":"1e7fe9e3-f045-4684-a90a-a332ae16b229","Type":"ContainerStarted","Data":"8fcbae537813e678387513a5e87027682f64dfa2d22b7db5c3c7b4330fefa668"}
Apr 24 21:17:39.336852 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:39.336816    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-6hk4n" podStartSLOduration=2.86490232 podStartE2EDuration="7.336806569s" podCreationTimestamp="2026-04-24 21:17:32 +0000 UTC" firstStartedPulling="2026-04-24 21:17:34.17863353 +0000 UTC m=+46.798090140" lastFinishedPulling="2026-04-24 21:17:38.650537773 +0000 UTC m=+51.269994389" observedRunningTime="2026-04-24 21:17:39.334843673 +0000 UTC m=+51.954300309" watchObservedRunningTime="2026-04-24 21:17:39.336806569 +0000 UTC m=+51.956263193"
Apr 24 21:17:39.635718 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:39.635673    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-68d84d7d56-rb9td" podStartSLOduration=3.053261584 podStartE2EDuration="7.635660385s" podCreationTimestamp="2026-04-24 21:17:32 +0000 UTC" firstStartedPulling="2026-04-24 21:17:34.068109212 +0000 UTC m=+46.687565817" lastFinishedPulling="2026-04-24 21:17:38.65050801 +0000 UTC m=+51.269964618" observedRunningTime="2026-04-24 21:17:39.633082599 +0000 UTC m=+52.252539226" watchObservedRunningTime="2026-04-24 21:17:39.635660385 +0000 UTC m=+52.255117031"
Apr 24 21:17:39.684362 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:39.684306    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6" podStartSLOduration=4.002031682 podStartE2EDuration="8.684287742s" podCreationTimestamp="2026-04-24 21:17:31 +0000 UTC" firstStartedPulling="2026-04-24 21:17:33.967637136 +0000 UTC m=+46.587093746" lastFinishedPulling="2026-04-24 21:17:38.649893197 +0000 UTC m=+51.269349806" observedRunningTime="2026-04-24 21:17:39.683038443 +0000 UTC m=+52.302495079" watchObservedRunningTime="2026-04-24 21:17:39.684287742 +0000 UTC m=+52.303744368"
Apr 24 21:17:40.498840 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.498316    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b4fcd778d-6wgtb"]
Apr 24 21:17:40.605656 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.605580    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6685fd9687-cchl5"]
Apr 24 21:17:40.609298 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.609270    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:40.647183 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.647154    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6685fd9687-cchl5"]
Apr 24 21:17:40.668942 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.668911    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrs2s\" (UniqueName: \"kubernetes.io/projected/3739a2e1-6c42-441b-bd94-b1d8e8538050-kube-api-access-zrs2s\") pod \"console-6685fd9687-cchl5\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") " pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:40.669082 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.668960    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-service-ca\") pod \"console-6685fd9687-cchl5\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") " pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:40.669163 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.669123    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-trusted-ca-bundle\") pod \"console-6685fd9687-cchl5\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") " pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:40.669163 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.669154    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3739a2e1-6c42-441b-bd94-b1d8e8538050-console-serving-cert\") pod \"console-6685fd9687-cchl5\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") " pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:40.669263 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.669191    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3739a2e1-6c42-441b-bd94-b1d8e8538050-console-oauth-config\") pod \"console-6685fd9687-cchl5\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") " pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:40.669263 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.669240    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-oauth-serving-cert\") pod \"console-6685fd9687-cchl5\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") " pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:40.669354 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.669276    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-console-config\") pod \"console-6685fd9687-cchl5\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") " pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:40.769796 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.769763    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-trusted-ca-bundle\") pod \"console-6685fd9687-cchl5\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") " pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:40.769950 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.769802    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3739a2e1-6c42-441b-bd94-b1d8e8538050-console-serving-cert\") pod \"console-6685fd9687-cchl5\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") " pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:40.769950 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.769838    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3739a2e1-6c42-441b-bd94-b1d8e8538050-console-oauth-config\") pod \"console-6685fd9687-cchl5\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") " pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:40.769950 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.769860    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-oauth-serving-cert\") pod \"console-6685fd9687-cchl5\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") " pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:40.769950 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.769894    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-console-config\") pod \"console-6685fd9687-cchl5\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") " pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:40.769950 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.769930    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zrs2s\" (UniqueName: \"kubernetes.io/projected/3739a2e1-6c42-441b-bd94-b1d8e8538050-kube-api-access-zrs2s\") pod \"console-6685fd9687-cchl5\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") " pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:40.770209 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.769960    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-service-ca\") pod \"console-6685fd9687-cchl5\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") " pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:40.771310 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.771257    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-oauth-serving-cert\") pod \"console-6685fd9687-cchl5\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") " pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:40.771435 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.771363    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-trusted-ca-bundle\") pod \"console-6685fd9687-cchl5\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") " pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:40.771435 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.771403    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-console-config\") pod \"console-6685fd9687-cchl5\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") " pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:40.771553 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.771526    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-service-ca\") pod \"console-6685fd9687-cchl5\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") " pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:40.773307 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.773282    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3739a2e1-6c42-441b-bd94-b1d8e8538050-console-serving-cert\") pod \"console-6685fd9687-cchl5\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") " pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:40.773441 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.773353    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3739a2e1-6c42-441b-bd94-b1d8e8538050-console-oauth-config\") pod \"console-6685fd9687-cchl5\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") " pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:40.789438 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.789354    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrs2s\" (UniqueName: \"kubernetes.io/projected/3739a2e1-6c42-441b-bd94-b1d8e8538050-kube-api-access-zrs2s\") pod \"console-6685fd9687-cchl5\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") " pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:40.921204 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:40.921171    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:41.096499 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:41.096472    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6685fd9687-cchl5"]
Apr 24 21:17:41.109439 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:17:41.109412    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3739a2e1_6c42_441b_bd94_b1d8e8538050.slice/crio-820af2ed167301b2f88e4b42166ee0741cc0bf1cef1d81c4161f0eab877bfd70 WatchSource:0}: Error finding container 820af2ed167301b2f88e4b42166ee0741cc0bf1cef1d81c4161f0eab877bfd70: Status 404 returned error can't find the container with id 820af2ed167301b2f88e4b42166ee0741cc0bf1cef1d81c4161f0eab877bfd70
Apr 24 21:17:41.312796 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:41.312764    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe592f7-616c-4382-b3e8-284718f95d30","Type":"ContainerStarted","Data":"6922b3d521c109b64f81fdf6537270aa5a979062710beedab9f27fc29450bd0f"}
Apr 24 21:17:41.312907 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:41.312806    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe592f7-616c-4382-b3e8-284718f95d30","Type":"ContainerStarted","Data":"d2f0b66492098ee9c9ca9d15a3a7274d0401913fab4ec6a923df61138adc0997"}
Apr 24 21:17:41.312907 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:41.312821    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe592f7-616c-4382-b3e8-284718f95d30","Type":"ContainerStarted","Data":"958e43b0e6216eaf6a8ebb6e452bce62844e62c8005ea9582ea8b68ea272a307"}
Apr 24 21:17:41.312907 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:41.312834    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe592f7-616c-4382-b3e8-284718f95d30","Type":"ContainerStarted","Data":"6675914de70372f7e0d8e566c6ed8870f7a69d2eece1c7a43e8fc9668d2b2ffc"}
Apr 24 21:17:41.312907 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:41.312846    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe592f7-616c-4382-b3e8-284718f95d30","Type":"ContainerStarted","Data":"cad0873dc83da88989b3ed42449b1a500ee3602ccfd8e7167860eeebd85baa96"}
Apr 24 21:17:41.314452 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:41.314417    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6685fd9687-cchl5" event={"ID":"3739a2e1-6c42-441b-bd94-b1d8e8538050","Type":"ContainerStarted","Data":"06b3048288970615661408942d35a86671b277a08fbf9b7e96698380ba485e5e"}
Apr 24 21:17:41.314563 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:41.314471    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6685fd9687-cchl5" event={"ID":"3739a2e1-6c42-441b-bd94-b1d8e8538050","Type":"ContainerStarted","Data":"820af2ed167301b2f88e4b42166ee0741cc0bf1cef1d81c4161f0eab877bfd70"}
Apr 24 21:17:41.319138 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:41.319077    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh" event={"ID":"1e7fe9e3-f045-4684-a90a-a332ae16b229","Type":"ContainerStarted","Data":"2c6fb6a14ddb6b8be9eaccf2dd5e5b7021c48732ddfe9ab34a0e5c87034204b5"}
Apr 24 21:17:41.319138 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:41.319107    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh" event={"ID":"1e7fe9e3-f045-4684-a90a-a332ae16b229","Type":"ContainerStarted","Data":"6e9f3fe13ecad4d02c278a9cdaf534be46cb31aad2fab7747d8c182252855739"}
Apr 24 21:17:41.319138 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:41.319120    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh" event={"ID":"1e7fe9e3-f045-4684-a90a-a332ae16b229","Type":"ContainerStarted","Data":"fce8117d5ad0bb1683efbedbc973752c36ad72142ae07cd2f0acf8981619f20f"}
Apr 24 21:17:41.319405 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:41.319282    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:41.471089 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:41.471038    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6685fd9687-cchl5" podStartSLOduration=1.471021288 podStartE2EDuration="1.471021288s" podCreationTimestamp="2026-04-24 21:17:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:17:41.446589839 +0000 UTC m=+54.066046474" watchObservedRunningTime="2026-04-24 21:17:41.471021288 +0000 UTC m=+54.090477892"
Apr 24 21:17:41.661713 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:41.661637    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh" podStartSLOduration=5.402488373 podStartE2EDuration="11.661617521s" podCreationTimestamp="2026-04-24 21:17:30 +0000 UTC" firstStartedPulling="2026-04-24 21:17:34.064355642 +0000 UTC m=+46.683812262" lastFinishedPulling="2026-04-24 21:17:40.323484801 +0000 UTC m=+52.942941410" observedRunningTime="2026-04-24 21:17:41.6592145 +0000 UTC m=+54.278671125" watchObservedRunningTime="2026-04-24 21:17:41.661617521 +0000 UTC m=+54.281074148"
Apr 24 21:17:42.326690 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:42.326650    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe592f7-616c-4382-b3e8-284718f95d30","Type":"ContainerStarted","Data":"9e50849361c4c27dd519fc8cf4ec675befede99818b23c8eb10e43983d35ab71"}
Apr 24 21:17:42.392646 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:42.392368    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.4903930899999995 podStartE2EDuration="14.392348386s" podCreationTimestamp="2026-04-24 21:17:28 +0000 UTC" firstStartedPulling="2026-04-24 21:17:33.971350551 +0000 UTC m=+46.590807161" lastFinishedPulling="2026-04-24 21:17:40.873305852 +0000 UTC m=+53.492762457" observedRunningTime="2026-04-24 21:17:42.389423388 +0000 UTC m=+55.008880016" watchObservedRunningTime="2026-04-24 21:17:42.392348386 +0000 UTC m=+55.011805013"
Apr 24 21:17:43.331903 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:43.331873    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"90e76aa8-68aa-4a31-86df-00197ce187b3","Type":"ContainerStarted","Data":"3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675"}
Apr 24 21:17:43.331903 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:43.331908    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"90e76aa8-68aa-4a31-86df-00197ce187b3","Type":"ContainerStarted","Data":"de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2"}
Apr 24 21:17:43.332292 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:43.331919    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"90e76aa8-68aa-4a31-86df-00197ce187b3","Type":"ContainerStarted","Data":"7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b"}
Apr 24 21:17:43.332292 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:43.331928    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"90e76aa8-68aa-4a31-86df-00197ce187b3","Type":"ContainerStarted","Data":"42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741"}
Apr 24 21:17:43.332292 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:43.331939    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"90e76aa8-68aa-4a31-86df-00197ce187b3","Type":"ContainerStarted","Data":"01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48"}
Apr 24 21:17:43.332292 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:43.331948    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"90e76aa8-68aa-4a31-86df-00197ce187b3","Type":"ContainerStarted","Data":"ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92"}
Apr 24 21:17:43.392992 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:43.392924    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.179474191 podStartE2EDuration="10.392910476s" podCreationTimestamp="2026-04-24 21:17:33 +0000 UTC" firstStartedPulling="2026-04-24 21:17:34.180726526 +0000 UTC m=+46.800183129" lastFinishedPulling="2026-04-24 21:17:42.394162808 +0000 UTC m=+55.013619414" observedRunningTime="2026-04-24 21:17:43.392132506 +0000 UTC m=+56.011589130" watchObservedRunningTime="2026-04-24 21:17:43.392910476 +0000 UTC m=+56.012367109"
Apr 24 21:17:43.960341 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:43.960313    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:17:44.128301 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:44.128272    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:17:44.180203 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:44.180180    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5595d687-bktl2"
Apr 24 21:17:47.161021 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:47.160988    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nxnnq"
Apr 24 21:17:47.332784 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:47.332756    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7d86fc6796-gc8qh"
Apr 24 21:17:50.921839 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:50.921802    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:50.922231 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:50.921850    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:50.926452 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:50.926430    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:51.360116 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:51.360031    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:17:52.207393 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:52.207345    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:52.207779 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:52.207417    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:17:52.590377 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:52.590300    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs\") pod \"network-metrics-daemon-v4zl5\" (UID: \"b2e03e73-fa77-4421-b99b-67c0205f5b37\") " pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:17:52.593394 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:52.593366    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Apr 24 21:17:52.603606 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:52.603578    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2e03e73-fa77-4421-b99b-67c0205f5b37-metrics-certs\") pod \"network-metrics-daemon-v4zl5\" (UID: \"b2e03e73-fa77-4421-b99b-67c0205f5b37\") " pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:17:52.772547 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:52.772519    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8v42p\""
Apr 24 21:17:52.780680 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:52.780656    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4zl5"
Apr 24 21:17:52.791845 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:52.791805    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9f7wm\" (UniqueName: \"kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm\") pod \"network-check-target-76jvz\" (UID: \"d3357c66-9444-4360-a1f9-e8317c53e78d\") " pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:17:52.794752 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:52.794729    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Apr 24 21:17:52.804806 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:52.804782    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Apr 24 21:17:52.816223 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:52.816199    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f7wm\" (UniqueName: \"kubernetes.io/projected/d3357c66-9444-4360-a1f9-e8317c53e78d-kube-api-access-9f7wm\") pod \"network-check-target-76jvz\" (UID: \"d3357c66-9444-4360-a1f9-e8317c53e78d\") " pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:17:52.911674 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:52.911649    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v4zl5"]
Apr 24 21:17:52.914308 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:17:52.914279    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e03e73_fa77_4421_b99b_67c0205f5b37.slice/crio-623649accaaf3d30216badb6c642a2f38483b1f90ce73c6eec2c712dbf908135 WatchSource:0}: Error finding container 623649accaaf3d30216badb6c642a2f38483b1f90ce73c6eec2c712dbf908135: Status 404 returned error can't find the container with id 623649accaaf3d30216badb6c642a2f38483b1f90ce73c6eec2c712dbf908135
Apr 24 21:17:53.087537 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:53.087510    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dd9qw\""
Apr 24 21:17:53.095842 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:53.095820    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:17:53.363477 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:53.363427    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v4zl5" event={"ID":"b2e03e73-fa77-4421-b99b-67c0205f5b37","Type":"ContainerStarted","Data":"623649accaaf3d30216badb6c642a2f38483b1f90ce73c6eec2c712dbf908135"}
Apr 24 21:17:53.421874 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:53.421811    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-76jvz"]
Apr 24 21:17:53.423990 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:17:53.423962    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3357c66_9444_4360_a1f9_e8317c53e78d.slice/crio-fbd14e794d0815516c3f35d65c1d08b0398c07707d20401d2fe13c81b422356b WatchSource:0}: Error finding container fbd14e794d0815516c3f35d65c1d08b0398c07707d20401d2fe13c81b422356b: Status 404 returned error can't find the container with id fbd14e794d0815516c3f35d65c1d08b0398c07707d20401d2fe13c81b422356b
Apr 24 21:17:54.369108 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:54.369062    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-76jvz" event={"ID":"d3357c66-9444-4360-a1f9-e8317c53e78d","Type":"ContainerStarted","Data":"fbd14e794d0815516c3f35d65c1d08b0398c07707d20401d2fe13c81b422356b"}
Apr 24 21:17:55.374046 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:55.374008    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v4zl5" event={"ID":"b2e03e73-fa77-4421-b99b-67c0205f5b37","Type":"ContainerStarted","Data":"3f5d4f2045486110248942b8c7934dae46ce7179dd38580620cdd6d113ad6f41"}
Apr 24 21:17:55.374046 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:55.374051    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v4zl5" event={"ID":"b2e03e73-fa77-4421-b99b-67c0205f5b37","Type":"ContainerStarted","Data":"5b48d08cae142f5021d4a2ffd219e7ba690f0c4d8a17dc2545b235ca7f52e396"}
Apr 24 21:17:55.392987 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:55.392940    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v4zl5" podStartSLOduration=66.887839105 podStartE2EDuration="1m8.392922378s" podCreationTimestamp="2026-04-24 21:16:47 +0000 UTC" firstStartedPulling="2026-04-24 21:17:52.918716336 +0000 UTC m=+65.538172939" lastFinishedPulling="2026-04-24 21:17:54.423799607 +0000 UTC m=+67.043256212" observedRunningTime="2026-04-24 21:17:55.390347352 +0000 UTC m=+68.009803981" watchObservedRunningTime="2026-04-24 21:17:55.392922378 +0000 UTC m=+68.012379004"
Apr 24 21:17:57.382969 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:57.382930    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-76jvz" event={"ID":"d3357c66-9444-4360-a1f9-e8317c53e78d","Type":"ContainerStarted","Data":"d44d1b8aaf190bca5b6785f7166e2679316218b1973d24fdfce1889123f758be"}
Apr 24 21:17:57.383343 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:57.382997    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:17:57.400556 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:57.400510    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-76jvz" podStartSLOduration=66.162885581 podStartE2EDuration="1m9.400495862s" podCreationTimestamp="2026-04-24 21:16:48 +0000 UTC" firstStartedPulling="2026-04-24 21:17:53.425851686 +0000 UTC m=+66.045308289" lastFinishedPulling="2026-04-24 21:17:56.663461954 +0000 UTC m=+69.282918570" observedRunningTime="2026-04-24 21:17:57.399287037 +0000 UTC m=+70.018743673" watchObservedRunningTime="2026-04-24 21:17:57.400495862 +0000 UTC m=+70.019952488"
Apr 24 21:17:59.277021 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.276974    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7b6d476f45-d7jzl" podUID="b0803663-ccce-442d-8b7d-c15efe642b15" containerName="console" containerID="cri-o://c88e7aadce8e9b0b92e423e912eb67d3acf2b1439300079458235ba945fce8ff" gracePeriod=15
Apr 24 21:17:59.541559 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.541538    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b6d476f45-d7jzl_b0803663-ccce-442d-8b7d-c15efe642b15/console/0.log"
Apr 24 21:17:59.541667 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.541608    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:17:59.659856 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.659824    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-trusted-ca-bundle\") pod \"b0803663-ccce-442d-8b7d-c15efe642b15\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") "
Apr 24 21:17:59.659856 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.659855    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-console-config\") pod \"b0803663-ccce-442d-8b7d-c15efe642b15\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") "
Apr 24 21:17:59.660075 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.659883    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0803663-ccce-442d-8b7d-c15efe642b15-console-oauth-config\") pod \"b0803663-ccce-442d-8b7d-c15efe642b15\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") "
Apr 24 21:17:59.660075 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.659904    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-oauth-serving-cert\") pod \"b0803663-ccce-442d-8b7d-c15efe642b15\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") "
Apr 24 21:17:59.660075 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.659948    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-service-ca\") pod \"b0803663-ccce-442d-8b7d-c15efe642b15\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") "
Apr 24 21:17:59.660075 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.659987    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-przl9\" (UniqueName: \"kubernetes.io/projected/b0803663-ccce-442d-8b7d-c15efe642b15-kube-api-access-przl9\") pod \"b0803663-ccce-442d-8b7d-c15efe642b15\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") "
Apr 24 21:17:59.660075 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.660024    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0803663-ccce-442d-8b7d-c15efe642b15-console-serving-cert\") pod \"b0803663-ccce-442d-8b7d-c15efe642b15\" (UID: \"b0803663-ccce-442d-8b7d-c15efe642b15\") "
Apr 24 21:17:59.660257 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.660227    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-console-config" (OuterVolumeSpecName: "console-config") pod "b0803663-ccce-442d-8b7d-c15efe642b15" (UID: "b0803663-ccce-442d-8b7d-c15efe642b15"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 24 21:17:59.660462 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.660436    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-console-config\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:17:59.660592 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.660543    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b0803663-ccce-442d-8b7d-c15efe642b15" (UID: "b0803663-ccce-442d-8b7d-c15efe642b15"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 24 21:17:59.660592 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.660565    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b0803663-ccce-442d-8b7d-c15efe642b15" (UID: "b0803663-ccce-442d-8b7d-c15efe642b15"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 24 21:17:59.660592 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.660579    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-service-ca" (OuterVolumeSpecName: "service-ca") pod "b0803663-ccce-442d-8b7d-c15efe642b15" (UID: "b0803663-ccce-442d-8b7d-c15efe642b15"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 24 21:17:59.662247 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.662221    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0803663-ccce-442d-8b7d-c15efe642b15-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b0803663-ccce-442d-8b7d-c15efe642b15" (UID: "b0803663-ccce-442d-8b7d-c15efe642b15"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:17:59.662342 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.662312    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0803663-ccce-442d-8b7d-c15efe642b15-kube-api-access-przl9" (OuterVolumeSpecName: "kube-api-access-przl9") pod "b0803663-ccce-442d-8b7d-c15efe642b15" (UID: "b0803663-ccce-442d-8b7d-c15efe642b15"). InnerVolumeSpecName "kube-api-access-przl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Apr 24 21:17:59.662410 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.662312    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0803663-ccce-442d-8b7d-c15efe642b15-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b0803663-ccce-442d-8b7d-c15efe642b15" (UID: "b0803663-ccce-442d-8b7d-c15efe642b15"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:17:59.761321 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.761294    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0803663-ccce-442d-8b7d-c15efe642b15-console-serving-cert\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:17:59.761321 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.761317    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-trusted-ca-bundle\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:17:59.761321 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.761326    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0803663-ccce-442d-8b7d-c15efe642b15-console-oauth-config\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:17:59.761520 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.761335    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-oauth-serving-cert\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:17:59.761520 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.761350    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0803663-ccce-442d-8b7d-c15efe642b15-service-ca\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:17:59.761520 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:17:59.761361    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-przl9\" (UniqueName: \"kubernetes.io/projected/b0803663-ccce-442d-8b7d-c15efe642b15-kube-api-access-przl9\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:00.394349 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:00.394325    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b6d476f45-d7jzl_b0803663-ccce-442d-8b7d-c15efe642b15/console/0.log"
Apr 24 21:18:00.394729 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:00.394366    2569 generic.go:358] "Generic (PLEG): container finished" podID="b0803663-ccce-442d-8b7d-c15efe642b15" containerID="c88e7aadce8e9b0b92e423e912eb67d3acf2b1439300079458235ba945fce8ff" exitCode=2
Apr 24 21:18:00.394729 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:00.394409    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6d476f45-d7jzl" event={"ID":"b0803663-ccce-442d-8b7d-c15efe642b15","Type":"ContainerDied","Data":"c88e7aadce8e9b0b92e423e912eb67d3acf2b1439300079458235ba945fce8ff"}
Apr 24 21:18:00.394729 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:00.394451    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6d476f45-d7jzl" event={"ID":"b0803663-ccce-442d-8b7d-c15efe642b15","Type":"ContainerDied","Data":"e31216b0adaf9d5d620b565dc6215cd8734cf2cab81f93232fdeffe051021628"}
Apr 24 21:18:00.394729 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:00.394453    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6d476f45-d7jzl"
Apr 24 21:18:00.394729 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:00.394467    2569 scope.go:117] "RemoveContainer" containerID="c88e7aadce8e9b0b92e423e912eb67d3acf2b1439300079458235ba945fce8ff"
Apr 24 21:18:00.403156 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:00.403136    2569 scope.go:117] "RemoveContainer" containerID="c88e7aadce8e9b0b92e423e912eb67d3acf2b1439300079458235ba945fce8ff"
Apr 24 21:18:00.403451 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:18:00.403426    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c88e7aadce8e9b0b92e423e912eb67d3acf2b1439300079458235ba945fce8ff\": container with ID starting with c88e7aadce8e9b0b92e423e912eb67d3acf2b1439300079458235ba945fce8ff not found: ID does not exist" containerID="c88e7aadce8e9b0b92e423e912eb67d3acf2b1439300079458235ba945fce8ff"
Apr 24 21:18:00.403540 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:00.403456    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c88e7aadce8e9b0b92e423e912eb67d3acf2b1439300079458235ba945fce8ff"} err="failed to get container status \"c88e7aadce8e9b0b92e423e912eb67d3acf2b1439300079458235ba945fce8ff\": rpc error: code = NotFound desc = could not find container \"c88e7aadce8e9b0b92e423e912eb67d3acf2b1439300079458235ba945fce8ff\": container with ID starting with c88e7aadce8e9b0b92e423e912eb67d3acf2b1439300079458235ba945fce8ff not found: ID does not exist"
Apr 24 21:18:00.413810 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:00.413784    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b6d476f45-d7jzl"]
Apr 24 21:18:00.418602 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:00.418582    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b6d476f45-d7jzl"]
Apr 24 21:18:01.960879 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:01.960841    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0803663-ccce-442d-8b7d-c15efe642b15" path="/var/lib/kubelet/pods/b0803663-ccce-442d-8b7d-c15efe642b15/volumes"
Apr 24 21:18:05.521782 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:05.521743    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-b4fcd778d-6wgtb" podUID="6325b9b7-1c93-49c2-aff2-0242a7bfe6a1" containerName="console" containerID="cri-o://8923766aabf031ddd820b444b4e6e816a10aa013efe02b06975346513e0af4e5" gracePeriod=15
Apr 24 21:18:05.846954 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:05.846932    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b4fcd778d-6wgtb_6325b9b7-1c93-49c2-aff2-0242a7bfe6a1/console/0.log"
Apr 24 21:18:05.847074 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:05.846993    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:18:05.910695 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:05.910662    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-trusted-ca-bundle\") pod \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") "
Apr 24 21:18:05.910878 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:05.910709    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-oauth-serving-cert\") pod \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") "
Apr 24 21:18:05.910878 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:05.910773    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-console-config\") pod \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") "
Apr 24 21:18:05.910878 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:05.910814    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-console-oauth-config\") pod \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") "
Apr 24 21:18:05.910878 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:05.910875    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-service-ca\") pod \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") "
Apr 24 21:18:05.911087 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:05.910912    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2h2mq\" (UniqueName: \"kubernetes.io/projected/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-kube-api-access-2h2mq\") pod \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") "
Apr 24 21:18:05.911087 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:05.910950    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-console-serving-cert\") pod \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\" (UID: \"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1\") "
Apr 24 21:18:05.911236 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:05.911139    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6325b9b7-1c93-49c2-aff2-0242a7bfe6a1" (UID: "6325b9b7-1c93-49c2-aff2-0242a7bfe6a1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 24 21:18:05.911279 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:05.911175    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6325b9b7-1c93-49c2-aff2-0242a7bfe6a1" (UID: "6325b9b7-1c93-49c2-aff2-0242a7bfe6a1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 24 21:18:05.911279 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:05.911255    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-console-config" (OuterVolumeSpecName: "console-config") pod "6325b9b7-1c93-49c2-aff2-0242a7bfe6a1" (UID: "6325b9b7-1c93-49c2-aff2-0242a7bfe6a1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 24 21:18:05.911355 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:05.911310    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-service-ca" (OuterVolumeSpecName: "service-ca") pod "6325b9b7-1c93-49c2-aff2-0242a7bfe6a1" (UID: "6325b9b7-1c93-49c2-aff2-0242a7bfe6a1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 24 21:18:05.913185 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:05.913159    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-kube-api-access-2h2mq" (OuterVolumeSpecName: "kube-api-access-2h2mq") pod "6325b9b7-1c93-49c2-aff2-0242a7bfe6a1" (UID: "6325b9b7-1c93-49c2-aff2-0242a7bfe6a1"). InnerVolumeSpecName "kube-api-access-2h2mq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Apr 24 21:18:05.913282 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:05.913210    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6325b9b7-1c93-49c2-aff2-0242a7bfe6a1" (UID: "6325b9b7-1c93-49c2-aff2-0242a7bfe6a1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:18:05.913282 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:05.913269    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6325b9b7-1c93-49c2-aff2-0242a7bfe6a1" (UID: "6325b9b7-1c93-49c2-aff2-0242a7bfe6a1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:18:06.012453 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:06.012415    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-service-ca\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:06.012453 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:06.012447    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2h2mq\" (UniqueName: \"kubernetes.io/projected/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-kube-api-access-2h2mq\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:06.012453 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:06.012459    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-console-serving-cert\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:06.012672 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:06.012468    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-trusted-ca-bundle\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:06.012672 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:06.012476    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-oauth-serving-cert\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:06.012672 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:06.012485    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-console-config\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:06.012672 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:06.012494    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1-console-oauth-config\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:06.414698 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:06.414672    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b4fcd778d-6wgtb_6325b9b7-1c93-49c2-aff2-0242a7bfe6a1/console/0.log"
Apr 24 21:18:06.414865 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:06.414717    2569 generic.go:358] "Generic (PLEG): container finished" podID="6325b9b7-1c93-49c2-aff2-0242a7bfe6a1" containerID="8923766aabf031ddd820b444b4e6e816a10aa013efe02b06975346513e0af4e5" exitCode=2
Apr 24 21:18:06.414865 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:06.414748    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4fcd778d-6wgtb" event={"ID":"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1","Type":"ContainerDied","Data":"8923766aabf031ddd820b444b4e6e816a10aa013efe02b06975346513e0af4e5"}
Apr 24 21:18:06.414865 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:06.414779    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4fcd778d-6wgtb"
Apr 24 21:18:06.414865 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:06.414787    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4fcd778d-6wgtb" event={"ID":"6325b9b7-1c93-49c2-aff2-0242a7bfe6a1","Type":"ContainerDied","Data":"687fbde1a82c7d8b2397da6d181d86001af69bce78a64ccfe0608ff623d1db80"}
Apr 24 21:18:06.414865 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:06.414803    2569 scope.go:117] "RemoveContainer" containerID="8923766aabf031ddd820b444b4e6e816a10aa013efe02b06975346513e0af4e5"
Apr 24 21:18:06.422661 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:06.422644    2569 scope.go:117] "RemoveContainer" containerID="8923766aabf031ddd820b444b4e6e816a10aa013efe02b06975346513e0af4e5"
Apr 24 21:18:06.422949 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:18:06.422924    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8923766aabf031ddd820b444b4e6e816a10aa013efe02b06975346513e0af4e5\": container with ID starting with 8923766aabf031ddd820b444b4e6e816a10aa013efe02b06975346513e0af4e5 not found: ID does not exist" containerID="8923766aabf031ddd820b444b4e6e816a10aa013efe02b06975346513e0af4e5"
Apr 24 21:18:06.423057 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:06.422952    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8923766aabf031ddd820b444b4e6e816a10aa013efe02b06975346513e0af4e5"} err="failed to get container status \"8923766aabf031ddd820b444b4e6e816a10aa013efe02b06975346513e0af4e5\": rpc error: code = NotFound desc = could not find container \"8923766aabf031ddd820b444b4e6e816a10aa013efe02b06975346513e0af4e5\": container with ID starting with 8923766aabf031ddd820b444b4e6e816a10aa013efe02b06975346513e0af4e5 not found: ID does not exist"
Apr 24 21:18:06.439679 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:06.438608    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b4fcd778d-6wgtb"]
Apr 24 21:18:06.439679 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:06.438654    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b4fcd778d-6wgtb"]
Apr 24 21:18:07.959742 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:07.959703    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6325b9b7-1c93-49c2-aff2-0242a7bfe6a1" path="/var/lib/kubelet/pods/6325b9b7-1c93-49c2-aff2-0242a7bfe6a1/volumes"
Apr 24 21:18:12.211993 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:12.211955    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:18:12.215782 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:12.215760    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6fd764c9f6-wvdt6"
Apr 24 21:18:28.388059 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:28.388029    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-76jvz"
Apr 24 21:18:37.782776 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:37.782739    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:37.801671 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:37.801643    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:38.550020 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:38.549985    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:47.709862 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:47.709830    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Apr 24 21:18:47.710350 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:47.710297    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="alertmanager" containerID="cri-o://cad0873dc83da88989b3ed42449b1a500ee3602ccfd8e7167860eeebd85baa96" gracePeriod=120
Apr 24 21:18:47.710449 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:47.710360    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="kube-rbac-proxy-metric" containerID="cri-o://6922b3d521c109b64f81fdf6537270aa5a979062710beedab9f27fc29450bd0f" gracePeriod=120
Apr 24 21:18:47.710449 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:47.710417    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="kube-rbac-proxy-web" containerID="cri-o://958e43b0e6216eaf6a8ebb6e452bce62844e62c8005ea9582ea8b68ea272a307" gracePeriod=120
Apr 24 21:18:47.710449 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:47.710443    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="config-reloader" containerID="cri-o://6675914de70372f7e0d8e566c6ed8870f7a69d2eece1c7a43e8fc9668d2b2ffc" gracePeriod=120
Apr 24 21:18:47.710608 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:47.710447    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="kube-rbac-proxy" containerID="cri-o://d2f0b66492098ee9c9ca9d15a3a7274d0401913fab4ec6a923df61138adc0997" gracePeriod=120
Apr 24 21:18:47.710608 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:47.710420    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="prom-label-proxy" containerID="cri-o://9e50849361c4c27dd519fc8cf4ec675befede99818b23c8eb10e43983d35ab71" gracePeriod=120
Apr 24 21:18:48.566204 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:48.566165    2569 generic.go:358] "Generic (PLEG): container finished" podID="dbe592f7-616c-4382-b3e8-284718f95d30" containerID="9e50849361c4c27dd519fc8cf4ec675befede99818b23c8eb10e43983d35ab71" exitCode=0
Apr 24 21:18:48.566204 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:48.566196    2569 generic.go:358] "Generic (PLEG): container finished" podID="dbe592f7-616c-4382-b3e8-284718f95d30" containerID="6922b3d521c109b64f81fdf6537270aa5a979062710beedab9f27fc29450bd0f" exitCode=0
Apr 24 21:18:48.566204 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:48.566203    2569 generic.go:358] "Generic (PLEG): container finished" podID="dbe592f7-616c-4382-b3e8-284718f95d30" containerID="d2f0b66492098ee9c9ca9d15a3a7274d0401913fab4ec6a923df61138adc0997" exitCode=0
Apr 24 21:18:48.566204 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:48.566210    2569 generic.go:358] "Generic (PLEG): container finished" podID="dbe592f7-616c-4382-b3e8-284718f95d30" containerID="6675914de70372f7e0d8e566c6ed8870f7a69d2eece1c7a43e8fc9668d2b2ffc" exitCode=0
Apr 24 21:18:48.566204 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:48.566215    2569 generic.go:358] "Generic (PLEG): container finished" podID="dbe592f7-616c-4382-b3e8-284718f95d30" containerID="cad0873dc83da88989b3ed42449b1a500ee3602ccfd8e7167860eeebd85baa96" exitCode=0
Apr 24 21:18:48.566539 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:48.566239    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe592f7-616c-4382-b3e8-284718f95d30","Type":"ContainerDied","Data":"9e50849361c4c27dd519fc8cf4ec675befede99818b23c8eb10e43983d35ab71"}
Apr 24 21:18:48.566539 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:48.566275    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe592f7-616c-4382-b3e8-284718f95d30","Type":"ContainerDied","Data":"6922b3d521c109b64f81fdf6537270aa5a979062710beedab9f27fc29450bd0f"}
Apr 24 21:18:48.566539 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:48.566287    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe592f7-616c-4382-b3e8-284718f95d30","Type":"ContainerDied","Data":"d2f0b66492098ee9c9ca9d15a3a7274d0401913fab4ec6a923df61138adc0997"}
Apr 24 21:18:48.566539 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:48.566296    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe592f7-616c-4382-b3e8-284718f95d30","Type":"ContainerDied","Data":"6675914de70372f7e0d8e566c6ed8870f7a69d2eece1c7a43e8fc9668d2b2ffc"}
Apr 24 21:18:48.566539 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:48.566305    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe592f7-616c-4382-b3e8-284718f95d30","Type":"ContainerDied","Data":"cad0873dc83da88989b3ed42449b1a500ee3602ccfd8e7167860eeebd85baa96"}
Apr 24 21:18:48.984318 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:48.984285    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.081663 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.081580    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-config-volume\") pod \"dbe592f7-616c-4382-b3e8-284718f95d30\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") "
Apr 24 21:18:49.081663 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.081638    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-kube-rbac-proxy\") pod \"dbe592f7-616c-4382-b3e8-284718f95d30\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") "
Apr 24 21:18:49.081886 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.081677    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-main-tls\") pod \"dbe592f7-616c-4382-b3e8-284718f95d30\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") "
Apr 24 21:18:49.081886 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.081709    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-kube-rbac-proxy-metric\") pod \"dbe592f7-616c-4382-b3e8-284718f95d30\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") "
Apr 24 21:18:49.081886 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.081741    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbe592f7-616c-4382-b3e8-284718f95d30-metrics-client-ca\") pod \"dbe592f7-616c-4382-b3e8-284718f95d30\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") "
Apr 24 21:18:49.081886 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.081767    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcrcr\" (UniqueName: \"kubernetes.io/projected/dbe592f7-616c-4382-b3e8-284718f95d30-kube-api-access-qcrcr\") pod \"dbe592f7-616c-4382-b3e8-284718f95d30\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") "
Apr 24 21:18:49.081886 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.081813    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbe592f7-616c-4382-b3e8-284718f95d30-alertmanager-trusted-ca-bundle\") pod \"dbe592f7-616c-4382-b3e8-284718f95d30\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") "
Apr 24 21:18:49.081886 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.081843    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-cluster-tls-config\") pod \"dbe592f7-616c-4382-b3e8-284718f95d30\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") "
Apr 24 21:18:49.081886 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.081880    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-web-config\") pod \"dbe592f7-616c-4382-b3e8-284718f95d30\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") "
Apr 24 21:18:49.082240 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.081906    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-kube-rbac-proxy-web\") pod \"dbe592f7-616c-4382-b3e8-284718f95d30\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") "
Apr 24 21:18:49.082240 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.081943    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbe592f7-616c-4382-b3e8-284718f95d30-alertmanager-main-db\") pod \"dbe592f7-616c-4382-b3e8-284718f95d30\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") "
Apr 24 21:18:49.082240 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.081967    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbe592f7-616c-4382-b3e8-284718f95d30-config-out\") pod \"dbe592f7-616c-4382-b3e8-284718f95d30\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") "
Apr 24 21:18:49.082240 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.081992    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbe592f7-616c-4382-b3e8-284718f95d30-tls-assets\") pod \"dbe592f7-616c-4382-b3e8-284718f95d30\" (UID: \"dbe592f7-616c-4382-b3e8-284718f95d30\") "
Apr 24 21:18:49.082240 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.082127    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbe592f7-616c-4382-b3e8-284718f95d30-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "dbe592f7-616c-4382-b3e8-284718f95d30" (UID: "dbe592f7-616c-4382-b3e8-284718f95d30"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 24 21:18:49.082514 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.082337    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbe592f7-616c-4382-b3e8-284718f95d30-metrics-client-ca\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:49.082780 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.082729    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbe592f7-616c-4382-b3e8-284718f95d30-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "dbe592f7-616c-4382-b3e8-284718f95d30" (UID: "dbe592f7-616c-4382-b3e8-284718f95d30"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:18:49.083273 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.083146    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbe592f7-616c-4382-b3e8-284718f95d30-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "dbe592f7-616c-4382-b3e8-284718f95d30" (UID: "dbe592f7-616c-4382-b3e8-284718f95d30"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 24 21:18:49.084922 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.084894    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "dbe592f7-616c-4382-b3e8-284718f95d30" (UID: "dbe592f7-616c-4382-b3e8-284718f95d30"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:18:49.085060 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.085035    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "dbe592f7-616c-4382-b3e8-284718f95d30" (UID: "dbe592f7-616c-4382-b3e8-284718f95d30"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:18:49.085169 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.085146    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "dbe592f7-616c-4382-b3e8-284718f95d30" (UID: "dbe592f7-616c-4382-b3e8-284718f95d30"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:18:49.085358 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.085334    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbe592f7-616c-4382-b3e8-284718f95d30-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dbe592f7-616c-4382-b3e8-284718f95d30" (UID: "dbe592f7-616c-4382-b3e8-284718f95d30"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Apr 24 21:18:49.085476 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.085429    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbe592f7-616c-4382-b3e8-284718f95d30-config-out" (OuterVolumeSpecName: "config-out") pod "dbe592f7-616c-4382-b3e8-284718f95d30" (UID: "dbe592f7-616c-4382-b3e8-284718f95d30"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:18:49.085785 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.085766    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbe592f7-616c-4382-b3e8-284718f95d30-kube-api-access-qcrcr" (OuterVolumeSpecName: "kube-api-access-qcrcr") pod "dbe592f7-616c-4382-b3e8-284718f95d30" (UID: "dbe592f7-616c-4382-b3e8-284718f95d30"). InnerVolumeSpecName "kube-api-access-qcrcr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Apr 24 21:18:49.086055 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.086038    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-config-volume" (OuterVolumeSpecName: "config-volume") pod "dbe592f7-616c-4382-b3e8-284718f95d30" (UID: "dbe592f7-616c-4382-b3e8-284718f95d30"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:18:49.086565 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.086541    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "dbe592f7-616c-4382-b3e8-284718f95d30" (UID: "dbe592f7-616c-4382-b3e8-284718f95d30"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:18:49.089994 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.089968    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "dbe592f7-616c-4382-b3e8-284718f95d30" (UID: "dbe592f7-616c-4382-b3e8-284718f95d30"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:18:49.097623 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.097595    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-web-config" (OuterVolumeSpecName: "web-config") pod "dbe592f7-616c-4382-b3e8-284718f95d30" (UID: "dbe592f7-616c-4382-b3e8-284718f95d30"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:18:49.182886 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.182837    2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbe592f7-616c-4382-b3e8-284718f95d30-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:49.182886 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.182888    2569 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-cluster-tls-config\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:49.183100 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.182922    2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-web-config\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:49.183100 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.182934    2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:49.183100 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.182943    2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbe592f7-616c-4382-b3e8-284718f95d30-alertmanager-main-db\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:49.183100 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.182954    2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbe592f7-616c-4382-b3e8-284718f95d30-config-out\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:49.183100 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.182963    2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbe592f7-616c-4382-b3e8-284718f95d30-tls-assets\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:49.183100 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.182971    2569 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-config-volume\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:49.183100 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.182981    2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:49.183100 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.182990    2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-main-tls\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:49.183100 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.183001    2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbe592f7-616c-4382-b3e8-284718f95d30-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:49.183100 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.183010    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcrcr\" (UniqueName: \"kubernetes.io/projected/dbe592f7-616c-4382-b3e8-284718f95d30-kube-api-access-qcrcr\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:49.572122 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.572084    2569 generic.go:358] "Generic (PLEG): container finished" podID="dbe592f7-616c-4382-b3e8-284718f95d30" containerID="958e43b0e6216eaf6a8ebb6e452bce62844e62c8005ea9582ea8b68ea272a307" exitCode=0
Apr 24 21:18:49.572326 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.572160    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe592f7-616c-4382-b3e8-284718f95d30","Type":"ContainerDied","Data":"958e43b0e6216eaf6a8ebb6e452bce62844e62c8005ea9582ea8b68ea272a307"}
Apr 24 21:18:49.572326 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.572211    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbe592f7-616c-4382-b3e8-284718f95d30","Type":"ContainerDied","Data":"62450b5df0cda24671e9466df1daa48f2890a69fd8548a1ce95665ea3888417b"}
Apr 24 21:18:49.572326 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.572213    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.572326 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.572268    2569 scope.go:117] "RemoveContainer" containerID="9e50849361c4c27dd519fc8cf4ec675befede99818b23c8eb10e43983d35ab71"
Apr 24 21:18:49.579978 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.579958    2569 scope.go:117] "RemoveContainer" containerID="6922b3d521c109b64f81fdf6537270aa5a979062710beedab9f27fc29450bd0f"
Apr 24 21:18:49.586886 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.586859    2569 scope.go:117] "RemoveContainer" containerID="d2f0b66492098ee9c9ca9d15a3a7274d0401913fab4ec6a923df61138adc0997"
Apr 24 21:18:49.593882 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.593860    2569 scope.go:117] "RemoveContainer" containerID="958e43b0e6216eaf6a8ebb6e452bce62844e62c8005ea9582ea8b68ea272a307"
Apr 24 21:18:49.595193 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.595172    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Apr 24 21:18:49.599082 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.599062    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Apr 24 21:18:49.601581 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.601566    2569 scope.go:117] "RemoveContainer" containerID="6675914de70372f7e0d8e566c6ed8870f7a69d2eece1c7a43e8fc9668d2b2ffc"
Apr 24 21:18:49.608162 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.608144    2569 scope.go:117] "RemoveContainer" containerID="cad0873dc83da88989b3ed42449b1a500ee3602ccfd8e7167860eeebd85baa96"
Apr 24 21:18:49.615129 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.615101    2569 scope.go:117] "RemoveContainer" containerID="9e60ebc0f1379a215496f4a566fca3df911b60c4a24936ad87b5e50020ae8603"
Apr 24 21:18:49.621907 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.621719    2569 scope.go:117] "RemoveContainer" containerID="9e50849361c4c27dd519fc8cf4ec675befede99818b23c8eb10e43983d35ab71"
Apr 24 21:18:49.622100 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:18:49.622078    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e50849361c4c27dd519fc8cf4ec675befede99818b23c8eb10e43983d35ab71\": container with ID starting with 9e50849361c4c27dd519fc8cf4ec675befede99818b23c8eb10e43983d35ab71 not found: ID does not exist" containerID="9e50849361c4c27dd519fc8cf4ec675befede99818b23c8eb10e43983d35ab71"
Apr 24 21:18:49.622188 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.622112    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e50849361c4c27dd519fc8cf4ec675befede99818b23c8eb10e43983d35ab71"} err="failed to get container status \"9e50849361c4c27dd519fc8cf4ec675befede99818b23c8eb10e43983d35ab71\": rpc error: code = NotFound desc = could not find container \"9e50849361c4c27dd519fc8cf4ec675befede99818b23c8eb10e43983d35ab71\": container with ID starting with 9e50849361c4c27dd519fc8cf4ec675befede99818b23c8eb10e43983d35ab71 not found: ID does not exist"
Apr 24 21:18:49.622188 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.622138    2569 scope.go:117] "RemoveContainer" containerID="6922b3d521c109b64f81fdf6537270aa5a979062710beedab9f27fc29450bd0f"
Apr 24 21:18:49.622429 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:18:49.622402    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6922b3d521c109b64f81fdf6537270aa5a979062710beedab9f27fc29450bd0f\": container with ID starting with 6922b3d521c109b64f81fdf6537270aa5a979062710beedab9f27fc29450bd0f not found: ID does not exist" containerID="6922b3d521c109b64f81fdf6537270aa5a979062710beedab9f27fc29450bd0f"
Apr 24 21:18:49.622500 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.622433    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6922b3d521c109b64f81fdf6537270aa5a979062710beedab9f27fc29450bd0f"} err="failed to get container status \"6922b3d521c109b64f81fdf6537270aa5a979062710beedab9f27fc29450bd0f\": rpc error: code = NotFound desc = could not find container \"6922b3d521c109b64f81fdf6537270aa5a979062710beedab9f27fc29450bd0f\": container with ID starting with 6922b3d521c109b64f81fdf6537270aa5a979062710beedab9f27fc29450bd0f not found: ID does not exist"
Apr 24 21:18:49.622500 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.622453    2569 scope.go:117] "RemoveContainer" containerID="d2f0b66492098ee9c9ca9d15a3a7274d0401913fab4ec6a923df61138adc0997"
Apr 24 21:18:49.622754 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:18:49.622728    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2f0b66492098ee9c9ca9d15a3a7274d0401913fab4ec6a923df61138adc0997\": container with ID starting with d2f0b66492098ee9c9ca9d15a3a7274d0401913fab4ec6a923df61138adc0997 not found: ID does not exist" containerID="d2f0b66492098ee9c9ca9d15a3a7274d0401913fab4ec6a923df61138adc0997"
Apr 24 21:18:49.622836 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.622768    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2f0b66492098ee9c9ca9d15a3a7274d0401913fab4ec6a923df61138adc0997"} err="failed to get container status \"d2f0b66492098ee9c9ca9d15a3a7274d0401913fab4ec6a923df61138adc0997\": rpc error: code = NotFound desc = could not find container \"d2f0b66492098ee9c9ca9d15a3a7274d0401913fab4ec6a923df61138adc0997\": container with ID starting with d2f0b66492098ee9c9ca9d15a3a7274d0401913fab4ec6a923df61138adc0997 not found: ID does not exist"
Apr 24 21:18:49.622836 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.622787    2569 scope.go:117] "RemoveContainer" containerID="958e43b0e6216eaf6a8ebb6e452bce62844e62c8005ea9582ea8b68ea272a307"
Apr 24 21:18:49.623037 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:18:49.623012    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"958e43b0e6216eaf6a8ebb6e452bce62844e62c8005ea9582ea8b68ea272a307\": container with ID starting with 958e43b0e6216eaf6a8ebb6e452bce62844e62c8005ea9582ea8b68ea272a307 not found: ID does not exist" containerID="958e43b0e6216eaf6a8ebb6e452bce62844e62c8005ea9582ea8b68ea272a307"
Apr 24 21:18:49.623143 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.623040    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"958e43b0e6216eaf6a8ebb6e452bce62844e62c8005ea9582ea8b68ea272a307"} err="failed to get container status \"958e43b0e6216eaf6a8ebb6e452bce62844e62c8005ea9582ea8b68ea272a307\": rpc error: code = NotFound desc = could not find container \"958e43b0e6216eaf6a8ebb6e452bce62844e62c8005ea9582ea8b68ea272a307\": container with ID starting with 958e43b0e6216eaf6a8ebb6e452bce62844e62c8005ea9582ea8b68ea272a307 not found: ID does not exist"
Apr 24 21:18:49.623143 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.623060    2569 scope.go:117] "RemoveContainer" containerID="6675914de70372f7e0d8e566c6ed8870f7a69d2eece1c7a43e8fc9668d2b2ffc"
Apr 24 21:18:49.623329 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:18:49.623311    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6675914de70372f7e0d8e566c6ed8870f7a69d2eece1c7a43e8fc9668d2b2ffc\": container with ID starting with 6675914de70372f7e0d8e566c6ed8870f7a69d2eece1c7a43e8fc9668d2b2ffc not found: ID does not exist" containerID="6675914de70372f7e0d8e566c6ed8870f7a69d2eece1c7a43e8fc9668d2b2ffc"
Apr 24 21:18:49.623409 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.623333    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6675914de70372f7e0d8e566c6ed8870f7a69d2eece1c7a43e8fc9668d2b2ffc"} err="failed to get container status \"6675914de70372f7e0d8e566c6ed8870f7a69d2eece1c7a43e8fc9668d2b2ffc\": rpc error: code = NotFound desc = could not find container \"6675914de70372f7e0d8e566c6ed8870f7a69d2eece1c7a43e8fc9668d2b2ffc\": container with ID starting with 6675914de70372f7e0d8e566c6ed8870f7a69d2eece1c7a43e8fc9668d2b2ffc not found: ID does not exist"
Apr 24 21:18:49.623409 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.623347    2569 scope.go:117] "RemoveContainer" containerID="cad0873dc83da88989b3ed42449b1a500ee3602ccfd8e7167860eeebd85baa96"
Apr 24 21:18:49.623674 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:18:49.623647    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cad0873dc83da88989b3ed42449b1a500ee3602ccfd8e7167860eeebd85baa96\": container with ID starting with cad0873dc83da88989b3ed42449b1a500ee3602ccfd8e7167860eeebd85baa96 not found: ID does not exist" containerID="cad0873dc83da88989b3ed42449b1a500ee3602ccfd8e7167860eeebd85baa96"
Apr 24 21:18:49.623762 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.623678    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cad0873dc83da88989b3ed42449b1a500ee3602ccfd8e7167860eeebd85baa96"} err="failed to get container status \"cad0873dc83da88989b3ed42449b1a500ee3602ccfd8e7167860eeebd85baa96\": rpc error: code = NotFound desc = could not find container \"cad0873dc83da88989b3ed42449b1a500ee3602ccfd8e7167860eeebd85baa96\": container with ID starting with cad0873dc83da88989b3ed42449b1a500ee3602ccfd8e7167860eeebd85baa96 not found: ID does not exist"
Apr 24 21:18:49.623762 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.623698    2569 scope.go:117] "RemoveContainer" containerID="9e60ebc0f1379a215496f4a566fca3df911b60c4a24936ad87b5e50020ae8603"
Apr 24 21:18:49.623978 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:18:49.623956    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e60ebc0f1379a215496f4a566fca3df911b60c4a24936ad87b5e50020ae8603\": container with ID starting with 9e60ebc0f1379a215496f4a566fca3df911b60c4a24936ad87b5e50020ae8603 not found: ID does not exist" containerID="9e60ebc0f1379a215496f4a566fca3df911b60c4a24936ad87b5e50020ae8603"
Apr 24 21:18:49.624023 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.623985    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e60ebc0f1379a215496f4a566fca3df911b60c4a24936ad87b5e50020ae8603"} err="failed to get container status \"9e60ebc0f1379a215496f4a566fca3df911b60c4a24936ad87b5e50020ae8603\": rpc error: code = NotFound desc = could not find container \"9e60ebc0f1379a215496f4a566fca3df911b60c4a24936ad87b5e50020ae8603\": container with ID starting with 9e60ebc0f1379a215496f4a566fca3df911b60c4a24936ad87b5e50020ae8603 not found: ID does not exist"
Apr 24 21:18:49.624205 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624187    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Apr 24 21:18:49.624613 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624595    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="kube-rbac-proxy-metric"
Apr 24 21:18:49.624671 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624614    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="kube-rbac-proxy-metric"
Apr 24 21:18:49.624671 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624622    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0803663-ccce-442d-8b7d-c15efe642b15" containerName="console"
Apr 24 21:18:49.624671 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624628    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0803663-ccce-442d-8b7d-c15efe642b15" containerName="console"
Apr 24 21:18:49.624671 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624635    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6325b9b7-1c93-49c2-aff2-0242a7bfe6a1" containerName="console"
Apr 24 21:18:49.624671 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624640    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6325b9b7-1c93-49c2-aff2-0242a7bfe6a1" containerName="console"
Apr 24 21:18:49.624671 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624650    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="alertmanager"
Apr 24 21:18:49.624671 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624655    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="alertmanager"
Apr 24 21:18:49.624671 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624662    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="prom-label-proxy"
Apr 24 21:18:49.624671 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624667    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="prom-label-proxy"
Apr 24 21:18:49.624997 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624676    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="kube-rbac-proxy-web"
Apr 24 21:18:49.624997 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624682    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="kube-rbac-proxy-web"
Apr 24 21:18:49.624997 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624691    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="kube-rbac-proxy"
Apr 24 21:18:49.624997 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624696    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="kube-rbac-proxy"
Apr 24 21:18:49.624997 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624704    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="config-reloader"
Apr 24 21:18:49.624997 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624709    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="config-reloader"
Apr 24 21:18:49.624997 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624719    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="init-config-reloader"
Apr 24 21:18:49.624997 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624725    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="init-config-reloader"
Apr 24 21:18:49.624997 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624767    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="6325b9b7-1c93-49c2-aff2-0242a7bfe6a1" containerName="console"
Apr 24 21:18:49.624997 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624777    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="kube-rbac-proxy"
Apr 24 21:18:49.624997 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624785    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="kube-rbac-proxy-metric"
Apr 24 21:18:49.624997 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624797    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="alertmanager"
Apr 24 21:18:49.624997 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624804    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="config-reloader"
Apr 24 21:18:49.624997 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624810    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="prom-label-proxy"
Apr 24 21:18:49.624997 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624817    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" containerName="kube-rbac-proxy-web"
Apr 24 21:18:49.624997 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.624827    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0803663-ccce-442d-8b7d-c15efe642b15" containerName="console"
Apr 24 21:18:49.628329 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.628313    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.630455 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.630431    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Apr 24 21:18:49.630540 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.630456    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Apr 24 21:18:49.630540 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.630434    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Apr 24 21:18:49.630878 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.630751    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tjbks\""
Apr 24 21:18:49.630878 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.630763    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Apr 24 21:18:49.630878 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.630765    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Apr 24 21:18:49.630878 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.630783    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Apr 24 21:18:49.631100 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.630977    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Apr 24 21:18:49.631226 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.631210    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Apr 24 21:18:49.641910 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.641842    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Apr 24 21:18:49.645027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.645004    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Apr 24 21:18:49.789526 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.789494    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/419a3eec-3436-4906-b7c4-09159ce540e4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.789526 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.789528    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/419a3eec-3436-4906-b7c4-09159ce540e4-config-out\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.789767 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.789566    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/419a3eec-3436-4906-b7c4-09159ce540e4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.789767 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.789600    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/419a3eec-3436-4906-b7c4-09159ce540e4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.789767 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.789617    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/419a3eec-3436-4906-b7c4-09159ce540e4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.789767 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.789665    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/419a3eec-3436-4906-b7c4-09159ce540e4-web-config\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.789767 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.789713    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn4m2\" (UniqueName: \"kubernetes.io/projected/419a3eec-3436-4906-b7c4-09159ce540e4-kube-api-access-gn4m2\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.789767 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.789746    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/419a3eec-3436-4906-b7c4-09159ce540e4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.790029 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.789816    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/419a3eec-3436-4906-b7c4-09159ce540e4-config-volume\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.790029 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.789845    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/419a3eec-3436-4906-b7c4-09159ce540e4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.790029 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.789873    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/419a3eec-3436-4906-b7c4-09159ce540e4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.790029 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.789952    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/419a3eec-3436-4906-b7c4-09159ce540e4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.790029 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.789979    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/419a3eec-3436-4906-b7c4-09159ce540e4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.890403 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.890357    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/419a3eec-3436-4906-b7c4-09159ce540e4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.890597 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.890415    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/419a3eec-3436-4906-b7c4-09159ce540e4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.890597 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.890459    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/419a3eec-3436-4906-b7c4-09159ce540e4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.890597 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.890483    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/419a3eec-3436-4906-b7c4-09159ce540e4-config-out\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.890597 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.890531    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/419a3eec-3436-4906-b7c4-09159ce540e4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.890597 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.890579    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/419a3eec-3436-4906-b7c4-09159ce540e4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.890843 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.890603    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/419a3eec-3436-4906-b7c4-09159ce540e4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.890843 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.890627    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/419a3eec-3436-4906-b7c4-09159ce540e4-web-config\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.890843 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.890655    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gn4m2\" (UniqueName: \"kubernetes.io/projected/419a3eec-3436-4906-b7c4-09159ce540e4-kube-api-access-gn4m2\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.890843 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.890683    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/419a3eec-3436-4906-b7c4-09159ce540e4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.890843 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.890735    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/419a3eec-3436-4906-b7c4-09159ce540e4-config-volume\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.890843 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.890766    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/419a3eec-3436-4906-b7c4-09159ce540e4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.890843 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.890794    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/419a3eec-3436-4906-b7c4-09159ce540e4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.891532 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.891505    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/419a3eec-3436-4906-b7c4-09159ce540e4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.891642 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.891571    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/419a3eec-3436-4906-b7c4-09159ce540e4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.891956 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.890764    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/419a3eec-3436-4906-b7c4-09159ce540e4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.893485 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.893441    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/419a3eec-3436-4906-b7c4-09159ce540e4-config-out\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.893582 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.893528    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/419a3eec-3436-4906-b7c4-09159ce540e4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.893582 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.893547    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/419a3eec-3436-4906-b7c4-09159ce540e4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.893931 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.893909    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/419a3eec-3436-4906-b7c4-09159ce540e4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.894069 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.894044    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/419a3eec-3436-4906-b7c4-09159ce540e4-web-config\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.894581 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.894560    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/419a3eec-3436-4906-b7c4-09159ce540e4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.894661 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.894604    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/419a3eec-3436-4906-b7c4-09159ce540e4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.894768 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.894746    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/419a3eec-3436-4906-b7c4-09159ce540e4-config-volume\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.895218 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.895201    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/419a3eec-3436-4906-b7c4-09159ce540e4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.898269 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.898247    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn4m2\" (UniqueName: \"kubernetes.io/projected/419a3eec-3436-4906-b7c4-09159ce540e4-kube-api-access-gn4m2\") pod \"alertmanager-main-0\" (UID: \"419a3eec-3436-4906-b7c4-09159ce540e4\") " pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.937824 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.937800    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Apr 24 21:18:49.960681 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.960650    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbe592f7-616c-4382-b3e8-284718f95d30" path="/var/lib/kubelet/pods/dbe592f7-616c-4382-b3e8-284718f95d30/volumes"
Apr 24 21:18:49.999462 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:49.999429    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-694db545b8-wsrdm"]
Apr 24 21:18:50.002625 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.002599    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:18:50.014019 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.013991    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-694db545b8-wsrdm"]
Apr 24 21:18:50.092638 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.092583    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-console-serving-cert\") pod \"console-694db545b8-wsrdm\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") " pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:18:50.092638 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.092637    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-trusted-ca-bundle\") pod \"console-694db545b8-wsrdm\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") " pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:18:50.092848 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.092693    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-console-oauth-config\") pod \"console-694db545b8-wsrdm\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") " pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:18:50.092848 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.092735    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-console-config\") pod \"console-694db545b8-wsrdm\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") " pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:18:50.092848 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.092765    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnrv5\" (UniqueName: \"kubernetes.io/projected/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-kube-api-access-bnrv5\") pod \"console-694db545b8-wsrdm\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") " pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:18:50.092848 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.092819    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-service-ca\") pod \"console-694db545b8-wsrdm\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") " pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:18:50.092977 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.092934    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-oauth-serving-cert\") pod \"console-694db545b8-wsrdm\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") " pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:18:50.194160 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.194081    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-oauth-serving-cert\") pod \"console-694db545b8-wsrdm\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") " pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:18:50.194160 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.194140    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-console-serving-cert\") pod \"console-694db545b8-wsrdm\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") " pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:18:50.194362 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.194170    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-trusted-ca-bundle\") pod \"console-694db545b8-wsrdm\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") " pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:18:50.194362 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.194197    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-console-oauth-config\") pod \"console-694db545b8-wsrdm\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") " pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:18:50.194474 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.194424    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-console-config\") pod \"console-694db545b8-wsrdm\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") " pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:18:50.194522 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.194471    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bnrv5\" (UniqueName: \"kubernetes.io/projected/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-kube-api-access-bnrv5\") pod \"console-694db545b8-wsrdm\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") " pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:18:50.194522 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.194504    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-service-ca\") pod \"console-694db545b8-wsrdm\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") " pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:18:50.194914 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.194888    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-oauth-serving-cert\") pod \"console-694db545b8-wsrdm\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") " pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:18:50.195092 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.195072    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-trusted-ca-bundle\") pod \"console-694db545b8-wsrdm\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") " pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:18:50.195136 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.195093    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-service-ca\") pod \"console-694db545b8-wsrdm\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") " pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:18:50.195136 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.195115    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-console-config\") pod \"console-694db545b8-wsrdm\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") " pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:18:50.196931 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.196901    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-console-serving-cert\") pod \"console-694db545b8-wsrdm\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") " pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:18:50.197043 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.196901    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-console-oauth-config\") pod \"console-694db545b8-wsrdm\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") " pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:18:50.203122 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.203106    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnrv5\" (UniqueName: \"kubernetes.io/projected/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-kube-api-access-bnrv5\") pod \"console-694db545b8-wsrdm\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") " pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:18:50.276827 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.276761    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Apr 24 21:18:50.279503 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:18:50.279472    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod419a3eec_3436_4906_b7c4_09159ce540e4.slice/crio-9223fcddaa5f03325a3ef8aca96d875086ecb06a45a5721890c3765398a519a5 WatchSource:0}: Error finding container 9223fcddaa5f03325a3ef8aca96d875086ecb06a45a5721890c3765398a519a5: Status 404 returned error can't find the container with id 9223fcddaa5f03325a3ef8aca96d875086ecb06a45a5721890c3765398a519a5
Apr 24 21:18:50.314128 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.314104    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:18:50.440173 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.440139    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-694db545b8-wsrdm"]
Apr 24 21:18:50.443052 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:18:50.443016    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aeda76f_ff9e_48c1_a1ca_b274daf38c15.slice/crio-78b3ec3c3160e4f2143e4daac79e90acdc9c49053f02c93f9e53d94c27b946f6 WatchSource:0}: Error finding container 78b3ec3c3160e4f2143e4daac79e90acdc9c49053f02c93f9e53d94c27b946f6: Status 404 returned error can't find the container with id 78b3ec3c3160e4f2143e4daac79e90acdc9c49053f02c93f9e53d94c27b946f6
Apr 24 21:18:50.576795 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.576754    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-694db545b8-wsrdm" event={"ID":"0aeda76f-ff9e-48c1-a1ca-b274daf38c15","Type":"ContainerStarted","Data":"e7687651a2734c118b0d3c4cd46d6ce3c453172caa02aa79b7529e8a527d1ba8"}
Apr 24 21:18:50.576795 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.576802    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-694db545b8-wsrdm" event={"ID":"0aeda76f-ff9e-48c1-a1ca-b274daf38c15","Type":"ContainerStarted","Data":"78b3ec3c3160e4f2143e4daac79e90acdc9c49053f02c93f9e53d94c27b946f6"}
Apr 24 21:18:50.578868 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.578840    2569 generic.go:358] "Generic (PLEG): container finished" podID="419a3eec-3436-4906-b7c4-09159ce540e4" containerID="a0ecb5670b243bb0fcca3ad72a5dc5bd0b71a4ffe19589f155f5e9804e2d9b35" exitCode=0
Apr 24 21:18:50.578993 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.578891    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"419a3eec-3436-4906-b7c4-09159ce540e4","Type":"ContainerDied","Data":"a0ecb5670b243bb0fcca3ad72a5dc5bd0b71a4ffe19589f155f5e9804e2d9b35"}
Apr 24 21:18:50.578993 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.578911    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"419a3eec-3436-4906-b7c4-09159ce540e4","Type":"ContainerStarted","Data":"9223fcddaa5f03325a3ef8aca96d875086ecb06a45a5721890c3765398a519a5"}
Apr 24 21:18:50.595065 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:50.595025    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-694db545b8-wsrdm" podStartSLOduration=1.5950123459999999 podStartE2EDuration="1.595012346s" podCreationTimestamp="2026-04-24 21:18:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:18:50.593275544 +0000 UTC m=+123.212732169" watchObservedRunningTime="2026-04-24 21:18:50.595012346 +0000 UTC m=+123.214468971"
Apr 24 21:18:51.585187 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:51.585144    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"419a3eec-3436-4906-b7c4-09159ce540e4","Type":"ContainerStarted","Data":"1b951543fc7c717460fa327cb2e21377b0edfdd1dbc55224d39145007e2ed6ac"}
Apr 24 21:18:51.585187 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:51.585190    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"419a3eec-3436-4906-b7c4-09159ce540e4","Type":"ContainerStarted","Data":"05809d86af1fd68145704e5dd5810b9dd93d9180127f810c0a706cbf1d47cc37"}
Apr 24 21:18:51.585719 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:51.585203    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"419a3eec-3436-4906-b7c4-09159ce540e4","Type":"ContainerStarted","Data":"f00d9d2a5900b3a77074587fe6e3b384a169df172276b17afd381e72d7377b71"}
Apr 24 21:18:51.585719 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:51.585215    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"419a3eec-3436-4906-b7c4-09159ce540e4","Type":"ContainerStarted","Data":"af0d754b26cf5162730f33591fba9eaef69b8cc074f7d1c9b5dbef3b835c5431"}
Apr 24 21:18:51.585719 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:51.585227    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"419a3eec-3436-4906-b7c4-09159ce540e4","Type":"ContainerStarted","Data":"89ced35c96d2666f4f2dcfc6cfeec7a58d216968e380e37d9afd45d16af82b0d"}
Apr 24 21:18:51.585719 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:51.585239    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"419a3eec-3436-4906-b7c4-09159ce540e4","Type":"ContainerStarted","Data":"4b883b8ac567dbc211f8cd4f65c59de5706133e46a544abe49bdf44a6f76da86"}
Apr 24 21:18:51.611495 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:51.611422    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.611403042 podStartE2EDuration="2.611403042s" podCreationTimestamp="2026-04-24 21:18:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:18:51.609871531 +0000 UTC m=+124.229328158" watchObservedRunningTime="2026-04-24 21:18:51.611403042 +0000 UTC m=+124.230859664"
Apr 24 21:18:51.954932 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:51.954897    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Apr 24 21:18:51.955373 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:51.955324    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="prometheus" containerID="cri-o://ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92" gracePeriod=600
Apr 24 21:18:51.955483 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:51.955370    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="kube-rbac-proxy-thanos" containerID="cri-o://3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675" gracePeriod=600
Apr 24 21:18:51.955483 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:51.955396    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="thanos-sidecar" containerID="cri-o://42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741" gracePeriod=600
Apr 24 21:18:51.955483 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:51.955420    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="config-reloader" containerID="cri-o://01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48" gracePeriod=600
Apr 24 21:18:51.955483 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:51.955399    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="kube-rbac-proxy-web" containerID="cri-o://7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b" gracePeriod=600
Apr 24 21:18:51.955695 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:51.955332    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="kube-rbac-proxy" containerID="cri-o://de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2" gracePeriod=600
Apr 24 21:18:52.220989 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.220963    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.318871 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.318837    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-metrics-client-certs\") pod \"90e76aa8-68aa-4a31-86df-00197ce187b3\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") "
Apr 24 21:18:52.319020 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.318877    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"90e76aa8-68aa-4a31-86df-00197ce187b3\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") "
Apr 24 21:18:52.319020 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.318902    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-thanos-prometheus-http-client-file\") pod \"90e76aa8-68aa-4a31-86df-00197ce187b3\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") "
Apr 24 21:18:52.319020 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.318931    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"90e76aa8-68aa-4a31-86df-00197ce187b3\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") "
Apr 24 21:18:52.319020 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.318956    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-configmap-metrics-client-ca\") pod \"90e76aa8-68aa-4a31-86df-00197ce187b3\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") "
Apr 24 21:18:52.319020 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.318990    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/90e76aa8-68aa-4a31-86df-00197ce187b3-prometheus-k8s-db\") pod \"90e76aa8-68aa-4a31-86df-00197ce187b3\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") "
Apr 24 21:18:52.319020 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.319020    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-prometheus-trusted-ca-bundle\") pod \"90e76aa8-68aa-4a31-86df-00197ce187b3\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") "
Apr 24 21:18:52.319335 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.319048    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-web-config\") pod \"90e76aa8-68aa-4a31-86df-00197ce187b3\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") "
Apr 24 21:18:52.319335 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.319094    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/90e76aa8-68aa-4a31-86df-00197ce187b3-config-out\") pod \"90e76aa8-68aa-4a31-86df-00197ce187b3\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") "
Apr 24 21:18:52.319335 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.319128    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-configmap-kubelet-serving-ca-bundle\") pod \"90e76aa8-68aa-4a31-86df-00197ce187b3\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") "
Apr 24 21:18:52.319335 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.319153    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/90e76aa8-68aa-4a31-86df-00197ce187b3-tls-assets\") pod \"90e76aa8-68aa-4a31-86df-00197ce187b3\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") "
Apr 24 21:18:52.319335 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.319184    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-kube-rbac-proxy\") pod \"90e76aa8-68aa-4a31-86df-00197ce187b3\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") "
Apr 24 21:18:52.319335 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.319210    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-grpc-tls\") pod \"90e76aa8-68aa-4a31-86df-00197ce187b3\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") "
Apr 24 21:18:52.319335 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.319252    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4r8sl\" (UniqueName: \"kubernetes.io/projected/90e76aa8-68aa-4a31-86df-00197ce187b3-kube-api-access-4r8sl\") pod \"90e76aa8-68aa-4a31-86df-00197ce187b3\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") "
Apr 24 21:18:52.319335 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.319277    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-config\") pod \"90e76aa8-68aa-4a31-86df-00197ce187b3\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") "
Apr 24 21:18:52.319335 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.319333    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-configmap-serving-certs-ca-bundle\") pod \"90e76aa8-68aa-4a31-86df-00197ce187b3\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") "
Apr 24 21:18:52.319912 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.319421    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-prometheus-k8s-tls\") pod \"90e76aa8-68aa-4a31-86df-00197ce187b3\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") "
Apr 24 21:18:52.319912 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.319422    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "90e76aa8-68aa-4a31-86df-00197ce187b3" (UID: "90e76aa8-68aa-4a31-86df-00197ce187b3"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 24 21:18:52.319912 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.319483    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-prometheus-k8s-rulefiles-0\") pod \"90e76aa8-68aa-4a31-86df-00197ce187b3\" (UID: \"90e76aa8-68aa-4a31-86df-00197ce187b3\") "
Apr 24 21:18:52.319912 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.319780    2569 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-configmap-metrics-client-ca\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:52.320109 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.320055    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "90e76aa8-68aa-4a31-86df-00197ce187b3" (UID: "90e76aa8-68aa-4a31-86df-00197ce187b3"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 24 21:18:52.320487 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.320270    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "90e76aa8-68aa-4a31-86df-00197ce187b3" (UID: "90e76aa8-68aa-4a31-86df-00197ce187b3"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 24 21:18:52.320487 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.320363    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90e76aa8-68aa-4a31-86df-00197ce187b3-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "90e76aa8-68aa-4a31-86df-00197ce187b3" (UID: "90e76aa8-68aa-4a31-86df-00197ce187b3"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:18:52.321141 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.321110    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "90e76aa8-68aa-4a31-86df-00197ce187b3" (UID: "90e76aa8-68aa-4a31-86df-00197ce187b3"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 24 21:18:52.321375 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.321345    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "90e76aa8-68aa-4a31-86df-00197ce187b3" (UID: "90e76aa8-68aa-4a31-86df-00197ce187b3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 24 21:18:52.322982 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.322882    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "90e76aa8-68aa-4a31-86df-00197ce187b3" (UID: "90e76aa8-68aa-4a31-86df-00197ce187b3"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:18:52.323084 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.323055    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "90e76aa8-68aa-4a31-86df-00197ce187b3" (UID: "90e76aa8-68aa-4a31-86df-00197ce187b3"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:18:52.323337 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.323301    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "90e76aa8-68aa-4a31-86df-00197ce187b3" (UID: "90e76aa8-68aa-4a31-86df-00197ce187b3"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:18:52.323548 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.323521    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "90e76aa8-68aa-4a31-86df-00197ce187b3" (UID: "90e76aa8-68aa-4a31-86df-00197ce187b3"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:18:52.323685 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.323629    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90e76aa8-68aa-4a31-86df-00197ce187b3-config-out" (OuterVolumeSpecName: "config-out") pod "90e76aa8-68aa-4a31-86df-00197ce187b3" (UID: "90e76aa8-68aa-4a31-86df-00197ce187b3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:18:52.323753 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.323698    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "90e76aa8-68aa-4a31-86df-00197ce187b3" (UID: "90e76aa8-68aa-4a31-86df-00197ce187b3"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:18:52.323807 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.323769    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90e76aa8-68aa-4a31-86df-00197ce187b3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "90e76aa8-68aa-4a31-86df-00197ce187b3" (UID: "90e76aa8-68aa-4a31-86df-00197ce187b3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Apr 24 21:18:52.323807 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.323782    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90e76aa8-68aa-4a31-86df-00197ce187b3-kube-api-access-4r8sl" (OuterVolumeSpecName: "kube-api-access-4r8sl") pod "90e76aa8-68aa-4a31-86df-00197ce187b3" (UID: "90e76aa8-68aa-4a31-86df-00197ce187b3"). InnerVolumeSpecName "kube-api-access-4r8sl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Apr 24 21:18:52.323807 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.323789    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-config" (OuterVolumeSpecName: "config") pod "90e76aa8-68aa-4a31-86df-00197ce187b3" (UID: "90e76aa8-68aa-4a31-86df-00197ce187b3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:18:52.324112 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.324095    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "90e76aa8-68aa-4a31-86df-00197ce187b3" (UID: "90e76aa8-68aa-4a31-86df-00197ce187b3"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:18:52.325188 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.325172    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "90e76aa8-68aa-4a31-86df-00197ce187b3" (UID: "90e76aa8-68aa-4a31-86df-00197ce187b3"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:18:52.333881 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.333862    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-web-config" (OuterVolumeSpecName: "web-config") pod "90e76aa8-68aa-4a31-86df-00197ce187b3" (UID: "90e76aa8-68aa-4a31-86df-00197ce187b3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:18:52.421000 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.420967    2569 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:52.421000 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.420998    2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:52.421181 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.421013    2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:52.421181 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.421026    2569 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-metrics-client-certs\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:52.421181 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.421040    2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:52.421181 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.421055    2569 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:52.421181 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.421070    2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:52.421181 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.421085    2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/90e76aa8-68aa-4a31-86df-00197ce187b3-prometheus-k8s-db\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:52.421181 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.421098    2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:52.421181 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.421110    2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-web-config\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:52.421181 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.421122    2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/90e76aa8-68aa-4a31-86df-00197ce187b3-config-out\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:52.421181 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.421135    2569 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90e76aa8-68aa-4a31-86df-00197ce187b3-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:52.421181 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.421149    2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/90e76aa8-68aa-4a31-86df-00197ce187b3-tls-assets\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:52.421181 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.421163    2569 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-kube-rbac-proxy\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:52.421181 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.421176    2569 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-secret-grpc-tls\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:52.421637 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.421189    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4r8sl\" (UniqueName: \"kubernetes.io/projected/90e76aa8-68aa-4a31-86df-00197ce187b3-kube-api-access-4r8sl\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:52.421637 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.421202    2569 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/90e76aa8-68aa-4a31-86df-00197ce187b3-config\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:18:52.592480 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.592398    2569 generic.go:358] "Generic (PLEG): container finished" podID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerID="3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675" exitCode=0
Apr 24 21:18:52.592480 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.592423    2569 generic.go:358] "Generic (PLEG): container finished" podID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerID="de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2" exitCode=0
Apr 24 21:18:52.592480 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.592430    2569 generic.go:358] "Generic (PLEG): container finished" podID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerID="7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b" exitCode=0
Apr 24 21:18:52.592480 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.592435    2569 generic.go:358] "Generic (PLEG): container finished" podID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerID="42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741" exitCode=0
Apr 24 21:18:52.592480 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.592440    2569 generic.go:358] "Generic (PLEG): container finished" podID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerID="01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48" exitCode=0
Apr 24 21:18:52.592480 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.592445    2569 generic.go:358] "Generic (PLEG): container finished" podID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerID="ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92" exitCode=0
Apr 24 21:18:52.593012 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.592472    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"90e76aa8-68aa-4a31-86df-00197ce187b3","Type":"ContainerDied","Data":"3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675"}
Apr 24 21:18:52.593012 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.592511    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.593012 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.592528    2569 scope.go:117] "RemoveContainer" containerID="3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675"
Apr 24 21:18:52.593012 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.592514    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"90e76aa8-68aa-4a31-86df-00197ce187b3","Type":"ContainerDied","Data":"de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2"}
Apr 24 21:18:52.593012 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.592620    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"90e76aa8-68aa-4a31-86df-00197ce187b3","Type":"ContainerDied","Data":"7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b"}
Apr 24 21:18:52.593012 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.592638    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"90e76aa8-68aa-4a31-86df-00197ce187b3","Type":"ContainerDied","Data":"42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741"}
Apr 24 21:18:52.593012 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.592649    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"90e76aa8-68aa-4a31-86df-00197ce187b3","Type":"ContainerDied","Data":"01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48"}
Apr 24 21:18:52.593012 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.592659    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"90e76aa8-68aa-4a31-86df-00197ce187b3","Type":"ContainerDied","Data":"ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92"}
Apr 24 21:18:52.593012 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.592688    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"90e76aa8-68aa-4a31-86df-00197ce187b3","Type":"ContainerDied","Data":"0d16c17d30a66a01aca2d7d8391bb234e1994fab837f17558b3a0530a5532067"}
Apr 24 21:18:52.600027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.600013    2569 scope.go:117] "RemoveContainer" containerID="de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2"
Apr 24 21:18:52.607672 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.607652    2569 scope.go:117] "RemoveContainer" containerID="7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b"
Apr 24 21:18:52.613953 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.613927    2569 scope.go:117] "RemoveContainer" containerID="42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741"
Apr 24 21:18:52.617432 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.617414    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Apr 24 21:18:52.622669 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.622591    2569 scope.go:117] "RemoveContainer" containerID="01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48"
Apr 24 21:18:52.624856 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.624834    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Apr 24 21:18:52.629624 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.629599    2569 scope.go:117] "RemoveContainer" containerID="ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92"
Apr 24 21:18:52.635971 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.635952    2569 scope.go:117] "RemoveContainer" containerID="cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63"
Apr 24 21:18:52.642765 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.642748    2569 scope.go:117] "RemoveContainer" containerID="3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675"
Apr 24 21:18:52.643024 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:18:52.643005    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675\": container with ID starting with 3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675 not found: ID does not exist" containerID="3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675"
Apr 24 21:18:52.643071 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.643033    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675"} err="failed to get container status \"3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675\": rpc error: code = NotFound desc = could not find container \"3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675\": container with ID starting with 3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675 not found: ID does not exist"
Apr 24 21:18:52.643071 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.643052    2569 scope.go:117] "RemoveContainer" containerID="de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2"
Apr 24 21:18:52.643276 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:18:52.643258    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2\": container with ID starting with de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2 not found: ID does not exist" containerID="de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2"
Apr 24 21:18:52.643337 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.643285    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2"} err="failed to get container status \"de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2\": rpc error: code = NotFound desc = could not find container \"de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2\": container with ID starting with de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2 not found: ID does not exist"
Apr 24 21:18:52.643337 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.643307    2569 scope.go:117] "RemoveContainer" containerID="7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b"
Apr 24 21:18:52.643581 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:18:52.643564    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b\": container with ID starting with 7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b not found: ID does not exist" containerID="7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b"
Apr 24 21:18:52.643617 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.643587    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b"} err="failed to get container status \"7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b\": rpc error: code = NotFound desc = could not find container \"7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b\": container with ID starting with 7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b not found: ID does not exist"
Apr 24 21:18:52.643617 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.643602    2569 scope.go:117] "RemoveContainer" containerID="42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741"
Apr 24 21:18:52.643803 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:18:52.643786    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741\": container with ID starting with 42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741 not found: ID does not exist" containerID="42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741"
Apr 24 21:18:52.643841 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.643810    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741"} err="failed to get container status \"42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741\": rpc error: code = NotFound desc = could not find container \"42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741\": container with ID starting with 42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741 not found: ID does not exist"
Apr 24 21:18:52.643841 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.643825    2569 scope.go:117] "RemoveContainer" containerID="01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48"
Apr 24 21:18:52.644021 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:18:52.644005    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48\": container with ID starting with 01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48 not found: ID does not exist" containerID="01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48"
Apr 24 21:18:52.644081 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.644028    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48"} err="failed to get container status \"01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48\": rpc error: code = NotFound desc = could not find container \"01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48\": container with ID starting with 01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48 not found: ID does not exist"
Apr 24 21:18:52.644081 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.644047    2569 scope.go:117] "RemoveContainer" containerID="ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92"
Apr 24 21:18:52.644245 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:18:52.644230    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92\": container with ID starting with ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92 not found: ID does not exist" containerID="ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92"
Apr 24 21:18:52.644284 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.644251    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92"} err="failed to get container status \"ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92\": rpc error: code = NotFound desc = could not find container \"ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92\": container with ID starting with ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92 not found: ID does not exist"
Apr 24 21:18:52.644284 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.644263    2569 scope.go:117] "RemoveContainer" containerID="cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63"
Apr 24 21:18:52.644453 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:18:52.644436    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63\": container with ID starting with cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63 not found: ID does not exist" containerID="cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63"
Apr 24 21:18:52.644495 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.644457    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63"} err="failed to get container status \"cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63\": rpc error: code = NotFound desc = could not find container \"cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63\": container with ID starting with cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63 not found: ID does not exist"
Apr 24 21:18:52.644495 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.644479    2569 scope.go:117] "RemoveContainer" containerID="3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675"
Apr 24 21:18:52.644662 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.644638    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675"} err="failed to get container status \"3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675\": rpc error: code = NotFound desc = could not find container \"3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675\": container with ID starting with 3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675 not found: ID does not exist"
Apr 24 21:18:52.644662 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.644660    2569 scope.go:117] "RemoveContainer" containerID="de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2"
Apr 24 21:18:52.644987 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.644959    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2"} err="failed to get container status \"de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2\": rpc error: code = NotFound desc = could not find container \"de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2\": container with ID starting with de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2 not found: ID does not exist"
Apr 24 21:18:52.645085 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.644993    2569 scope.go:117] "RemoveContainer" containerID="7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b"
Apr 24 21:18:52.645375 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.645252    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b"} err="failed to get container status \"7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b\": rpc error: code = NotFound desc = could not find container \"7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b\": container with ID starting with 7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b not found: ID does not exist"
Apr 24 21:18:52.645375 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.645284    2569 scope.go:117] "RemoveContainer" containerID="42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741"
Apr 24 21:18:52.645600 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.645566    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741"} err="failed to get container status \"42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741\": rpc error: code = NotFound desc = could not find container \"42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741\": container with ID starting with 42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741 not found: ID does not exist"
Apr 24 21:18:52.645600 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.645593    2569 scope.go:117] "RemoveContainer" containerID="01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48"
Apr 24 21:18:52.645909 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.645867    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48"} err="failed to get container status \"01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48\": rpc error: code = NotFound desc = could not find container \"01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48\": container with ID starting with 01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48 not found: ID does not exist"
Apr 24 21:18:52.645909 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.645897    2569 scope.go:117] "RemoveContainer" containerID="ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92"
Apr 24 21:18:52.646145 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.646116    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92"} err="failed to get container status \"ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92\": rpc error: code = NotFound desc = could not find container \"ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92\": container with ID starting with ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92 not found: ID does not exist"
Apr 24 21:18:52.646145 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.646143    2569 scope.go:117] "RemoveContainer" containerID="cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63"
Apr 24 21:18:52.646430 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.646409    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63"} err="failed to get container status \"cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63\": rpc error: code = NotFound desc = could not find container \"cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63\": container with ID starting with cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63 not found: ID does not exist"
Apr 24 21:18:52.646507 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.646431    2569 scope.go:117] "RemoveContainer" containerID="3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675"
Apr 24 21:18:52.646683 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.646661    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675"} err="failed to get container status \"3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675\": rpc error: code = NotFound desc = could not find container \"3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675\": container with ID starting with 3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675 not found: ID does not exist"
Apr 24 21:18:52.646742 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.646685    2569 scope.go:117] "RemoveContainer" containerID="de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2"
Apr 24 21:18:52.646947 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.646924    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2"} err="failed to get container status \"de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2\": rpc error: code = NotFound desc = could not find container \"de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2\": container with ID starting with de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2 not found: ID does not exist"
Apr 24 21:18:52.647008 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.646951    2569 scope.go:117] "RemoveContainer" containerID="7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b"
Apr 24 21:18:52.647196 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647180    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Apr 24 21:18:52.647274 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647178    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b"} err="failed to get container status \"7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b\": rpc error: code = NotFound desc = could not find container \"7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b\": container with ID starting with 7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b not found: ID does not exist"
Apr 24 21:18:52.647328 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647277    2569 scope.go:117] "RemoveContainer" containerID="42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741"
Apr 24 21:18:52.647556 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647542    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="thanos-sidecar"
Apr 24 21:18:52.647556 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647562    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="thanos-sidecar"
Apr 24 21:18:52.647686 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647580    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="kube-rbac-proxy-web"
Apr 24 21:18:52.647686 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647588    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="kube-rbac-proxy-web"
Apr 24 21:18:52.647686 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647597    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="kube-rbac-proxy"
Apr 24 21:18:52.647686 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647603    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="kube-rbac-proxy"
Apr 24 21:18:52.647686 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647610    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="init-config-reloader"
Apr 24 21:18:52.647686 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647616    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="init-config-reloader"
Apr 24 21:18:52.647686 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647541    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741"} err="failed to get container status \"42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741\": rpc error: code = NotFound desc = could not find container \"42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741\": container with ID starting with 42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741 not found: ID does not exist"
Apr 24 21:18:52.647686 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647628    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="prometheus"
Apr 24 21:18:52.647686 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647634    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="prometheus"
Apr 24 21:18:52.647686 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647652    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="config-reloader"
Apr 24 21:18:52.647686 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647660    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="config-reloader"
Apr 24 21:18:52.647686 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647667    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="kube-rbac-proxy-thanos"
Apr 24 21:18:52.647686 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647672    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="kube-rbac-proxy-thanos"
Apr 24 21:18:52.648265 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647634    2569 scope.go:117] "RemoveContainer" containerID="01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48"
Apr 24 21:18:52.648265 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647721    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="prometheus"
Apr 24 21:18:52.648265 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647779    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="thanos-sidecar"
Apr 24 21:18:52.648265 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647789    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="kube-rbac-proxy"
Apr 24 21:18:52.648265 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647796    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="kube-rbac-proxy-thanos"
Apr 24 21:18:52.648265 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647805    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="config-reloader"
Apr 24 21:18:52.648265 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.647815    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" containerName="kube-rbac-proxy-web"
Apr 24 21:18:52.648265 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.648007    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48"} err="failed to get container status \"01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48\": rpc error: code = NotFound desc = could not find container \"01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48\": container with ID starting with 01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48 not found: ID does not exist"
Apr 24 21:18:52.648265 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.648029    2569 scope.go:117] "RemoveContainer" containerID="ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92"
Apr 24 21:18:52.648563 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.648280    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92"} err="failed to get container status \"ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92\": rpc error: code = NotFound desc = could not find container \"ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92\": container with ID starting with ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92 not found: ID does not exist"
Apr 24 21:18:52.648563 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.648306    2569 scope.go:117] "RemoveContainer" containerID="cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63"
Apr 24 21:18:52.648563 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.648552    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63"} err="failed to get container status \"cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63\": rpc error: code = NotFound desc = could not find container \"cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63\": container with ID starting with cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63 not found: ID does not exist"
Apr 24 21:18:52.648662 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.648569    2569 scope.go:117] "RemoveContainer" containerID="3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675"
Apr 24 21:18:52.648821 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.648799    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675"} err="failed to get container status \"3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675\": rpc error: code = NotFound desc = could not find container \"3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675\": container with ID starting with 3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675 not found: ID does not exist"
Apr 24 21:18:52.648871 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.648822    2569 scope.go:117] "RemoveContainer" containerID="de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2"
Apr 24 21:18:52.649037 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.649014    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2"} err="failed to get container status \"de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2\": rpc error: code = NotFound desc = could not find container \"de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2\": container with ID starting with de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2 not found: ID does not exist"
Apr 24 21:18:52.649080 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.649039    2569 scope.go:117] "RemoveContainer" containerID="7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b"
Apr 24 21:18:52.649296 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.649277    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b"} err="failed to get container status \"7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b\": rpc error: code = NotFound desc = could not find container \"7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b\": container with ID starting with 7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b not found: ID does not exist"
Apr 24 21:18:52.649296 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.649296    2569 scope.go:117] "RemoveContainer" containerID="42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741"
Apr 24 21:18:52.649551 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.649533    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741"} err="failed to get container status \"42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741\": rpc error: code = NotFound desc = could not find container \"42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741\": container with ID starting with 42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741 not found: ID does not exist"
Apr 24 21:18:52.649551 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.649551    2569 scope.go:117] "RemoveContainer" containerID="01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48"
Apr 24 21:18:52.649765 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.649747    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48"} err="failed to get container status \"01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48\": rpc error: code = NotFound desc = could not find container \"01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48\": container with ID starting with 01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48 not found: ID does not exist"
Apr 24 21:18:52.649808 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.649766    2569 scope.go:117] "RemoveContainer" containerID="ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92"
Apr 24 21:18:52.650002 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.649985    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92"} err="failed to get container status \"ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92\": rpc error: code = NotFound desc = could not find container \"ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92\": container with ID starting with ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92 not found: ID does not exist"
Apr 24 21:18:52.650044 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.650003    2569 scope.go:117] "RemoveContainer" containerID="cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63"
Apr 24 21:18:52.650195 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.650178    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63"} err="failed to get container status \"cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63\": rpc error: code = NotFound desc = could not find container \"cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63\": container with ID starting with cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63 not found: ID does not exist"
Apr 24 21:18:52.650195 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.650194    2569 scope.go:117] "RemoveContainer" containerID="3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675"
Apr 24 21:18:52.650426 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.650402    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675"} err="failed to get container status \"3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675\": rpc error: code = NotFound desc = could not find container \"3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675\": container with ID starting with 3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675 not found: ID does not exist"
Apr 24 21:18:52.650481 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.650426    2569 scope.go:117] "RemoveContainer" containerID="de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2"
Apr 24 21:18:52.650589 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.650574    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.650628 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.650600    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2"} err="failed to get container status \"de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2\": rpc error: code = NotFound desc = could not find container \"de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2\": container with ID starting with de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2 not found: ID does not exist"
Apr 24 21:18:52.650628 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.650613    2569 scope.go:117] "RemoveContainer" containerID="7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b"
Apr 24 21:18:52.650844 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.650817    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b"} err="failed to get container status \"7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b\": rpc error: code = NotFound desc = could not find container \"7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b\": container with ID starting with 7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b not found: ID does not exist"
Apr 24 21:18:52.650970 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.650847    2569 scope.go:117] "RemoveContainer" containerID="42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741"
Apr 24 21:18:52.651164 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.651142    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741"} err="failed to get container status \"42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741\": rpc error: code = NotFound desc = could not find container \"42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741\": container with ID starting with 42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741 not found: ID does not exist"
Apr 24 21:18:52.651164 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.651164    2569 scope.go:117] "RemoveContainer" containerID="01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48"
Apr 24 21:18:52.651432 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.651411    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48"} err="failed to get container status \"01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48\": rpc error: code = NotFound desc = could not find container \"01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48\": container with ID starting with 01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48 not found: ID does not exist"
Apr 24 21:18:52.651432 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.651431    2569 scope.go:117] "RemoveContainer" containerID="ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92"
Apr 24 21:18:52.651692 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.651669    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92"} err="failed to get container status \"ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92\": rpc error: code = NotFound desc = could not find container \"ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92\": container with ID starting with ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92 not found: ID does not exist"
Apr 24 21:18:52.651692 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.651691    2569 scope.go:117] "RemoveContainer" containerID="cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63"
Apr 24 21:18:52.651938 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.651921    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63"} err="failed to get container status \"cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63\": rpc error: code = NotFound desc = could not find container \"cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63\": container with ID starting with cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63 not found: ID does not exist"
Apr 24 21:18:52.652032 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.651940    2569 scope.go:117] "RemoveContainer" containerID="3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675"
Apr 24 21:18:52.652186 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.652166    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675"} err="failed to get container status \"3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675\": rpc error: code = NotFound desc = could not find container \"3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675\": container with ID starting with 3e29704e26cd6e4ec6c121a4b532c5c82f32c0a36ff60cc2ece90443fc002675 not found: ID does not exist"
Apr 24 21:18:52.652240 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.652189    2569 scope.go:117] "RemoveContainer" containerID="de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2"
Apr 24 21:18:52.652484 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.652465    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2"} err="failed to get container status \"de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2\": rpc error: code = NotFound desc = could not find container \"de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2\": container with ID starting with de368c65cc637bb8883401faa3b7b109e6180d2e4485a8ae1444f58e4faadcb2 not found: ID does not exist"
Apr 24 21:18:52.652548 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.652485    2569 scope.go:117] "RemoveContainer" containerID="7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b"
Apr 24 21:18:52.653696 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.653323    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b"} err="failed to get container status \"7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b\": rpc error: code = NotFound desc = could not find container \"7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b\": container with ID starting with 7de0d0ae50fd3657b1128b6505c8407d9f0f387ec6d7fe5cc01db12f2bc8319b not found: ID does not exist"
Apr 24 21:18:52.653696 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.653359    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Apr 24 21:18:52.653696 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.653399    2569 scope.go:117] "RemoveContainer" containerID="42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741"
Apr 24 21:18:52.653883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.653734    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Apr 24 21:18:52.654071 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.654051    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Apr 24 21:18:52.654220 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.654198    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Apr 24 21:18:52.654397 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.654362    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8fkri8tut005u\""
Apr 24 21:18:52.654459 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.654396    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Apr 24 21:18:52.654964 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.654928    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Apr 24 21:18:52.655061 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.654998    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741"} err="failed to get container status \"42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741\": rpc error: code = NotFound desc = could not find container \"42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741\": container with ID starting with 42b1f62f036d7cc9bd625945df6c1d4d223427346ec7122156d14f33be7ed741 not found: ID does not exist"
Apr 24 21:18:52.655061 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.655022    2569 scope.go:117] "RemoveContainer" containerID="01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48"
Apr 24 21:18:52.655168 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.655072    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Apr 24 21:18:52.655617 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.655588    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Apr 24 21:18:52.655750 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.655733    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Apr 24 21:18:52.656190 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.656170    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Apr 24 21:18:52.656289 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.656260    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vpp99\""
Apr 24 21:18:52.656346 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.656294    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48"} err="failed to get container status \"01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48\": rpc error: code = NotFound desc = could not find container \"01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48\": container with ID starting with 01661d6f00839f7b866579f100378ec37e1a9592f6713453f842a2fac2af6c48 not found: ID does not exist"
Apr 24 21:18:52.656346 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.656314    2569 scope.go:117] "RemoveContainer" containerID="ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92"
Apr 24 21:18:52.660209 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.657017    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92"} err="failed to get container status \"ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92\": rpc error: code = NotFound desc = could not find container \"ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92\": container with ID starting with ead70a12a4ff7944ec79c45cd0c0209ee92f667d9b3e2ee7dd8b4419ce0d9d92 not found: ID does not exist"
Apr 24 21:18:52.660209 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.657231    2569 scope.go:117] "RemoveContainer" containerID="cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63"
Apr 24 21:18:52.660209 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.658347    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63"} err="failed to get container status \"cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63\": rpc error: code = NotFound desc = could not find container \"cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63\": container with ID starting with cb59d9a4ca866cea856e169c1dab7357b1c2ddbd12cb45c058bb023a7bb8ca63 not found: ID does not exist"
Apr 24 21:18:52.660209 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.659289    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Apr 24 21:18:52.662431 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.662409    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Apr 24 21:18:52.665482 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.665465    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Apr 24 21:18:52.824954 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.824916    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.825152 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.824962    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-config-out\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.825152 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.824989    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-config\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.825152 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.825010    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.825152 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.825033    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-web-config\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.825152 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.825077    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.825152 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.825115    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.825152 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.825136    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.825521 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.825170    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.825521 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.825194    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.825521 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.825250    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt6vx\" (UniqueName: \"kubernetes.io/projected/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-kube-api-access-mt6vx\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.825521 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.825285    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.825521 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.825313    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.825521 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.825337    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.825521 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.825358    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.825521 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.825421    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.825521 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.825451    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.825521 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.825476    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.926356 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.926323    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.926567 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.926364    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-config-out\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.926567 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.926410    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-config\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.926567 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.926426    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.926567 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.926446    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-web-config\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.926567 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.926470    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.926567 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.926497    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.926871 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.926570    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.926871 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.926623    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.926871 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.926682    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.926871 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.926732    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mt6vx\" (UniqueName: \"kubernetes.io/projected/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-kube-api-access-mt6vx\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.926871 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.926763    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.926871 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.926792    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.926871 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.926819    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.926871 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.926843    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.927232 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.926880    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.927232 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.926914    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.927232 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.926942    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.927405 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.927261    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.928113 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.927614    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.928113 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.927776    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.928113 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.927851    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.928630 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.928606    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.929892 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.929815    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.930201 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.930167    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.930201 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.930195    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.930485 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.930460    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-web-config\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.931219 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.931185    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.931219 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.931203    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-config\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.931478 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.931456    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-config-out\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.931641 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.931622    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.931814 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.931792    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.932184 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.932168    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.932254 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.932237    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.932550 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.932534    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.938664 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.938642    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt6vx\" (UniqueName: \"kubernetes.io/projected/0eda6f74-3e5f-4e7d-9ba6-7537620d1120-kube-api-access-mt6vx\") pod \"prometheus-k8s-0\" (UID: \"0eda6f74-3e5f-4e7d-9ba6-7537620d1120\") " pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:52.965402 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:52.964669    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:18:53.098888 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:53.098859    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Apr 24 21:18:53.101538 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:18:53.101502    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eda6f74_3e5f_4e7d_9ba6_7537620d1120.slice/crio-392e33f5d85404dd4a5e116cdecff26d3b4d63888c973372a47307bc973d122b WatchSource:0}: Error finding container 392e33f5d85404dd4a5e116cdecff26d3b4d63888c973372a47307bc973d122b: Status 404 returned error can't find the container with id 392e33f5d85404dd4a5e116cdecff26d3b4d63888c973372a47307bc973d122b
Apr 24 21:18:53.598267 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:53.598169    2569 generic.go:358] "Generic (PLEG): container finished" podID="0eda6f74-3e5f-4e7d-9ba6-7537620d1120" containerID="be278db52a965a06f3b5044a5e3d7abec05e2dff33bce802e6d26940777e79df" exitCode=0
Apr 24 21:18:53.598267 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:53.598219    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0eda6f74-3e5f-4e7d-9ba6-7537620d1120","Type":"ContainerDied","Data":"be278db52a965a06f3b5044a5e3d7abec05e2dff33bce802e6d26940777e79df"}
Apr 24 21:18:53.598267 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:53.598250    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0eda6f74-3e5f-4e7d-9ba6-7537620d1120","Type":"ContainerStarted","Data":"392e33f5d85404dd4a5e116cdecff26d3b4d63888c973372a47307bc973d122b"}
Apr 24 21:18:53.965768 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:53.962980    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90e76aa8-68aa-4a31-86df-00197ce187b3" path="/var/lib/kubelet/pods/90e76aa8-68aa-4a31-86df-00197ce187b3/volumes"
Apr 24 21:18:54.604411 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:54.604366    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0eda6f74-3e5f-4e7d-9ba6-7537620d1120","Type":"ContainerStarted","Data":"1997559853b7e2bc2dc2b30c4f5bb71c43461ee5e87b6207f72d874284849e14"}
Apr 24 21:18:54.604411 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:54.604413    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0eda6f74-3e5f-4e7d-9ba6-7537620d1120","Type":"ContainerStarted","Data":"6ff6a8072380b1c0707cead31bbe3a23a0f4144c58df1345818f6847c3e736d8"}
Apr 24 21:18:54.604851 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:54.604424    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0eda6f74-3e5f-4e7d-9ba6-7537620d1120","Type":"ContainerStarted","Data":"725276ea8e1222642ee7d182a7c75a6b5a1b192071e9b0f0f6d416fe63b68835"}
Apr 24 21:18:54.604851 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:54.604433    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0eda6f74-3e5f-4e7d-9ba6-7537620d1120","Type":"ContainerStarted","Data":"0cd5616eff68e87d2d56f138a6c27429408c642c8b518f64986a4695249c78a4"}
Apr 24 21:18:54.604851 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:54.604440    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0eda6f74-3e5f-4e7d-9ba6-7537620d1120","Type":"ContainerStarted","Data":"ee084060a33ac53f80e91bb7da45030afece221619b402f998f20d14e92c7978"}
Apr 24 21:18:54.604851 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:54.604448    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0eda6f74-3e5f-4e7d-9ba6-7537620d1120","Type":"ContainerStarted","Data":"15c741d8698f953b1ae906bbed938d40b634c13db648b19f9c9207869c8f3e1b"}
Apr 24 21:18:54.632267 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:54.632213    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.632183928 podStartE2EDuration="2.632183928s" podCreationTimestamp="2026-04-24 21:18:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:18:54.629469939 +0000 UTC m=+127.248926564" watchObservedRunningTime="2026-04-24 21:18:54.632183928 +0000 UTC m=+127.251640553"
Apr 24 21:18:57.965810 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:18:57.965778    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:19:00.314823 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:00.314787    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:19:00.315183 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:00.314876    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:19:00.319372 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:00.319352    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:19:00.628724 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:00.628700    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:19:00.675456 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:00.675424    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6685fd9687-cchl5"]
Apr 24 21:19:25.696632 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:25.696587    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6685fd9687-cchl5" podUID="3739a2e1-6c42-441b-bd94-b1d8e8538050" containerName="console" containerID="cri-o://06b3048288970615661408942d35a86671b277a08fbf9b7e96698380ba485e5e" gracePeriod=15
Apr 24 21:19:25.957573 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:25.957500    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6685fd9687-cchl5_3739a2e1-6c42-441b-bd94-b1d8e8538050/console/0.log"
Apr 24 21:19:25.957726 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:25.957575    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:19:26.050669 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.050643    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-service-ca\") pod \"3739a2e1-6c42-441b-bd94-b1d8e8538050\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") "
Apr 24 21:19:26.050837 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.050676    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3739a2e1-6c42-441b-bd94-b1d8e8538050-console-serving-cert\") pod \"3739a2e1-6c42-441b-bd94-b1d8e8538050\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") "
Apr 24 21:19:26.050837 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.050710    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-oauth-serving-cert\") pod \"3739a2e1-6c42-441b-bd94-b1d8e8538050\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") "
Apr 24 21:19:26.050837 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.050748    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrs2s\" (UniqueName: \"kubernetes.io/projected/3739a2e1-6c42-441b-bd94-b1d8e8538050-kube-api-access-zrs2s\") pod \"3739a2e1-6c42-441b-bd94-b1d8e8538050\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") "
Apr 24 21:19:26.050968 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.050878    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-console-config\") pod \"3739a2e1-6c42-441b-bd94-b1d8e8538050\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") "
Apr 24 21:19:26.050968 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.050961    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3739a2e1-6c42-441b-bd94-b1d8e8538050-console-oauth-config\") pod \"3739a2e1-6c42-441b-bd94-b1d8e8538050\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") "
Apr 24 21:19:26.051073 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.051025    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-trusted-ca-bundle\") pod \"3739a2e1-6c42-441b-bd94-b1d8e8538050\" (UID: \"3739a2e1-6c42-441b-bd94-b1d8e8538050\") "
Apr 24 21:19:26.051164 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.051125    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-service-ca" (OuterVolumeSpecName: "service-ca") pod "3739a2e1-6c42-441b-bd94-b1d8e8538050" (UID: "3739a2e1-6c42-441b-bd94-b1d8e8538050"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 24 21:19:26.051230 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.051177    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3739a2e1-6c42-441b-bd94-b1d8e8538050" (UID: "3739a2e1-6c42-441b-bd94-b1d8e8538050"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 24 21:19:26.051311 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.051252    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-console-config" (OuterVolumeSpecName: "console-config") pod "3739a2e1-6c42-441b-bd94-b1d8e8538050" (UID: "3739a2e1-6c42-441b-bd94-b1d8e8538050"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 24 21:19:26.051509 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.051480    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3739a2e1-6c42-441b-bd94-b1d8e8538050" (UID: "3739a2e1-6c42-441b-bd94-b1d8e8538050"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 24 21:19:26.051604 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.051515    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-service-ca\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:19:26.051604 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.051538    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-oauth-serving-cert\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:19:26.051604 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.051553    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-console-config\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:19:26.052898 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.052878    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3739a2e1-6c42-441b-bd94-b1d8e8538050-kube-api-access-zrs2s" (OuterVolumeSpecName: "kube-api-access-zrs2s") pod "3739a2e1-6c42-441b-bd94-b1d8e8538050" (UID: "3739a2e1-6c42-441b-bd94-b1d8e8538050"). InnerVolumeSpecName "kube-api-access-zrs2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Apr 24 21:19:26.053289 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.053268    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3739a2e1-6c42-441b-bd94-b1d8e8538050-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3739a2e1-6c42-441b-bd94-b1d8e8538050" (UID: "3739a2e1-6c42-441b-bd94-b1d8e8538050"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:19:26.053366 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.053328    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3739a2e1-6c42-441b-bd94-b1d8e8538050-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3739a2e1-6c42-441b-bd94-b1d8e8538050" (UID: "3739a2e1-6c42-441b-bd94-b1d8e8538050"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:19:26.151961 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.151922    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrs2s\" (UniqueName: \"kubernetes.io/projected/3739a2e1-6c42-441b-bd94-b1d8e8538050-kube-api-access-zrs2s\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:19:26.151961 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.151955    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3739a2e1-6c42-441b-bd94-b1d8e8538050-console-oauth-config\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:19:26.151961 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.151964    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3739a2e1-6c42-441b-bd94-b1d8e8538050-trusted-ca-bundle\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:19:26.151961 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.151973    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3739a2e1-6c42-441b-bd94-b1d8e8538050-console-serving-cert\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:19:26.711448 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.711420    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6685fd9687-cchl5_3739a2e1-6c42-441b-bd94-b1d8e8538050/console/0.log"
Apr 24 21:19:26.711883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.711459    2569 generic.go:358] "Generic (PLEG): container finished" podID="3739a2e1-6c42-441b-bd94-b1d8e8538050" containerID="06b3048288970615661408942d35a86671b277a08fbf9b7e96698380ba485e5e" exitCode=2
Apr 24 21:19:26.711883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.711510    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6685fd9687-cchl5" event={"ID":"3739a2e1-6c42-441b-bd94-b1d8e8538050","Type":"ContainerDied","Data":"06b3048288970615661408942d35a86671b277a08fbf9b7e96698380ba485e5e"}
Apr 24 21:19:26.711883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.711534    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6685fd9687-cchl5" event={"ID":"3739a2e1-6c42-441b-bd94-b1d8e8538050","Type":"ContainerDied","Data":"820af2ed167301b2f88e4b42166ee0741cc0bf1cef1d81c4161f0eab877bfd70"}
Apr 24 21:19:26.711883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.711532    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6685fd9687-cchl5"
Apr 24 21:19:26.711883 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.711545    2569 scope.go:117] "RemoveContainer" containerID="06b3048288970615661408942d35a86671b277a08fbf9b7e96698380ba485e5e"
Apr 24 21:19:26.720333 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.720311    2569 scope.go:117] "RemoveContainer" containerID="06b3048288970615661408942d35a86671b277a08fbf9b7e96698380ba485e5e"
Apr 24 21:19:26.720643 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:19:26.720625    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06b3048288970615661408942d35a86671b277a08fbf9b7e96698380ba485e5e\": container with ID starting with 06b3048288970615661408942d35a86671b277a08fbf9b7e96698380ba485e5e not found: ID does not exist" containerID="06b3048288970615661408942d35a86671b277a08fbf9b7e96698380ba485e5e"
Apr 24 21:19:26.720701 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.720651    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06b3048288970615661408942d35a86671b277a08fbf9b7e96698380ba485e5e"} err="failed to get container status \"06b3048288970615661408942d35a86671b277a08fbf9b7e96698380ba485e5e\": rpc error: code = NotFound desc = could not find container \"06b3048288970615661408942d35a86671b277a08fbf9b7e96698380ba485e5e\": container with ID starting with 06b3048288970615661408942d35a86671b277a08fbf9b7e96698380ba485e5e not found: ID does not exist"
Apr 24 21:19:26.733568 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.733531    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6685fd9687-cchl5"]
Apr 24 21:19:26.736274 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:26.736246    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6685fd9687-cchl5"]
Apr 24 21:19:27.960045 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:27.960010    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3739a2e1-6c42-441b-bd94-b1d8e8538050" path="/var/lib/kubelet/pods/3739a2e1-6c42-441b-bd94-b1d8e8538050/volumes"
Apr 24 21:19:52.965839 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:52.965808    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:19:52.981019 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:52.980989    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:19:53.810411 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:19:53.810370    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Apr 24 21:21:47.845152 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:21:47.845129    2569 kubelet.go:1628] "Image garbage collection succeeded"
Apr 24 21:21:51.589265 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:21:51.589232    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-tllmj"]
Apr 24 21:21:51.591571 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:21:51.589617    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3739a2e1-6c42-441b-bd94-b1d8e8538050" containerName="console"
Apr 24 21:21:51.591571 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:21:51.589633    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3739a2e1-6c42-441b-bd94-b1d8e8538050" containerName="console"
Apr 24 21:21:51.591571 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:21:51.589692    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="3739a2e1-6c42-441b-bd94-b1d8e8538050" containerName="console"
Apr 24 21:21:51.592362 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:21:51.592347    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-tllmj"
Apr 24 21:21:51.595045 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:21:51.595020    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-ldzhr\""
Apr 24 21:21:51.595954 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:21:51.595935    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Apr 24 21:21:51.596046 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:21:51.596002    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Apr 24 21:21:51.600650 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:21:51.600629    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-tllmj"]
Apr 24 21:21:51.687648 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:21:51.687621    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b862b4d7-eb48-42d4-9632-6f5dfeb8113b-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-tllmj\" (UID: \"b862b4d7-eb48-42d4-9632-6f5dfeb8113b\") " pod="cert-manager/cert-manager-webhook-587ccfb98-tllmj"
Apr 24 21:21:51.687759 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:21:51.687657    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7n98\" (UniqueName: \"kubernetes.io/projected/b862b4d7-eb48-42d4-9632-6f5dfeb8113b-kube-api-access-b7n98\") pod \"cert-manager-webhook-587ccfb98-tllmj\" (UID: \"b862b4d7-eb48-42d4-9632-6f5dfeb8113b\") " pod="cert-manager/cert-manager-webhook-587ccfb98-tllmj"
Apr 24 21:21:51.788130 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:21:51.788102    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b862b4d7-eb48-42d4-9632-6f5dfeb8113b-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-tllmj\" (UID: \"b862b4d7-eb48-42d4-9632-6f5dfeb8113b\") " pod="cert-manager/cert-manager-webhook-587ccfb98-tllmj"
Apr 24 21:21:51.788271 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:21:51.788140    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b7n98\" (UniqueName: \"kubernetes.io/projected/b862b4d7-eb48-42d4-9632-6f5dfeb8113b-kube-api-access-b7n98\") pod \"cert-manager-webhook-587ccfb98-tllmj\" (UID: \"b862b4d7-eb48-42d4-9632-6f5dfeb8113b\") " pod="cert-manager/cert-manager-webhook-587ccfb98-tllmj"
Apr 24 21:21:51.796555 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:21:51.796525    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b862b4d7-eb48-42d4-9632-6f5dfeb8113b-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-tllmj\" (UID: \"b862b4d7-eb48-42d4-9632-6f5dfeb8113b\") " pod="cert-manager/cert-manager-webhook-587ccfb98-tllmj"
Apr 24 21:21:51.796919 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:21:51.796902    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7n98\" (UniqueName: \"kubernetes.io/projected/b862b4d7-eb48-42d4-9632-6f5dfeb8113b-kube-api-access-b7n98\") pod \"cert-manager-webhook-587ccfb98-tllmj\" (UID: \"b862b4d7-eb48-42d4-9632-6f5dfeb8113b\") " pod="cert-manager/cert-manager-webhook-587ccfb98-tllmj"
Apr 24 21:21:51.916170 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:21:51.916145    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-tllmj"
Apr 24 21:21:52.037076 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:21:52.037054    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-tllmj"]
Apr 24 21:21:52.039342 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:21:52.039313    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb862b4d7_eb48_42d4_9632_6f5dfeb8113b.slice/crio-cd33412676444357967c8de8955c4514a8dc52825963187815b26cd12cd68bf4 WatchSource:0}: Error finding container cd33412676444357967c8de8955c4514a8dc52825963187815b26cd12cd68bf4: Status 404 returned error can't find the container with id cd33412676444357967c8de8955c4514a8dc52825963187815b26cd12cd68bf4
Apr 24 21:21:52.041212 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:21:52.041197    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Apr 24 21:21:52.137559 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:21:52.137526    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-tllmj" event={"ID":"b862b4d7-eb48-42d4-9632-6f5dfeb8113b","Type":"ContainerStarted","Data":"cd33412676444357967c8de8955c4514a8dc52825963187815b26cd12cd68bf4"}
Apr 24 21:21:59.163549 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:21:59.163512    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-tllmj" event={"ID":"b862b4d7-eb48-42d4-9632-6f5dfeb8113b","Type":"ContainerStarted","Data":"58f8930adb17ca89b4eb50e894d08f51ad189e9d5212b9ab31bad72133572a11"}
Apr 24 21:21:59.163906 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:21:59.163576    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-tllmj"
Apr 24 21:21:59.179788 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:21:59.179741    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-tllmj" podStartSLOduration=2.102948965 podStartE2EDuration="8.179728276s" podCreationTimestamp="2026-04-24 21:21:51 +0000 UTC" firstStartedPulling="2026-04-24 21:21:52.041320741 +0000 UTC m=+304.660777345" lastFinishedPulling="2026-04-24 21:21:58.118100038 +0000 UTC m=+310.737556656" observedRunningTime="2026-04-24 21:21:59.178659783 +0000 UTC m=+311.798116432" watchObservedRunningTime="2026-04-24 21:21:59.179728276 +0000 UTC m=+311.799184900"
Apr 24 21:22:05.167932 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:05.167906    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-tllmj"
Apr 24 21:22:31.601286 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:31.601198    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f997f587c-8xtsj"]
Apr 24 21:22:31.604625 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:31.604605    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f997f587c-8xtsj"
Apr 24 21:22:31.608230 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:31.608186    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Apr 24 21:22:31.608230 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:31.608211    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Apr 24 21:22:31.608477 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:31.608206    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-kt5gk\""
Apr 24 21:22:31.608591 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:31.608573    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Apr 24 21:22:31.608663 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:31.608633    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Apr 24 21:22:31.608717 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:31.608701    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Apr 24 21:22:31.614430 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:31.614406    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f997f587c-8xtsj"]
Apr 24 21:22:31.738666 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:31.738633    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e-manager-config\") pod \"lws-controller-manager-7f997f587c-8xtsj\" (UID: \"332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e\") " pod="openshift-lws-operator/lws-controller-manager-7f997f587c-8xtsj"
Apr 24 21:22:31.738848 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:31.738699    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e-cert\") pod \"lws-controller-manager-7f997f587c-8xtsj\" (UID: \"332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e\") " pod="openshift-lws-operator/lws-controller-manager-7f997f587c-8xtsj"
Apr 24 21:22:31.738848 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:31.738717    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e-metrics-cert\") pod \"lws-controller-manager-7f997f587c-8xtsj\" (UID: \"332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e\") " pod="openshift-lws-operator/lws-controller-manager-7f997f587c-8xtsj"
Apr 24 21:22:31.738848 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:31.738739    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czfw2\" (UniqueName: \"kubernetes.io/projected/332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e-kube-api-access-czfw2\") pod \"lws-controller-manager-7f997f587c-8xtsj\" (UID: \"332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e\") " pod="openshift-lws-operator/lws-controller-manager-7f997f587c-8xtsj"
Apr 24 21:22:31.839648 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:31.839595    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e-manager-config\") pod \"lws-controller-manager-7f997f587c-8xtsj\" (UID: \"332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e\") " pod="openshift-lws-operator/lws-controller-manager-7f997f587c-8xtsj"
Apr 24 21:22:31.839823 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:31.839684    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e-cert\") pod \"lws-controller-manager-7f997f587c-8xtsj\" (UID: \"332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e\") " pod="openshift-lws-operator/lws-controller-manager-7f997f587c-8xtsj"
Apr 24 21:22:31.839823 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:31.839700    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e-metrics-cert\") pod \"lws-controller-manager-7f997f587c-8xtsj\" (UID: \"332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e\") " pod="openshift-lws-operator/lws-controller-manager-7f997f587c-8xtsj"
Apr 24 21:22:31.839823 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:31.839723    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czfw2\" (UniqueName: \"kubernetes.io/projected/332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e-kube-api-access-czfw2\") pod \"lws-controller-manager-7f997f587c-8xtsj\" (UID: \"332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e\") " pod="openshift-lws-operator/lws-controller-manager-7f997f587c-8xtsj"
Apr 24 21:22:31.840244 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:31.840215    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e-manager-config\") pod \"lws-controller-manager-7f997f587c-8xtsj\" (UID: \"332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e\") " pod="openshift-lws-operator/lws-controller-manager-7f997f587c-8xtsj"
Apr 24 21:22:31.842307 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:31.842284    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e-cert\") pod \"lws-controller-manager-7f997f587c-8xtsj\" (UID: \"332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e\") " pod="openshift-lws-operator/lws-controller-manager-7f997f587c-8xtsj"
Apr 24 21:22:31.842411 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:31.842284    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e-metrics-cert\") pod \"lws-controller-manager-7f997f587c-8xtsj\" (UID: \"332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e\") " pod="openshift-lws-operator/lws-controller-manager-7f997f587c-8xtsj"
Apr 24 21:22:31.847236 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:31.847214    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czfw2\" (UniqueName: \"kubernetes.io/projected/332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e-kube-api-access-czfw2\") pod \"lws-controller-manager-7f997f587c-8xtsj\" (UID: \"332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e\") " pod="openshift-lws-operator/lws-controller-manager-7f997f587c-8xtsj"
Apr 24 21:22:31.915506 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:31.915472    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f997f587c-8xtsj"
Apr 24 21:22:32.037079 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:32.037052    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f997f587c-8xtsj"]
Apr 24 21:22:32.039591 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:22:32.039555    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod332ab0d1_5fb6_4a28_b7d7_348fdf59fc8e.slice/crio-1b70046ef31e446b764d9209d60a1c140ba818432186ebdbdda029685999be22 WatchSource:0}: Error finding container 1b70046ef31e446b764d9209d60a1c140ba818432186ebdbdda029685999be22: Status 404 returned error can't find the container with id 1b70046ef31e446b764d9209d60a1c140ba818432186ebdbdda029685999be22
Apr 24 21:22:32.263450 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:32.263350    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f997f587c-8xtsj" event={"ID":"332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e","Type":"ContainerStarted","Data":"1b70046ef31e446b764d9209d60a1c140ba818432186ebdbdda029685999be22"}
Apr 24 21:22:35.276658 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:35.276621    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f997f587c-8xtsj" event={"ID":"332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e","Type":"ContainerStarted","Data":"d60a65e04460a2da7a8e1fe4ecf1b2eafd8ea094bab99d03479f4315858e4fd5"}
Apr 24 21:22:35.277069 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:35.276737    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7f997f587c-8xtsj"
Apr 24 21:22:45.602007 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.601939    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7f997f587c-8xtsj" podStartSLOduration=12.097649507 podStartE2EDuration="14.601919005s" podCreationTimestamp="2026-04-24 21:22:31 +0000 UTC" firstStartedPulling="2026-04-24 21:22:32.041435961 +0000 UTC m=+344.660892568" lastFinishedPulling="2026-04-24 21:22:34.54570546 +0000 UTC m=+347.165162066" observedRunningTime="2026-04-24 21:22:35.381253164 +0000 UTC m=+348.000709792" watchObservedRunningTime="2026-04-24 21:22:45.601919005 +0000 UTC m=+358.221375630"
Apr 24 21:22:45.602590 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.602199    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-8c564f69f-4hd9f"]
Apr 24 21:22:45.605890 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.605859    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:45.621290 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.621254    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8c564f69f-4hd9f"]
Apr 24 21:22:45.765104 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.765050    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c7abc73-226a-4d81-8f9a-198998ce37a5-console-config\") pod \"console-8c564f69f-4hd9f\" (UID: \"3c7abc73-226a-4d81-8f9a-198998ce37a5\") " pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:45.765310 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.765114    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn6np\" (UniqueName: \"kubernetes.io/projected/3c7abc73-226a-4d81-8f9a-198998ce37a5-kube-api-access-xn6np\") pod \"console-8c564f69f-4hd9f\" (UID: \"3c7abc73-226a-4d81-8f9a-198998ce37a5\") " pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:45.765310 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.765159    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c7abc73-226a-4d81-8f9a-198998ce37a5-console-oauth-config\") pod \"console-8c564f69f-4hd9f\" (UID: \"3c7abc73-226a-4d81-8f9a-198998ce37a5\") " pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:45.765310 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.765200    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c7abc73-226a-4d81-8f9a-198998ce37a5-service-ca\") pod \"console-8c564f69f-4hd9f\" (UID: \"3c7abc73-226a-4d81-8f9a-198998ce37a5\") " pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:45.765310 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.765229    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c7abc73-226a-4d81-8f9a-198998ce37a5-console-serving-cert\") pod \"console-8c564f69f-4hd9f\" (UID: \"3c7abc73-226a-4d81-8f9a-198998ce37a5\") " pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:45.765310 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.765252    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c7abc73-226a-4d81-8f9a-198998ce37a5-trusted-ca-bundle\") pod \"console-8c564f69f-4hd9f\" (UID: \"3c7abc73-226a-4d81-8f9a-198998ce37a5\") " pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:45.765545 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.765358    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c7abc73-226a-4d81-8f9a-198998ce37a5-oauth-serving-cert\") pod \"console-8c564f69f-4hd9f\" (UID: \"3c7abc73-226a-4d81-8f9a-198998ce37a5\") " pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:45.866728 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.866631    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c7abc73-226a-4d81-8f9a-198998ce37a5-console-config\") pod \"console-8c564f69f-4hd9f\" (UID: \"3c7abc73-226a-4d81-8f9a-198998ce37a5\") " pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:45.866728 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.866686    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xn6np\" (UniqueName: \"kubernetes.io/projected/3c7abc73-226a-4d81-8f9a-198998ce37a5-kube-api-access-xn6np\") pod \"console-8c564f69f-4hd9f\" (UID: \"3c7abc73-226a-4d81-8f9a-198998ce37a5\") " pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:45.866728 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.866729    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c7abc73-226a-4d81-8f9a-198998ce37a5-console-oauth-config\") pod \"console-8c564f69f-4hd9f\" (UID: \"3c7abc73-226a-4d81-8f9a-198998ce37a5\") " pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:45.867002 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.866750    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c7abc73-226a-4d81-8f9a-198998ce37a5-service-ca\") pod \"console-8c564f69f-4hd9f\" (UID: \"3c7abc73-226a-4d81-8f9a-198998ce37a5\") " pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:45.867002 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.866779    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c7abc73-226a-4d81-8f9a-198998ce37a5-console-serving-cert\") pod \"console-8c564f69f-4hd9f\" (UID: \"3c7abc73-226a-4d81-8f9a-198998ce37a5\") " pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:45.867002 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.866802    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c7abc73-226a-4d81-8f9a-198998ce37a5-trusted-ca-bundle\") pod \"console-8c564f69f-4hd9f\" (UID: \"3c7abc73-226a-4d81-8f9a-198998ce37a5\") " pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:45.867002 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.866853    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c7abc73-226a-4d81-8f9a-198998ce37a5-oauth-serving-cert\") pod \"console-8c564f69f-4hd9f\" (UID: \"3c7abc73-226a-4d81-8f9a-198998ce37a5\") " pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:45.867497 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.867464    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c7abc73-226a-4d81-8f9a-198998ce37a5-console-config\") pod \"console-8c564f69f-4hd9f\" (UID: \"3c7abc73-226a-4d81-8f9a-198998ce37a5\") " pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:45.867643 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.867535    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c7abc73-226a-4d81-8f9a-198998ce37a5-oauth-serving-cert\") pod \"console-8c564f69f-4hd9f\" (UID: \"3c7abc73-226a-4d81-8f9a-198998ce37a5\") " pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:45.867643 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.867591    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c7abc73-226a-4d81-8f9a-198998ce37a5-service-ca\") pod \"console-8c564f69f-4hd9f\" (UID: \"3c7abc73-226a-4d81-8f9a-198998ce37a5\") " pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:45.867801 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.867780    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c7abc73-226a-4d81-8f9a-198998ce37a5-trusted-ca-bundle\") pod \"console-8c564f69f-4hd9f\" (UID: \"3c7abc73-226a-4d81-8f9a-198998ce37a5\") " pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:45.869298 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.869272    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c7abc73-226a-4d81-8f9a-198998ce37a5-console-oauth-config\") pod \"console-8c564f69f-4hd9f\" (UID: \"3c7abc73-226a-4d81-8f9a-198998ce37a5\") " pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:45.869405 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.869316    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c7abc73-226a-4d81-8f9a-198998ce37a5-console-serving-cert\") pod \"console-8c564f69f-4hd9f\" (UID: \"3c7abc73-226a-4d81-8f9a-198998ce37a5\") " pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:45.875218 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.875199    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn6np\" (UniqueName: \"kubernetes.io/projected/3c7abc73-226a-4d81-8f9a-198998ce37a5-kube-api-access-xn6np\") pod \"console-8c564f69f-4hd9f\" (UID: \"3c7abc73-226a-4d81-8f9a-198998ce37a5\") " pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:45.916391 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:45.916353    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:46.035165 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:46.035026    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8c564f69f-4hd9f"]
Apr 24 21:22:46.037858 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:22:46.037825    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c7abc73_226a_4d81_8f9a_198998ce37a5.slice/crio-8f99308c5e54fc261e93151ee4b2f7c84191294695aeeefac6c1b8f94fbdc63e WatchSource:0}: Error finding container 8f99308c5e54fc261e93151ee4b2f7c84191294695aeeefac6c1b8f94fbdc63e: Status 404 returned error can't find the container with id 8f99308c5e54fc261e93151ee4b2f7c84191294695aeeefac6c1b8f94fbdc63e
Apr 24 21:22:46.282236 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:46.282205    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7f997f587c-8xtsj"
Apr 24 21:22:46.311901 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:46.311850    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c564f69f-4hd9f" event={"ID":"3c7abc73-226a-4d81-8f9a-198998ce37a5","Type":"ContainerStarted","Data":"48ad755be37ddf6017c649c41d48750e776f7e1bf4d3dde838effbd3def0e7fc"}
Apr 24 21:22:46.311901 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:46.311908    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c564f69f-4hd9f" event={"ID":"3c7abc73-226a-4d81-8f9a-198998ce37a5","Type":"ContainerStarted","Data":"8f99308c5e54fc261e93151ee4b2f7c84191294695aeeefac6c1b8f94fbdc63e"}
Apr 24 21:22:49.972037 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:49.971985    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-8c564f69f-4hd9f" podStartSLOduration=4.971969745 podStartE2EDuration="4.971969745s" podCreationTimestamp="2026-04-24 21:22:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:22:46.332447241 +0000 UTC m=+358.951903866" watchObservedRunningTime="2026-04-24 21:22:49.971969745 +0000 UTC m=+362.591426372"
Apr 24 21:22:49.972438 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:49.972234    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"]
Apr 24 21:22:49.975768 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:49.975740    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:49.978516 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:49.978491    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Apr 24 21:22:49.978797 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:49.978778    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Apr 24 21:22:49.978926 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:49.978906    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-default-dockercfg-f77rc\""
Apr 24 21:22:49.979062 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:49.979044    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"istio-ca-root-cert\""
Apr 24 21:22:49.994198 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:49.994168    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"]
Apr 24 21:22:50.003959 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.003933    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/635410e6-6fd5-48e0-82e6-e4aed5a9052c-istio-data\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.004071 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.003966    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/635410e6-6fd5-48e0-82e6-e4aed5a9052c-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.004071 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.003994    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6rp5\" (UniqueName: \"kubernetes.io/projected/635410e6-6fd5-48e0-82e6-e4aed5a9052c-kube-api-access-b6rp5\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.004071 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.004019    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/635410e6-6fd5-48e0-82e6-e4aed5a9052c-credential-socket\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.004071 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.004037    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/635410e6-6fd5-48e0-82e6-e4aed5a9052c-workload-socket\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.004071 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.004053    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/635410e6-6fd5-48e0-82e6-e4aed5a9052c-istio-envoy\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.004298 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.004134    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/635410e6-6fd5-48e0-82e6-e4aed5a9052c-workload-certs\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.004298 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.004204    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/635410e6-6fd5-48e0-82e6-e4aed5a9052c-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.004298 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.004244    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/635410e6-6fd5-48e0-82e6-e4aed5a9052c-istio-token\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.104993 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.104953    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/635410e6-6fd5-48e0-82e6-e4aed5a9052c-istio-data\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.104993 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.104996    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/635410e6-6fd5-48e0-82e6-e4aed5a9052c-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.105246 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.105039    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6rp5\" (UniqueName: \"kubernetes.io/projected/635410e6-6fd5-48e0-82e6-e4aed5a9052c-kube-api-access-b6rp5\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.105246 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.105068    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/635410e6-6fd5-48e0-82e6-e4aed5a9052c-credential-socket\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.105246 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.105096    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/635410e6-6fd5-48e0-82e6-e4aed5a9052c-workload-socket\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.105246 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.105123    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/635410e6-6fd5-48e0-82e6-e4aed5a9052c-istio-envoy\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.105246 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.105166    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/635410e6-6fd5-48e0-82e6-e4aed5a9052c-workload-certs\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.105246 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.105188    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/635410e6-6fd5-48e0-82e6-e4aed5a9052c-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.105560 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.105402    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/635410e6-6fd5-48e0-82e6-e4aed5a9052c-istio-data\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.105560 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.105431    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/635410e6-6fd5-48e0-82e6-e4aed5a9052c-credential-socket\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.105560 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.105445    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/635410e6-6fd5-48e0-82e6-e4aed5a9052c-istio-token\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.105817 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.105793    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/635410e6-6fd5-48e0-82e6-e4aed5a9052c-workload-socket\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.105817 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.105807    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/635410e6-6fd5-48e0-82e6-e4aed5a9052c-workload-certs\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.106159 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.106137    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/635410e6-6fd5-48e0-82e6-e4aed5a9052c-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.107338 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.107315    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/635410e6-6fd5-48e0-82e6-e4aed5a9052c-istio-envoy\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.107645 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.107627    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/635410e6-6fd5-48e0-82e6-e4aed5a9052c-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.112498 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.112469    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/635410e6-6fd5-48e0-82e6-e4aed5a9052c-istio-token\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.112612 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.112596    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6rp5\" (UniqueName: \"kubernetes.io/projected/635410e6-6fd5-48e0-82e6-e4aed5a9052c-kube-api-access-b6rp5\") pod \"openshift-ai-inference-openshift-default-7c5447bb76-q9nvg\" (UID: \"635410e6-6fd5-48e0-82e6-e4aed5a9052c\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.292811 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.292729    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:50.414738 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:50.414715    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"]
Apr 24 21:22:50.416877 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:22:50.416848    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod635410e6_6fd5_48e0_82e6_e4aed5a9052c.slice/crio-4753d5fa99ae354c266312dadef99279afba8f56668b8d62d37ffb28e3fe1496 WatchSource:0}: Error finding container 4753d5fa99ae354c266312dadef99279afba8f56668b8d62d37ffb28e3fe1496: Status 404 returned error can't find the container with id 4753d5fa99ae354c266312dadef99279afba8f56668b8d62d37ffb28e3fe1496
Apr 24 21:22:51.329700 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:51.329660    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg" event={"ID":"635410e6-6fd5-48e0-82e6-e4aed5a9052c","Type":"ContainerStarted","Data":"4753d5fa99ae354c266312dadef99279afba8f56668b8d62d37ffb28e3fe1496"}
Apr 24 21:22:52.486955 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:52.486918    2569 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Apr 24 21:22:52.487212 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:52.486999    2569 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Apr 24 21:22:52.487212 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:52.487026    2569 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Apr 24 21:22:53.337653 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:53.337618    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg" event={"ID":"635410e6-6fd5-48e0-82e6-e4aed5a9052c","Type":"ContainerStarted","Data":"e7a270897ca5f4b7d77b2549dd48257d0d10c18daae1170ed36ee1b9c0ad3acf"}
Apr 24 21:22:53.365055 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:53.365006    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg" podStartSLOduration=2.297175424 podStartE2EDuration="4.364989765s" podCreationTimestamp="2026-04-24 21:22:49 +0000 UTC" firstStartedPulling="2026-04-24 21:22:50.418840513 +0000 UTC m=+363.038297116" lastFinishedPulling="2026-04-24 21:22:52.486654849 +0000 UTC m=+365.106111457" observedRunningTime="2026-04-24 21:22:53.362642649 +0000 UTC m=+365.982099274" watchObservedRunningTime="2026-04-24 21:22:53.364989765 +0000 UTC m=+365.984446391"
Apr 24 21:22:54.293777 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:54.293739    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:54.298509 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:54.298482    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:54.341164 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:54.341132    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:54.342137 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:54.342119    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-q9nvg"
Apr 24 21:22:55.917040 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:55.917000    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:55.917449 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:55.917091    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:55.921854 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:55.921832    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:56.351768 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:56.351683    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8c564f69f-4hd9f"
Apr 24 21:22:56.405036 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:22:56.404987    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-694db545b8-wsrdm"]
Apr 24 21:23:09.430436 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:09.430406    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7587b89b76-dnrb2"]
Apr 24 21:23:09.439171 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:09.439148    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7587b89b76-dnrb2"
Apr 24 21:23:09.441642 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:09.441620    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Apr 24 21:23:09.441642 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:09.441629    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5fd7r\""
Apr 24 21:23:09.441800 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:09.441709    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Apr 24 21:23:09.448442 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:09.448419    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7587b89b76-dnrb2"]
Apr 24 21:23:09.579358 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:09.579322    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr522\" (UniqueName: \"kubernetes.io/projected/3b69685d-7385-4446-b188-5795eea55e15-kube-api-access-mr522\") pod \"authorino-operator-7587b89b76-dnrb2\" (UID: \"3b69685d-7385-4446-b188-5795eea55e15\") " pod="kuadrant-system/authorino-operator-7587b89b76-dnrb2"
Apr 24 21:23:09.680490 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:09.680404    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mr522\" (UniqueName: \"kubernetes.io/projected/3b69685d-7385-4446-b188-5795eea55e15-kube-api-access-mr522\") pod \"authorino-operator-7587b89b76-dnrb2\" (UID: \"3b69685d-7385-4446-b188-5795eea55e15\") " pod="kuadrant-system/authorino-operator-7587b89b76-dnrb2"
Apr 24 21:23:09.688351 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:09.688321    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr522\" (UniqueName: \"kubernetes.io/projected/3b69685d-7385-4446-b188-5795eea55e15-kube-api-access-mr522\") pod \"authorino-operator-7587b89b76-dnrb2\" (UID: \"3b69685d-7385-4446-b188-5795eea55e15\") " pod="kuadrant-system/authorino-operator-7587b89b76-dnrb2"
Apr 24 21:23:09.750399 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:09.750343    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7587b89b76-dnrb2"
Apr 24 21:23:09.868502 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:09.868427    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7587b89b76-dnrb2"]
Apr 24 21:23:09.871774 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:23:09.871742    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b69685d_7385_4446_b188_5795eea55e15.slice/crio-b75d4887dcf39dbf12d00dce06363f6e12ab936caafe0c69abde37b2ed3aa0dc WatchSource:0}: Error finding container b75d4887dcf39dbf12d00dce06363f6e12ab936caafe0c69abde37b2ed3aa0dc: Status 404 returned error can't find the container with id b75d4887dcf39dbf12d00dce06363f6e12ab936caafe0c69abde37b2ed3aa0dc
Apr 24 21:23:10.393619 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:10.393585    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7587b89b76-dnrb2" event={"ID":"3b69685d-7385-4446-b188-5795eea55e15","Type":"ContainerStarted","Data":"b75d4887dcf39dbf12d00dce06363f6e12ab936caafe0c69abde37b2ed3aa0dc"}
Apr 24 21:23:13.405668 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:13.405629    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7587b89b76-dnrb2" event={"ID":"3b69685d-7385-4446-b188-5795eea55e15","Type":"ContainerStarted","Data":"046d0b0bd3779ee6afc94a1037feb1c3b98c3456b40ddfa0f29e27a393761bb9"}
Apr 24 21:23:13.406027 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:13.405758    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7587b89b76-dnrb2"
Apr 24 21:23:13.445845 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:13.445800    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7587b89b76-dnrb2" podStartSLOduration=1.826588337 podStartE2EDuration="4.445785487s" podCreationTimestamp="2026-04-24 21:23:09 +0000 UTC" firstStartedPulling="2026-04-24 21:23:09.874366194 +0000 UTC m=+382.493822796" lastFinishedPulling="2026-04-24 21:23:12.49356333 +0000 UTC m=+385.113019946" observedRunningTime="2026-04-24 21:23:13.443941225 +0000 UTC m=+386.063397849" watchObservedRunningTime="2026-04-24 21:23:13.445785487 +0000 UTC m=+386.065242111"
Apr 24 21:23:13.940672 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:13.940637    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-844548ff4c-2kll4"]
Apr 24 21:23:13.944243 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:13.944220    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-844548ff4c-2kll4"
Apr 24 21:23:13.948000 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:13.947985    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Apr 24 21:23:13.948440 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:13.948422    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-dfz2x\""
Apr 24 21:23:13.954988 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:13.954965    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-844548ff4c-2kll4"]
Apr 24 21:23:14.025895 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:14.025860    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjb2g\" (UniqueName: \"kubernetes.io/projected/40161184-b3c1-48c0-97b9-6eeeb6c54fc8-kube-api-access-mjb2g\") pod \"dns-operator-controller-manager-844548ff4c-2kll4\" (UID: \"40161184-b3c1-48c0-97b9-6eeeb6c54fc8\") " pod="kuadrant-system/dns-operator-controller-manager-844548ff4c-2kll4"
Apr 24 21:23:14.127169 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:14.127126    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mjb2g\" (UniqueName: \"kubernetes.io/projected/40161184-b3c1-48c0-97b9-6eeeb6c54fc8-kube-api-access-mjb2g\") pod \"dns-operator-controller-manager-844548ff4c-2kll4\" (UID: \"40161184-b3c1-48c0-97b9-6eeeb6c54fc8\") " pod="kuadrant-system/dns-operator-controller-manager-844548ff4c-2kll4"
Apr 24 21:23:14.135820 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:14.135791    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjb2g\" (UniqueName: \"kubernetes.io/projected/40161184-b3c1-48c0-97b9-6eeeb6c54fc8-kube-api-access-mjb2g\") pod \"dns-operator-controller-manager-844548ff4c-2kll4\" (UID: \"40161184-b3c1-48c0-97b9-6eeeb6c54fc8\") " pod="kuadrant-system/dns-operator-controller-manager-844548ff4c-2kll4"
Apr 24 21:23:14.254845 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:14.254765    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-844548ff4c-2kll4"
Apr 24 21:23:14.381805 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:14.381737    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-844548ff4c-2kll4"]
Apr 24 21:23:14.384079 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:23:14.384047    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40161184_b3c1_48c0_97b9_6eeeb6c54fc8.slice/crio-6e238db14463f0582acfa77ef60c1ec0d7d0f363e834e7a5d67a5a9eb34e18ea WatchSource:0}: Error finding container 6e238db14463f0582acfa77ef60c1ec0d7d0f363e834e7a5d67a5a9eb34e18ea: Status 404 returned error can't find the container with id 6e238db14463f0582acfa77ef60c1ec0d7d0f363e834e7a5d67a5a9eb34e18ea
Apr 24 21:23:14.409905 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:14.409876    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-844548ff4c-2kll4" event={"ID":"40161184-b3c1-48c0-97b9-6eeeb6c54fc8","Type":"ContainerStarted","Data":"6e238db14463f0582acfa77ef60c1ec0d7d0f363e834e7a5d67a5a9eb34e18ea"}
Apr 24 21:23:16.418754 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:16.418719    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-844548ff4c-2kll4" event={"ID":"40161184-b3c1-48c0-97b9-6eeeb6c54fc8","Type":"ContainerStarted","Data":"3a36a5af98c8e40436d119667206e75c170ae27a7d305cae93dbbd22a9e39a7d"}
Apr 24 21:23:16.419143 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:16.418833    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-844548ff4c-2kll4"
Apr 24 21:23:16.444733 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:16.444674    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-844548ff4c-2kll4" podStartSLOduration=1.789145359 podStartE2EDuration="3.444659244s" podCreationTimestamp="2026-04-24 21:23:13 +0000 UTC" firstStartedPulling="2026-04-24 21:23:14.386258875 +0000 UTC m=+387.005715479" lastFinishedPulling="2026-04-24 21:23:16.041772747 +0000 UTC m=+388.661229364" observedRunningTime="2026-04-24 21:23:16.442203272 +0000 UTC m=+389.061659896" watchObservedRunningTime="2026-04-24 21:23:16.444659244 +0000 UTC m=+389.064115868"
Apr 24 21:23:21.427044 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.427002    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-694db545b8-wsrdm" podUID="0aeda76f-ff9e-48c1-a1ca-b274daf38c15" containerName="console" containerID="cri-o://e7687651a2734c118b0d3c4cd46d6ce3c453172caa02aa79b7529e8a527d1ba8" gracePeriod=15
Apr 24 21:23:21.670784 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.670760    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-694db545b8-wsrdm_0aeda76f-ff9e-48c1-a1ca-b274daf38c15/console/0.log"
Apr 24 21:23:21.670904 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.670823    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:23:21.799578 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.799493    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-console-oauth-config\") pod \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") "
Apr 24 21:23:21.799578 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.799570    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-console-config\") pod \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") "
Apr 24 21:23:21.799809 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.799595    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnrv5\" (UniqueName: \"kubernetes.io/projected/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-kube-api-access-bnrv5\") pod \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") "
Apr 24 21:23:21.799809 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.799623    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-oauth-serving-cert\") pod \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") "
Apr 24 21:23:21.799809 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.799658    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-console-serving-cert\") pod \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") "
Apr 24 21:23:21.799809 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.799701    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-trusted-ca-bundle\") pod \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") "
Apr 24 21:23:21.799809 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.799737    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-service-ca\") pod \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\" (UID: \"0aeda76f-ff9e-48c1-a1ca-b274daf38c15\") "
Apr 24 21:23:21.800060 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.800024    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-console-config" (OuterVolumeSpecName: "console-config") pod "0aeda76f-ff9e-48c1-a1ca-b274daf38c15" (UID: "0aeda76f-ff9e-48c1-a1ca-b274daf38c15"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 24 21:23:21.800166 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.800141    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0aeda76f-ff9e-48c1-a1ca-b274daf38c15" (UID: "0aeda76f-ff9e-48c1-a1ca-b274daf38c15"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 24 21:23:21.800355 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.800328    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-service-ca" (OuterVolumeSpecName: "service-ca") pod "0aeda76f-ff9e-48c1-a1ca-b274daf38c15" (UID: "0aeda76f-ff9e-48c1-a1ca-b274daf38c15"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 24 21:23:21.800572 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.800547    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0aeda76f-ff9e-48c1-a1ca-b274daf38c15" (UID: "0aeda76f-ff9e-48c1-a1ca-b274daf38c15"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Apr 24 21:23:21.801796 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.801767    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0aeda76f-ff9e-48c1-a1ca-b274daf38c15" (UID: "0aeda76f-ff9e-48c1-a1ca-b274daf38c15"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:23:21.801895 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.801789    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0aeda76f-ff9e-48c1-a1ca-b274daf38c15" (UID: "0aeda76f-ff9e-48c1-a1ca-b274daf38c15"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:23:21.801895 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.801817    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-kube-api-access-bnrv5" (OuterVolumeSpecName: "kube-api-access-bnrv5") pod "0aeda76f-ff9e-48c1-a1ca-b274daf38c15" (UID: "0aeda76f-ff9e-48c1-a1ca-b274daf38c15"). InnerVolumeSpecName "kube-api-access-bnrv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Apr 24 21:23:21.901212 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.901176    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-console-serving-cert\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:23:21.901212 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.901206    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-trusted-ca-bundle\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:23:21.901212 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.901218    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-service-ca\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:23:21.901467 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.901227    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-console-oauth-config\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:23:21.901467 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.901236    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-console-config\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:23:21.901467 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.901246    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnrv5\" (UniqueName: \"kubernetes.io/projected/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-kube-api-access-bnrv5\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:23:21.901467 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:21.901255    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0aeda76f-ff9e-48c1-a1ca-b274daf38c15-oauth-serving-cert\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:23:22.439859 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:22.439827    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-694db545b8-wsrdm_0aeda76f-ff9e-48c1-a1ca-b274daf38c15/console/0.log"
Apr 24 21:23:22.440315 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:22.439875    2569 generic.go:358] "Generic (PLEG): container finished" podID="0aeda76f-ff9e-48c1-a1ca-b274daf38c15" containerID="e7687651a2734c118b0d3c4cd46d6ce3c453172caa02aa79b7529e8a527d1ba8" exitCode=2
Apr 24 21:23:22.440315 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:22.439944    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-694db545b8-wsrdm"
Apr 24 21:23:22.440315 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:22.439966    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-694db545b8-wsrdm" event={"ID":"0aeda76f-ff9e-48c1-a1ca-b274daf38c15","Type":"ContainerDied","Data":"e7687651a2734c118b0d3c4cd46d6ce3c453172caa02aa79b7529e8a527d1ba8"}
Apr 24 21:23:22.440315 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:22.440009    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-694db545b8-wsrdm" event={"ID":"0aeda76f-ff9e-48c1-a1ca-b274daf38c15","Type":"ContainerDied","Data":"78b3ec3c3160e4f2143e4daac79e90acdc9c49053f02c93f9e53d94c27b946f6"}
Apr 24 21:23:22.440315 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:22.440031    2569 scope.go:117] "RemoveContainer" containerID="e7687651a2734c118b0d3c4cd46d6ce3c453172caa02aa79b7529e8a527d1ba8"
Apr 24 21:23:22.448081 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:22.448063    2569 scope.go:117] "RemoveContainer" containerID="e7687651a2734c118b0d3c4cd46d6ce3c453172caa02aa79b7529e8a527d1ba8"
Apr 24 21:23:22.448335 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:23:22.448315    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7687651a2734c118b0d3c4cd46d6ce3c453172caa02aa79b7529e8a527d1ba8\": container with ID starting with e7687651a2734c118b0d3c4cd46d6ce3c453172caa02aa79b7529e8a527d1ba8 not found: ID does not exist" containerID="e7687651a2734c118b0d3c4cd46d6ce3c453172caa02aa79b7529e8a527d1ba8"
Apr 24 21:23:22.448451 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:22.448344    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7687651a2734c118b0d3c4cd46d6ce3c453172caa02aa79b7529e8a527d1ba8"} err="failed to get container status \"e7687651a2734c118b0d3c4cd46d6ce3c453172caa02aa79b7529e8a527d1ba8\": rpc error: code = NotFound desc = could not find container \"e7687651a2734c118b0d3c4cd46d6ce3c453172caa02aa79b7529e8a527d1ba8\": container with ID starting with e7687651a2734c118b0d3c4cd46d6ce3c453172caa02aa79b7529e8a527d1ba8 not found: ID does not exist"
Apr 24 21:23:22.458100 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:22.458074    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-694db545b8-wsrdm"]
Apr 24 21:23:22.462953 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:22.462933    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-694db545b8-wsrdm"]
Apr 24 21:23:23.961526 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:23.961490    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0aeda76f-ff9e-48c1-a1ca-b274daf38c15" path="/var/lib/kubelet/pods/0aeda76f-ff9e-48c1-a1ca-b274daf38c15/volumes"
Apr 24 21:23:24.412438 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:24.412410    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7587b89b76-dnrb2"
Apr 24 21:23:27.424936 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:23:27.424894    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-844548ff4c-2kll4"
Apr 24 21:24:08.700941 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:24:08.700860    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-67566c68b4-59664"]
Apr 24 21:24:08.701355 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:24:08.701285    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aeda76f-ff9e-48c1-a1ca-b274daf38c15" containerName="console"
Apr 24 21:24:08.701355 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:24:08.701297    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aeda76f-ff9e-48c1-a1ca-b274daf38c15" containerName="console"
Apr 24 21:24:08.701468 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:24:08.701363    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="0aeda76f-ff9e-48c1-a1ca-b274daf38c15" containerName="console"
Apr 24 21:24:08.704267 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:24:08.704247    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-67566c68b4-59664"
Apr 24 21:24:08.707904 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:24:08.707884    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Apr 24 21:24:08.708012 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:24:08.707985    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pqks9\""
Apr 24 21:24:08.716845 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:24:08.716825    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-67566c68b4-59664"]
Apr 24 21:24:08.755429 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:24:08.755396    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-67566c68b4-59664"]
Apr 24 21:24:08.833514 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:24:08.833488    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0e53de14-6d55-4f8c-96fc-280ab41b6dbc-config-file\") pod \"limitador-limitador-67566c68b4-59664\" (UID: \"0e53de14-6d55-4f8c-96fc-280ab41b6dbc\") " pod="kuadrant-system/limitador-limitador-67566c68b4-59664"
Apr 24 21:24:08.833635 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:24:08.833604    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6s6p\" (UniqueName: \"kubernetes.io/projected/0e53de14-6d55-4f8c-96fc-280ab41b6dbc-kube-api-access-n6s6p\") pod \"limitador-limitador-67566c68b4-59664\" (UID: \"0e53de14-6d55-4f8c-96fc-280ab41b6dbc\") " pod="kuadrant-system/limitador-limitador-67566c68b4-59664"
Apr 24 21:24:08.934091 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:24:08.934061    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0e53de14-6d55-4f8c-96fc-280ab41b6dbc-config-file\") pod \"limitador-limitador-67566c68b4-59664\" (UID: \"0e53de14-6d55-4f8c-96fc-280ab41b6dbc\") " pod="kuadrant-system/limitador-limitador-67566c68b4-59664"
Apr 24 21:24:08.934258 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:24:08.934155    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6s6p\" (UniqueName: \"kubernetes.io/projected/0e53de14-6d55-4f8c-96fc-280ab41b6dbc-kube-api-access-n6s6p\") pod \"limitador-limitador-67566c68b4-59664\" (UID: \"0e53de14-6d55-4f8c-96fc-280ab41b6dbc\") " pod="kuadrant-system/limitador-limitador-67566c68b4-59664"
Apr 24 21:24:08.934670 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:24:08.934653    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0e53de14-6d55-4f8c-96fc-280ab41b6dbc-config-file\") pod \"limitador-limitador-67566c68b4-59664\" (UID: \"0e53de14-6d55-4f8c-96fc-280ab41b6dbc\") " pod="kuadrant-system/limitador-limitador-67566c68b4-59664"
Apr 24 21:24:08.942156 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:24:08.942132    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6s6p\" (UniqueName: \"kubernetes.io/projected/0e53de14-6d55-4f8c-96fc-280ab41b6dbc-kube-api-access-n6s6p\") pod \"limitador-limitador-67566c68b4-59664\" (UID: \"0e53de14-6d55-4f8c-96fc-280ab41b6dbc\") " pod="kuadrant-system/limitador-limitador-67566c68b4-59664"
Apr 24 21:24:09.014523 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:24:09.014463    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-67566c68b4-59664"
Apr 24 21:24:09.133771 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:24:09.133741    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-67566c68b4-59664"]
Apr 24 21:24:09.138362 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:24:09.138331    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e53de14_6d55_4f8c_96fc_280ab41b6dbc.slice/crio-e3a7c0e247bdd46af167ec0443e061a8c1e2859f873ab513cb7372596e0f0bdb WatchSource:0}: Error finding container e3a7c0e247bdd46af167ec0443e061a8c1e2859f873ab513cb7372596e0f0bdb: Status 404 returned error can't find the container with id e3a7c0e247bdd46af167ec0443e061a8c1e2859f873ab513cb7372596e0f0bdb
Apr 24 21:24:09.595544 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:24:09.595510    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-67566c68b4-59664" event={"ID":"0e53de14-6d55-4f8c-96fc-280ab41b6dbc","Type":"ContainerStarted","Data":"e3a7c0e247bdd46af167ec0443e061a8c1e2859f873ab513cb7372596e0f0bdb"}
Apr 24 21:24:13.616140 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:24:13.616102    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-67566c68b4-59664" event={"ID":"0e53de14-6d55-4f8c-96fc-280ab41b6dbc","Type":"ContainerStarted","Data":"3ff7be10a743351ef99afd64b91efbd3a9b515e71226d28374e3e325fb68d673"}
Apr 24 21:24:13.616585 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:24:13.616269    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-67566c68b4-59664"
Apr 24 21:24:13.638835 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:24:13.638784    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-67566c68b4-59664" podStartSLOduration=2.007315319 podStartE2EDuration="5.638771974s" podCreationTimestamp="2026-04-24 21:24:08 +0000 UTC" firstStartedPulling="2026-04-24 21:24:09.140261782 +0000 UTC m=+441.759718385" lastFinishedPulling="2026-04-24 21:24:12.771718433 +0000 UTC m=+445.391175040" observedRunningTime="2026-04-24 21:24:13.63731649 +0000 UTC m=+446.256773128" watchObservedRunningTime="2026-04-24 21:24:13.638771974 +0000 UTC m=+446.258228599"
Apr 24 21:24:24.620710 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:24:24.620678    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-67566c68b4-59664"
Apr 24 21:26:06.017374 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:26:06.017341    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-696fc77849-ft9w6"]
Apr 24 21:26:06.019729 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:26:06.019709    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-696fc77849-ft9w6"
Apr 24 21:26:06.022746 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:26:06.022724    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\""
Apr 24 21:26:06.022746 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:26:06.022734    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Apr 24 21:26:06.022922 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:26:06.022766    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Apr 24 21:26:06.023759 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:26:06.023741    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-24s6b\""
Apr 24 21:26:06.028758 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:26:06.028734    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-696fc77849-ft9w6"]
Apr 24 21:26:06.097811 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:26:06.097781    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9139b1f1-263a-46b4-9d76-99bd707dfd00-cert\") pod \"odh-model-controller-696fc77849-ft9w6\" (UID: \"9139b1f1-263a-46b4-9d76-99bd707dfd00\") " pod="kserve/odh-model-controller-696fc77849-ft9w6"
Apr 24 21:26:06.098000 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:26:06.097820    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkdh7\" (UniqueName: \"kubernetes.io/projected/9139b1f1-263a-46b4-9d76-99bd707dfd00-kube-api-access-vkdh7\") pod \"odh-model-controller-696fc77849-ft9w6\" (UID: \"9139b1f1-263a-46b4-9d76-99bd707dfd00\") " pod="kserve/odh-model-controller-696fc77849-ft9w6"
Apr 24 21:26:06.199459 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:26:06.199427    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9139b1f1-263a-46b4-9d76-99bd707dfd00-cert\") pod \"odh-model-controller-696fc77849-ft9w6\" (UID: \"9139b1f1-263a-46b4-9d76-99bd707dfd00\") " pod="kserve/odh-model-controller-696fc77849-ft9w6"
Apr 24 21:26:06.199642 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:26:06.199466    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vkdh7\" (UniqueName: \"kubernetes.io/projected/9139b1f1-263a-46b4-9d76-99bd707dfd00-kube-api-access-vkdh7\") pod \"odh-model-controller-696fc77849-ft9w6\" (UID: \"9139b1f1-263a-46b4-9d76-99bd707dfd00\") " pod="kserve/odh-model-controller-696fc77849-ft9w6"
Apr 24 21:26:06.199642 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:26:06.199587    2569 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Apr 24 21:26:06.199773 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:26:06.199665    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9139b1f1-263a-46b4-9d76-99bd707dfd00-cert podName:9139b1f1-263a-46b4-9d76-99bd707dfd00 nodeName:}" failed. No retries permitted until 2026-04-24 21:26:06.699645252 +0000 UTC m=+559.319101856 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9139b1f1-263a-46b4-9d76-99bd707dfd00-cert") pod "odh-model-controller-696fc77849-ft9w6" (UID: "9139b1f1-263a-46b4-9d76-99bd707dfd00") : secret "odh-model-controller-webhook-cert" not found
Apr 24 21:26:06.208906 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:26:06.208883    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkdh7\" (UniqueName: \"kubernetes.io/projected/9139b1f1-263a-46b4-9d76-99bd707dfd00-kube-api-access-vkdh7\") pod \"odh-model-controller-696fc77849-ft9w6\" (UID: \"9139b1f1-263a-46b4-9d76-99bd707dfd00\") " pod="kserve/odh-model-controller-696fc77849-ft9w6"
Apr 24 21:26:06.704745 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:26:06.704711    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9139b1f1-263a-46b4-9d76-99bd707dfd00-cert\") pod \"odh-model-controller-696fc77849-ft9w6\" (UID: \"9139b1f1-263a-46b4-9d76-99bd707dfd00\") " pod="kserve/odh-model-controller-696fc77849-ft9w6"
Apr 24 21:26:06.707104 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:26:06.707073    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9139b1f1-263a-46b4-9d76-99bd707dfd00-cert\") pod \"odh-model-controller-696fc77849-ft9w6\" (UID: \"9139b1f1-263a-46b4-9d76-99bd707dfd00\") " pod="kserve/odh-model-controller-696fc77849-ft9w6"
Apr 24 21:26:06.930908 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:26:06.930864    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-696fc77849-ft9w6"
Apr 24 21:26:07.064633 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:26:07.064608    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-696fc77849-ft9w6"]
Apr 24 21:26:07.067500 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:26:07.067462    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9139b1f1_263a_46b4_9d76_99bd707dfd00.slice/crio-b8c246c58b30382d67297c289985887a9151a5bd7488aa6e4f3de811845c0a59 WatchSource:0}: Error finding container b8c246c58b30382d67297c289985887a9151a5bd7488aa6e4f3de811845c0a59: Status 404 returned error can't find the container with id b8c246c58b30382d67297c289985887a9151a5bd7488aa6e4f3de811845c0a59
Apr 24 21:26:08.008123 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:26:08.008067    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-696fc77849-ft9w6" event={"ID":"9139b1f1-263a-46b4-9d76-99bd707dfd00","Type":"ContainerStarted","Data":"b8c246c58b30382d67297c289985887a9151a5bd7488aa6e4f3de811845c0a59"}
Apr 24 21:26:10.015884 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:26:10.015830    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-696fc77849-ft9w6" event={"ID":"9139b1f1-263a-46b4-9d76-99bd707dfd00","Type":"ContainerStarted","Data":"0d6d745d2aefe9a2f08ee63e81bc293077c680ee4b458dc4f24aa02fa1a4124a"}
Apr 24 21:26:10.016457 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:26:10.015935    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-696fc77849-ft9w6"
Apr 24 21:26:10.033816 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:26:10.033752    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/odh-model-controller-696fc77849-ft9w6" podStartSLOduration=2.578253927 podStartE2EDuration="5.033735905s" podCreationTimestamp="2026-04-24 21:26:05 +0000 UTC" firstStartedPulling="2026-04-24 21:26:07.068697864 +0000 UTC m=+559.688154467" lastFinishedPulling="2026-04-24 21:26:09.524179826 +0000 UTC m=+562.143636445" observedRunningTime="2026-04-24 21:26:10.032614286 +0000 UTC m=+562.652070906" watchObservedRunningTime="2026-04-24 21:26:10.033735905 +0000 UTC m=+562.653192530"
Apr 24 21:26:21.021910 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:26:21.021876    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-696fc77849-ft9w6"
Apr 24 21:27:28.929047 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:28.929007    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"]
Apr 24 21:27:28.932658 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:28.932637    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:27:28.936935 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:28.936904    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-qdwck\""
Apr 24 21:27:28.937096 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:28.936905    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Apr 24 21:27:28.937096 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:28.936905    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-inline-config-test-kserve-self-signed-certs\""
Apr 24 21:27:28.938671 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:28.938652    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Apr 24 21:27:28.951935 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:28.951906    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"]
Apr 24 21:27:29.068338 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.068307    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-home\") pod \"scheduler-inline-config-test-kserve-6586587d6c-wwvkn\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:27:29.068513 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.068346    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-dshm\") pod \"scheduler-inline-config-test-kserve-6586587d6c-wwvkn\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:27:29.068513 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.068476    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-model-cache\") pod \"scheduler-inline-config-test-kserve-6586587d6c-wwvkn\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:27:29.068513 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.068502    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f52c0bb6-834d-4cab-846a-1d247dfb1968-tls-certs\") pod \"scheduler-inline-config-test-kserve-6586587d6c-wwvkn\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:27:29.068639 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.068603    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-tmp-dir\") pod \"scheduler-inline-config-test-kserve-6586587d6c-wwvkn\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:27:29.068680 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.068643    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-kserve-provision-location\") pod \"scheduler-inline-config-test-kserve-6586587d6c-wwvkn\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:27:29.068716 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.068698    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r87hb\" (UniqueName: \"kubernetes.io/projected/f52c0bb6-834d-4cab-846a-1d247dfb1968-kube-api-access-r87hb\") pod \"scheduler-inline-config-test-kserve-6586587d6c-wwvkn\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:27:29.169694 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.169650    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-model-cache\") pod \"scheduler-inline-config-test-kserve-6586587d6c-wwvkn\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:27:29.169694 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.169693    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f52c0bb6-834d-4cab-846a-1d247dfb1968-tls-certs\") pod \"scheduler-inline-config-test-kserve-6586587d6c-wwvkn\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:27:29.169935 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.169809    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-tmp-dir\") pod \"scheduler-inline-config-test-kserve-6586587d6c-wwvkn\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:27:29.169935 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.169856    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-kserve-provision-location\") pod \"scheduler-inline-config-test-kserve-6586587d6c-wwvkn\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:27:29.169935 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.169900    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r87hb\" (UniqueName: \"kubernetes.io/projected/f52c0bb6-834d-4cab-846a-1d247dfb1968-kube-api-access-r87hb\") pod \"scheduler-inline-config-test-kserve-6586587d6c-wwvkn\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:27:29.170055 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.169967    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-home\") pod \"scheduler-inline-config-test-kserve-6586587d6c-wwvkn\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:27:29.170055 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.169997    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-dshm\") pod \"scheduler-inline-config-test-kserve-6586587d6c-wwvkn\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:27:29.170175 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.170151    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-model-cache\") pod \"scheduler-inline-config-test-kserve-6586587d6c-wwvkn\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:27:29.170175 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.170167    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-tmp-dir\") pod \"scheduler-inline-config-test-kserve-6586587d6c-wwvkn\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:27:29.170291 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.170222    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-kserve-provision-location\") pod \"scheduler-inline-config-test-kserve-6586587d6c-wwvkn\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:27:29.170453 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.170431    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-home\") pod \"scheduler-inline-config-test-kserve-6586587d6c-wwvkn\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:27:29.172204 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.172167    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-dshm\") pod \"scheduler-inline-config-test-kserve-6586587d6c-wwvkn\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:27:29.172461 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.172442    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f52c0bb6-834d-4cab-846a-1d247dfb1968-tls-certs\") pod \"scheduler-inline-config-test-kserve-6586587d6c-wwvkn\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:27:29.178952 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.178933    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r87hb\" (UniqueName: \"kubernetes.io/projected/f52c0bb6-834d-4cab-846a-1d247dfb1968-kube-api-access-r87hb\") pod \"scheduler-inline-config-test-kserve-6586587d6c-wwvkn\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:27:29.244088 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.244012    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:27:29.384460 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.384258    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"]
Apr 24 21:27:29.386799 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:27:29.386768    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf52c0bb6_834d_4cab_846a_1d247dfb1968.slice/crio-37753a76c28ec7332298491c1f992ed8ee191761ec925f9968989f846905a8fc WatchSource:0}: Error finding container 37753a76c28ec7332298491c1f992ed8ee191761ec925f9968989f846905a8fc: Status 404 returned error can't find the container with id 37753a76c28ec7332298491c1f992ed8ee191761ec925f9968989f846905a8fc
Apr 24 21:27:29.388739 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:29.388714    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Apr 24 21:27:30.294743 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:30.294679    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn" event={"ID":"f52c0bb6-834d-4cab-846a-1d247dfb1968","Type":"ContainerStarted","Data":"37753a76c28ec7332298491c1f992ed8ee191761ec925f9968989f846905a8fc"}
Apr 24 21:27:34.313360 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:27:34.313319    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn" event={"ID":"f52c0bb6-834d-4cab-846a-1d247dfb1968","Type":"ContainerStarted","Data":"24503a40ccf7a8848aaede68f4677700cefc72493b9e56503a1de4588265e2f8"}
Apr 24 21:28:32.515684 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:32.515592    2569 generic.go:358] "Generic (PLEG): container finished" podID="f52c0bb6-834d-4cab-846a-1d247dfb1968" containerID="24503a40ccf7a8848aaede68f4677700cefc72493b9e56503a1de4588265e2f8" exitCode=0
Apr 24 21:28:32.515684 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:32.515627    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn" event={"ID":"f52c0bb6-834d-4cab-846a-1d247dfb1968","Type":"ContainerDied","Data":"24503a40ccf7a8848aaede68f4677700cefc72493b9e56503a1de4588265e2f8"}
Apr 24 21:28:34.523743 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:34.523708    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn" event={"ID":"f52c0bb6-834d-4cab-846a-1d247dfb1968","Type":"ContainerStarted","Data":"0aa9589a1a6cf545d2296cf47ff2538596518f31425210f48c422474ff65cb6e"}
Apr 24 21:28:34.542720 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:34.542662    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn" podStartSLOduration=2.37598625 podStartE2EDuration="1m6.542649056s" podCreationTimestamp="2026-04-24 21:27:28 +0000 UTC" firstStartedPulling="2026-04-24 21:27:29.388845176 +0000 UTC m=+642.008301778" lastFinishedPulling="2026-04-24 21:28:33.555507981 +0000 UTC m=+706.174964584" observedRunningTime="2026-04-24 21:28:34.540785751 +0000 UTC m=+707.160242372" watchObservedRunningTime="2026-04-24 21:28:34.542649056 +0000 UTC m=+707.162105677"
Apr 24 21:28:39.244493 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:39.244460    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:28:39.244845 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:39.244503    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:28:39.256645 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:39.256624    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:28:39.553026 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:39.552954    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:28:40.396133 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:40.396101    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"]
Apr 24 21:28:40.636679 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:28:40.636638    2569 secret.go:189] Couldn't get secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs: secret "scheduler-inline-config-test-kserve-self-signed-certs" not found
Apr 24 21:28:40.636884 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:28:40.636717    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f52c0bb6-834d-4cab-846a-1d247dfb1968-tls-certs podName:f52c0bb6-834d-4cab-846a-1d247dfb1968 nodeName:}" failed. No retries permitted until 2026-04-24 21:28:41.136699287 +0000 UTC m=+713.756155890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f52c0bb6-834d-4cab-846a-1d247dfb1968-tls-certs") pod "scheduler-inline-config-test-kserve-6586587d6c-wwvkn" (UID: "f52c0bb6-834d-4cab-846a-1d247dfb1968") : secret "scheduler-inline-config-test-kserve-self-signed-certs" not found
Apr 24 21:28:41.141356 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:28:41.141323    2569 secret.go:189] Couldn't get secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs: secret "scheduler-inline-config-test-kserve-self-signed-certs" not found
Apr 24 21:28:41.141543 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:28:41.141416    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f52c0bb6-834d-4cab-846a-1d247dfb1968-tls-certs podName:f52c0bb6-834d-4cab-846a-1d247dfb1968 nodeName:}" failed. No retries permitted until 2026-04-24 21:28:42.141395309 +0000 UTC m=+714.760851929 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f52c0bb6-834d-4cab-846a-1d247dfb1968-tls-certs") pod "scheduler-inline-config-test-kserve-6586587d6c-wwvkn" (UID: "f52c0bb6-834d-4cab-846a-1d247dfb1968") : secret "scheduler-inline-config-test-kserve-self-signed-certs" not found
Apr 24 21:28:41.548029 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:41.547930    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn" podUID="f52c0bb6-834d-4cab-846a-1d247dfb1968" containerName="main" containerID="cri-o://0aa9589a1a6cf545d2296cf47ff2538596518f31425210f48c422474ff65cb6e" gracePeriod=30
Apr 24 21:28:41.839542 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:41.839518    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:28:41.847001 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:41.846982    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-tmp-dir\") pod \"f52c0bb6-834d-4cab-846a-1d247dfb1968\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") "
Apr 24 21:28:41.847093 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:41.847019    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-model-cache\") pod \"f52c0bb6-834d-4cab-846a-1d247dfb1968\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") "
Apr 24 21:28:41.847093 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:41.847061    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-kserve-provision-location\") pod \"f52c0bb6-834d-4cab-846a-1d247dfb1968\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") "
Apr 24 21:28:41.847176 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:41.847099    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r87hb\" (UniqueName: \"kubernetes.io/projected/f52c0bb6-834d-4cab-846a-1d247dfb1968-kube-api-access-r87hb\") pod \"f52c0bb6-834d-4cab-846a-1d247dfb1968\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") "
Apr 24 21:28:41.847176 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:41.847122    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-dshm\") pod \"f52c0bb6-834d-4cab-846a-1d247dfb1968\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") "
Apr 24 21:28:41.847274 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:41.847171    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f52c0bb6-834d-4cab-846a-1d247dfb1968" (UID: "f52c0bb6-834d-4cab-846a-1d247dfb1968"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:28:41.847274 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:41.847221    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-home\") pod \"f52c0bb6-834d-4cab-846a-1d247dfb1968\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") "
Apr 24 21:28:41.847274 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:41.847255    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f52c0bb6-834d-4cab-846a-1d247dfb1968-tls-certs\") pod \"f52c0bb6-834d-4cab-846a-1d247dfb1968\" (UID: \"f52c0bb6-834d-4cab-846a-1d247dfb1968\") "
Apr 24 21:28:41.847442 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:41.847301    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-model-cache" (OuterVolumeSpecName: "model-cache") pod "f52c0bb6-834d-4cab-846a-1d247dfb1968" (UID: "f52c0bb6-834d-4cab-846a-1d247dfb1968"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:28:41.847535 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:41.847518    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-tmp-dir\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:28:41.847590 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:41.847539    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-model-cache\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:28:41.847590 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:41.847512    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-home" (OuterVolumeSpecName: "home") pod "f52c0bb6-834d-4cab-846a-1d247dfb1968" (UID: "f52c0bb6-834d-4cab-846a-1d247dfb1968"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:28:41.849512 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:41.849479    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f52c0bb6-834d-4cab-846a-1d247dfb1968-kube-api-access-r87hb" (OuterVolumeSpecName: "kube-api-access-r87hb") pod "f52c0bb6-834d-4cab-846a-1d247dfb1968" (UID: "f52c0bb6-834d-4cab-846a-1d247dfb1968"). InnerVolumeSpecName "kube-api-access-r87hb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Apr 24 21:28:41.849609 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:41.849512    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f52c0bb6-834d-4cab-846a-1d247dfb1968-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f52c0bb6-834d-4cab-846a-1d247dfb1968" (UID: "f52c0bb6-834d-4cab-846a-1d247dfb1968"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:28:41.849609 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:41.849512    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-dshm" (OuterVolumeSpecName: "dshm") pod "f52c0bb6-834d-4cab-846a-1d247dfb1968" (UID: "f52c0bb6-834d-4cab-846a-1d247dfb1968"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:28:41.948153 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:41.948125    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r87hb\" (UniqueName: \"kubernetes.io/projected/f52c0bb6-834d-4cab-846a-1d247dfb1968-kube-api-access-r87hb\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:28:41.948153 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:41.948151    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-dshm\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:28:41.948332 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:41.948164    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-home\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:28:41.948332 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:41.948177    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f52c0bb6-834d-4cab-846a-1d247dfb1968-tls-certs\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:28:42.191180 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:42.191140    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "f52c0bb6-834d-4cab-846a-1d247dfb1968" (UID: "f52c0bb6-834d-4cab-846a-1d247dfb1968"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:28:42.251487 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:42.251454    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f52c0bb6-834d-4cab-846a-1d247dfb1968-kserve-provision-location\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:28:42.552970 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:42.552881    2569 generic.go:358] "Generic (PLEG): container finished" podID="f52c0bb6-834d-4cab-846a-1d247dfb1968" containerID="0aa9589a1a6cf545d2296cf47ff2538596518f31425210f48c422474ff65cb6e" exitCode=0
Apr 24 21:28:42.552970 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:42.552946    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"
Apr 24 21:28:42.552970 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:42.552960    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn" event={"ID":"f52c0bb6-834d-4cab-846a-1d247dfb1968","Type":"ContainerDied","Data":"0aa9589a1a6cf545d2296cf47ff2538596518f31425210f48c422474ff65cb6e"}
Apr 24 21:28:42.553508 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:42.552996    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn" event={"ID":"f52c0bb6-834d-4cab-846a-1d247dfb1968","Type":"ContainerDied","Data":"37753a76c28ec7332298491c1f992ed8ee191761ec925f9968989f846905a8fc"}
Apr 24 21:28:42.553508 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:42.553011    2569 scope.go:117] "RemoveContainer" containerID="0aa9589a1a6cf545d2296cf47ff2538596518f31425210f48c422474ff65cb6e"
Apr 24 21:28:42.562336 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:42.562320    2569 scope.go:117] "RemoveContainer" containerID="24503a40ccf7a8848aaede68f4677700cefc72493b9e56503a1de4588265e2f8"
Apr 24 21:28:42.575527 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:42.575504    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"]
Apr 24 21:28:42.581184 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:42.581162    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-6586587d6c-wwvkn"]
Apr 24 21:28:42.628214 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:42.628195    2569 scope.go:117] "RemoveContainer" containerID="0aa9589a1a6cf545d2296cf47ff2538596518f31425210f48c422474ff65cb6e"
Apr 24 21:28:42.628566 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:28:42.628539    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aa9589a1a6cf545d2296cf47ff2538596518f31425210f48c422474ff65cb6e\": container with ID starting with 0aa9589a1a6cf545d2296cf47ff2538596518f31425210f48c422474ff65cb6e not found: ID does not exist" containerID="0aa9589a1a6cf545d2296cf47ff2538596518f31425210f48c422474ff65cb6e"
Apr 24 21:28:42.628623 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:42.628566    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aa9589a1a6cf545d2296cf47ff2538596518f31425210f48c422474ff65cb6e"} err="failed to get container status \"0aa9589a1a6cf545d2296cf47ff2538596518f31425210f48c422474ff65cb6e\": rpc error: code = NotFound desc = could not find container \"0aa9589a1a6cf545d2296cf47ff2538596518f31425210f48c422474ff65cb6e\": container with ID starting with 0aa9589a1a6cf545d2296cf47ff2538596518f31425210f48c422474ff65cb6e not found: ID does not exist"
Apr 24 21:28:42.628623 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:42.628586    2569 scope.go:117] "RemoveContainer" containerID="24503a40ccf7a8848aaede68f4677700cefc72493b9e56503a1de4588265e2f8"
Apr 24 21:28:42.628796 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:28:42.628778    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24503a40ccf7a8848aaede68f4677700cefc72493b9e56503a1de4588265e2f8\": container with ID starting with 24503a40ccf7a8848aaede68f4677700cefc72493b9e56503a1de4588265e2f8 not found: ID does not exist" containerID="24503a40ccf7a8848aaede68f4677700cefc72493b9e56503a1de4588265e2f8"
Apr 24 21:28:42.628833 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:42.628807    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24503a40ccf7a8848aaede68f4677700cefc72493b9e56503a1de4588265e2f8"} err="failed to get container status \"24503a40ccf7a8848aaede68f4677700cefc72493b9e56503a1de4588265e2f8\": rpc error: code = NotFound desc = could not find container \"24503a40ccf7a8848aaede68f4677700cefc72493b9e56503a1de4588265e2f8\": container with ID starting with 24503a40ccf7a8848aaede68f4677700cefc72493b9e56503a1de4588265e2f8 not found: ID does not exist"
Apr 24 21:28:43.960779 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:28:43.960743    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f52c0bb6-834d-4cab-846a-1d247dfb1968" path="/var/lib/kubelet/pods/f52c0bb6-834d-4cab-846a-1d247dfb1968/volumes"
Apr 24 21:29:00.894765 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:00.894730    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"]
Apr 24 21:29:00.895157 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:00.895116    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f52c0bb6-834d-4cab-846a-1d247dfb1968" containerName="main"
Apr 24 21:29:00.895157 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:00.895128    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f52c0bb6-834d-4cab-846a-1d247dfb1968" containerName="main"
Apr 24 21:29:00.895157 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:00.895139    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f52c0bb6-834d-4cab-846a-1d247dfb1968" containerName="storage-initializer"
Apr 24 21:29:00.895157 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:00.895144    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f52c0bb6-834d-4cab-846a-1d247dfb1968" containerName="storage-initializer"
Apr 24 21:29:00.895290 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:00.895213    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="f52c0bb6-834d-4cab-846a-1d247dfb1968" containerName="main"
Apr 24 21:29:00.900559 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:00.900537    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:29:00.902779 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:00.902759    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-qdwck\""
Apr 24 21:29:00.903974 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:00.903943    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Apr 24 21:29:00.904101 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:00.904040    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Apr 24 21:29:00.904101 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:00.904066    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-configmap-ref-test-kserve-self-signed-certs\""
Apr 24 21:29:00.906195 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:00.906173    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"]
Apr 24 21:29:01.028580 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.028550    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-tmp-dir\") pod \"scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:29:01.028580 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.028589    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-model-cache\") pod \"scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:29:01.028781 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.028618    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-kserve-provision-location\") pod \"scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:29:01.028781 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.028709    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-home\") pod \"scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:29:01.028781 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.028752    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-dshm\") pod \"scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:29:01.028781 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.028772    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvd2k\" (UniqueName: \"kubernetes.io/projected/c70310e9-1b9b-453f-88bf-394cf38ba3d5-kube-api-access-rvd2k\") pod \"scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:29:01.028901 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.028797    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c70310e9-1b9b-453f-88bf-394cf38ba3d5-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:29:01.129813 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.129773    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-kserve-provision-location\") pod \"scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:29:01.129993 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.129834    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-home\") pod \"scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:29:01.129993 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.129869    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-dshm\") pod \"scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:29:01.129993 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.129885    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rvd2k\" (UniqueName: \"kubernetes.io/projected/c70310e9-1b9b-453f-88bf-394cf38ba3d5-kube-api-access-rvd2k\") pod \"scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:29:01.129993 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.129913    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c70310e9-1b9b-453f-88bf-394cf38ba3d5-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:29:01.129993 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.129975    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-tmp-dir\") pod \"scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:29:01.130242 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.130004    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-model-cache\") pod \"scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:29:01.130242 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.130223    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-kserve-provision-location\") pod \"scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:29:01.130342 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.130269    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-home\") pod \"scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:29:01.130342 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.130331    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-model-cache\") pod \"scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:29:01.130482 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.130345    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-tmp-dir\") pod \"scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:29:01.132161 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.132139    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-dshm\") pod \"scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:29:01.132467 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.132449    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c70310e9-1b9b-453f-88bf-394cf38ba3d5-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:29:01.137954 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.137937    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvd2k\" (UniqueName: \"kubernetes.io/projected/c70310e9-1b9b-453f-88bf-394cf38ba3d5-kube-api-access-rvd2k\") pod \"scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:29:01.211542 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.211452    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:29:01.546657 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.546464    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"]
Apr 24 21:29:01.549763 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:29:01.549728    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc70310e9_1b9b_453f_88bf_394cf38ba3d5.slice/crio-70f07fd9013f386ba34ad9d485e4fe989d27c206c0d2e74dc7642ddc20879af7 WatchSource:0}: Error finding container 70f07fd9013f386ba34ad9d485e4fe989d27c206c0d2e74dc7642ddc20879af7: Status 404 returned error can't find the container with id 70f07fd9013f386ba34ad9d485e4fe989d27c206c0d2e74dc7642ddc20879af7
Apr 24 21:29:01.620543 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:01.620511    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6" event={"ID":"c70310e9-1b9b-453f-88bf-394cf38ba3d5","Type":"ContainerStarted","Data":"70f07fd9013f386ba34ad9d485e4fe989d27c206c0d2e74dc7642ddc20879af7"}
Apr 24 21:29:02.626466 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:29:02.626430    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6" event={"ID":"c70310e9-1b9b-453f-88bf-394cf38ba3d5","Type":"ContainerStarted","Data":"946885f920e8deccc4c41f2937b6b8055c24624947bdd13ba00571fab4523cb0"}
Apr 24 21:30:03.847709 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:03.847623    2569 generic.go:358] "Generic (PLEG): container finished" podID="c70310e9-1b9b-453f-88bf-394cf38ba3d5" containerID="946885f920e8deccc4c41f2937b6b8055c24624947bdd13ba00571fab4523cb0" exitCode=0
Apr 24 21:30:03.847709 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:03.847697    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6" event={"ID":"c70310e9-1b9b-453f-88bf-394cf38ba3d5","Type":"ContainerDied","Data":"946885f920e8deccc4c41f2937b6b8055c24624947bdd13ba00571fab4523cb0"}
Apr 24 21:30:04.853447 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:04.853409    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6" event={"ID":"c70310e9-1b9b-453f-88bf-394cf38ba3d5","Type":"ContainerStarted","Data":"64dc9da4cf21bf9a93f6b7e1aa38478a2ec657becc3d0f23c48bd2a8ef4f16e1"}
Apr 24 21:30:04.873791 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:04.873746    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6" podStartSLOduration=64.873730148 podStartE2EDuration="1m4.873730148s" podCreationTimestamp="2026-04-24 21:29:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:30:04.872024411 +0000 UTC m=+797.491481036" watchObservedRunningTime="2026-04-24 21:30:04.873730148 +0000 UTC m=+797.493186775"
Apr 24 21:30:11.212369 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:11.212328    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:30:11.212831 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:11.212397    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:30:11.225108 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:11.225074    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:30:11.888625 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:11.888594    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:30:13.219604 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:13.219573    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"]
Apr 24 21:30:13.884604 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:13.884544    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6" podUID="c70310e9-1b9b-453f-88bf-394cf38ba3d5" containerName="main" containerID="cri-o://64dc9da4cf21bf9a93f6b7e1aa38478a2ec657becc3d0f23c48bd2a8ef4f16e1" gracePeriod=30
Apr 24 21:30:14.127983 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.127958    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:30:14.237171 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.237088    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-dshm\") pod \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") "
Apr 24 21:30:14.237171 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.237138    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-home\") pod \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") "
Apr 24 21:30:14.237718 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.237181    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-tmp-dir\") pod \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") "
Apr 24 21:30:14.237718 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.237208    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-kserve-provision-location\") pod \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") "
Apr 24 21:30:14.237718 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.237228    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c70310e9-1b9b-453f-88bf-394cf38ba3d5-tls-certs\") pod \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") "
Apr 24 21:30:14.237718 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.237267    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-model-cache\") pod \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") "
Apr 24 21:30:14.237718 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.237322    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvd2k\" (UniqueName: \"kubernetes.io/projected/c70310e9-1b9b-453f-88bf-394cf38ba3d5-kube-api-access-rvd2k\") pod \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\" (UID: \"c70310e9-1b9b-453f-88bf-394cf38ba3d5\") "
Apr 24 21:30:14.237718 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.237488    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c70310e9-1b9b-453f-88bf-394cf38ba3d5" (UID: "c70310e9-1b9b-453f-88bf-394cf38ba3d5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:30:14.237718 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.237503    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-home" (OuterVolumeSpecName: "home") pod "c70310e9-1b9b-453f-88bf-394cf38ba3d5" (UID: "c70310e9-1b9b-453f-88bf-394cf38ba3d5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:30:14.237718 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.237599    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-model-cache" (OuterVolumeSpecName: "model-cache") pod "c70310e9-1b9b-453f-88bf-394cf38ba3d5" (UID: "c70310e9-1b9b-453f-88bf-394cf38ba3d5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:30:14.237718 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.237670    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-home\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:30:14.237718 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.237687    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-tmp-dir\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:30:14.237718 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.237699    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-model-cache\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:30:14.239411 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.239358    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-dshm" (OuterVolumeSpecName: "dshm") pod "c70310e9-1b9b-453f-88bf-394cf38ba3d5" (UID: "c70310e9-1b9b-453f-88bf-394cf38ba3d5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:30:14.239536 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.239444    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c70310e9-1b9b-453f-88bf-394cf38ba3d5-kube-api-access-rvd2k" (OuterVolumeSpecName: "kube-api-access-rvd2k") pod "c70310e9-1b9b-453f-88bf-394cf38ba3d5" (UID: "c70310e9-1b9b-453f-88bf-394cf38ba3d5"). InnerVolumeSpecName "kube-api-access-rvd2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Apr 24 21:30:14.239536 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.239491    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c70310e9-1b9b-453f-88bf-394cf38ba3d5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c70310e9-1b9b-453f-88bf-394cf38ba3d5" (UID: "c70310e9-1b9b-453f-88bf-394cf38ba3d5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:30:14.298825 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.298793    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "c70310e9-1b9b-453f-88bf-394cf38ba3d5" (UID: "c70310e9-1b9b-453f-88bf-394cf38ba3d5"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:30:14.338349 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.338325    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvd2k\" (UniqueName: \"kubernetes.io/projected/c70310e9-1b9b-453f-88bf-394cf38ba3d5-kube-api-access-rvd2k\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:30:14.338349 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.338347    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-dshm\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:30:14.338510 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.338358    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c70310e9-1b9b-453f-88bf-394cf38ba3d5-kserve-provision-location\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:30:14.338510 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.338367    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c70310e9-1b9b-453f-88bf-394cf38ba3d5-tls-certs\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:30:14.889154 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.889118    2569 generic.go:358] "Generic (PLEG): container finished" podID="c70310e9-1b9b-453f-88bf-394cf38ba3d5" containerID="64dc9da4cf21bf9a93f6b7e1aa38478a2ec657becc3d0f23c48bd2a8ef4f16e1" exitCode=0
Apr 24 21:30:14.889355 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.889179    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"
Apr 24 21:30:14.889355 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.889202    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6" event={"ID":"c70310e9-1b9b-453f-88bf-394cf38ba3d5","Type":"ContainerDied","Data":"64dc9da4cf21bf9a93f6b7e1aa38478a2ec657becc3d0f23c48bd2a8ef4f16e1"}
Apr 24 21:30:14.889355 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.889245    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6" event={"ID":"c70310e9-1b9b-453f-88bf-394cf38ba3d5","Type":"ContainerDied","Data":"70f07fd9013f386ba34ad9d485e4fe989d27c206c0d2e74dc7642ddc20879af7"}
Apr 24 21:30:14.889355 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.889265    2569 scope.go:117] "RemoveContainer" containerID="64dc9da4cf21bf9a93f6b7e1aa38478a2ec657becc3d0f23c48bd2a8ef4f16e1"
Apr 24 21:30:14.899614 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.899594    2569 scope.go:117] "RemoveContainer" containerID="946885f920e8deccc4c41f2937b6b8055c24624947bdd13ba00571fab4523cb0"
Apr 24 21:30:14.915106 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.915080    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"]
Apr 24 21:30:14.918609 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.918587    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5857d4c74c-7qfk6"]
Apr 24 21:30:14.960561 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.960540    2569 scope.go:117] "RemoveContainer" containerID="64dc9da4cf21bf9a93f6b7e1aa38478a2ec657becc3d0f23c48bd2a8ef4f16e1"
Apr 24 21:30:14.960851 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:30:14.960830    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64dc9da4cf21bf9a93f6b7e1aa38478a2ec657becc3d0f23c48bd2a8ef4f16e1\": container with ID starting with 64dc9da4cf21bf9a93f6b7e1aa38478a2ec657becc3d0f23c48bd2a8ef4f16e1 not found: ID does not exist" containerID="64dc9da4cf21bf9a93f6b7e1aa38478a2ec657becc3d0f23c48bd2a8ef4f16e1"
Apr 24 21:30:14.960918 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.960858    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64dc9da4cf21bf9a93f6b7e1aa38478a2ec657becc3d0f23c48bd2a8ef4f16e1"} err="failed to get container status \"64dc9da4cf21bf9a93f6b7e1aa38478a2ec657becc3d0f23c48bd2a8ef4f16e1\": rpc error: code = NotFound desc = could not find container \"64dc9da4cf21bf9a93f6b7e1aa38478a2ec657becc3d0f23c48bd2a8ef4f16e1\": container with ID starting with 64dc9da4cf21bf9a93f6b7e1aa38478a2ec657becc3d0f23c48bd2a8ef4f16e1 not found: ID does not exist"
Apr 24 21:30:14.960918 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.960885    2569 scope.go:117] "RemoveContainer" containerID="946885f920e8deccc4c41f2937b6b8055c24624947bdd13ba00571fab4523cb0"
Apr 24 21:30:14.961104 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:30:14.961085    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"946885f920e8deccc4c41f2937b6b8055c24624947bdd13ba00571fab4523cb0\": container with ID starting with 946885f920e8deccc4c41f2937b6b8055c24624947bdd13ba00571fab4523cb0 not found: ID does not exist" containerID="946885f920e8deccc4c41f2937b6b8055c24624947bdd13ba00571fab4523cb0"
Apr 24 21:30:14.961146 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:14.961109    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"946885f920e8deccc4c41f2937b6b8055c24624947bdd13ba00571fab4523cb0"} err="failed to get container status \"946885f920e8deccc4c41f2937b6b8055c24624947bdd13ba00571fab4523cb0\": rpc error: code = NotFound desc = could not find container \"946885f920e8deccc4c41f2937b6b8055c24624947bdd13ba00571fab4523cb0\": container with ID starting with 946885f920e8deccc4c41f2937b6b8055c24624947bdd13ba00571fab4523cb0 not found: ID does not exist"
Apr 24 21:30:15.960190 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:15.960155    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c70310e9-1b9b-453f-88bf-394cf38ba3d5" path="/var/lib/kubelet/pods/c70310e9-1b9b-453f-88bf-394cf38ba3d5/volumes"
Apr 24 21:30:17.175963 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.175930    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"]
Apr 24 21:30:17.176430 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.176343    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c70310e9-1b9b-453f-88bf-394cf38ba3d5" containerName="main"
Apr 24 21:30:17.176430 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.176355    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c70310e9-1b9b-453f-88bf-394cf38ba3d5" containerName="main"
Apr 24 21:30:17.176430 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.176370    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c70310e9-1b9b-453f-88bf-394cf38ba3d5" containerName="storage-initializer"
Apr 24 21:30:17.176430 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.176376    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c70310e9-1b9b-453f-88bf-394cf38ba3d5" containerName="storage-initializer"
Apr 24 21:30:17.176570 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.176481    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="c70310e9-1b9b-453f-88bf-394cf38ba3d5" containerName="main"
Apr 24 21:30:17.181810 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.181787    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:30:17.184649 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.184625    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Apr 24 21:30:17.185435 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.185413    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Apr 24 21:30:17.185576 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.185462    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-qdwck\""
Apr 24 21:30:17.185576 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.185536    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-ha-replicas-test-kserve-self-signed-certs\""
Apr 24 21:30:17.191835 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.191805    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"]
Apr 24 21:30:17.265129 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.265094    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-home\") pod \"scheduler-ha-replicas-test-kserve-6946d768c-b8szr\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:30:17.265309 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.265158    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d732973e-b1fb-4776-86cb-cf41990ab276-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-6946d768c-b8szr\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:30:17.265309 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.265179    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-dshm\") pod \"scheduler-ha-replicas-test-kserve-6946d768c-b8szr\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:30:17.265309 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.265206    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxnk5\" (UniqueName: \"kubernetes.io/projected/d732973e-b1fb-4776-86cb-cf41990ab276-kube-api-access-rxnk5\") pod \"scheduler-ha-replicas-test-kserve-6946d768c-b8szr\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:30:17.265309 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.265225    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-model-cache\") pod \"scheduler-ha-replicas-test-kserve-6946d768c-b8szr\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:30:17.265309 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.265298    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-6946d768c-b8szr\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:30:17.265504 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.265369    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-kserve-provision-location\") pod \"scheduler-ha-replicas-test-kserve-6946d768c-b8szr\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:30:17.366798 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.366753    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-6946d768c-b8szr\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:30:17.366983 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.366827    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-kserve-provision-location\") pod \"scheduler-ha-replicas-test-kserve-6946d768c-b8szr\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:30:17.366983 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.366879    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-home\") pod \"scheduler-ha-replicas-test-kserve-6946d768c-b8szr\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:30:17.366983 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.366956    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d732973e-b1fb-4776-86cb-cf41990ab276-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-6946d768c-b8szr\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:30:17.366983 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.366981    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-dshm\") pod \"scheduler-ha-replicas-test-kserve-6946d768c-b8szr\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:30:17.367193 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.367026    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxnk5\" (UniqueName: \"kubernetes.io/projected/d732973e-b1fb-4776-86cb-cf41990ab276-kube-api-access-rxnk5\") pod \"scheduler-ha-replicas-test-kserve-6946d768c-b8szr\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:30:17.367193 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.367057    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-model-cache\") pod \"scheduler-ha-replicas-test-kserve-6946d768c-b8szr\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:30:17.367346 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.367323    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-6946d768c-b8szr\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:30:17.367425 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.367358    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-kserve-provision-location\") pod \"scheduler-ha-replicas-test-kserve-6946d768c-b8szr\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:30:17.367425 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.367409    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-model-cache\") pod \"scheduler-ha-replicas-test-kserve-6946d768c-b8szr\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:30:17.367601 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.367582    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-home\") pod \"scheduler-ha-replicas-test-kserve-6946d768c-b8szr\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:30:17.369447 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.369413    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-dshm\") pod \"scheduler-ha-replicas-test-kserve-6946d768c-b8szr\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:30:17.370359 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.370338    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d732973e-b1fb-4776-86cb-cf41990ab276-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-6946d768c-b8szr\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:30:17.375914 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.375888    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxnk5\" (UniqueName: \"kubernetes.io/projected/d732973e-b1fb-4776-86cb-cf41990ab276-kube-api-access-rxnk5\") pod \"scheduler-ha-replicas-test-kserve-6946d768c-b8szr\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:30:17.493062 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.492969    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:30:17.620041 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.620011    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"]
Apr 24 21:30:17.622755 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:30:17.622727    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd732973e_b1fb_4776_86cb_cf41990ab276.slice/crio-f399443590a49d2a98ab0b69558481158e5f66d3b669617170643a1ecbfaa9b3 WatchSource:0}: Error finding container f399443590a49d2a98ab0b69558481158e5f66d3b669617170643a1ecbfaa9b3: Status 404 returned error can't find the container with id f399443590a49d2a98ab0b69558481158e5f66d3b669617170643a1ecbfaa9b3
Apr 24 21:30:17.901919 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.901882    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr" event={"ID":"d732973e-b1fb-4776-86cb-cf41990ab276","Type":"ContainerStarted","Data":"a199bd306cbb424b398f3c5209b1eb1ee4e5b99c3e5bd0563308c4581a03299e"}
Apr 24 21:30:17.901919 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:30:17.901925    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr" event={"ID":"d732973e-b1fb-4776-86cb-cf41990ab276","Type":"ContainerStarted","Data":"f399443590a49d2a98ab0b69558481158e5f66d3b669617170643a1ecbfaa9b3"}
Apr 24 21:45:16.799689 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:16.799609    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"]
Apr 24 21:45:16.802119 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:16.799908    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr" podUID="d732973e-b1fb-4776-86cb-cf41990ab276" containerName="storage-initializer" containerID="cri-o://a199bd306cbb424b398f3c5209b1eb1ee4e5b99c3e5bd0563308c4581a03299e" gracePeriod=30
Apr 24 21:45:36.895453 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:36.895419    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"]
Apr 24 21:45:36.899201 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:36.899177    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:36.902629 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:36.902608    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"precise-prefix-cache-test-kserve-self-signed-certs\""
Apr 24 21:45:36.909318 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:36.909295    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"]
Apr 24 21:45:36.972633 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:36.972595    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-84b86f64f-rm9s2\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:36.972633 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:36.972633    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-home\") pod \"precise-prefix-cache-test-kserve-84b86f64f-rm9s2\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:36.972869 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:36.972651    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlzxg\" (UniqueName: \"kubernetes.io/projected/f25d07ba-799e-4af5-a58e-b403db1aca77-kube-api-access-xlzxg\") pod \"precise-prefix-cache-test-kserve-84b86f64f-rm9s2\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:36.972869 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:36.972773    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-model-cache\") pod \"precise-prefix-cache-test-kserve-84b86f64f-rm9s2\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:36.972869 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:36.972850    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-dshm\") pod \"precise-prefix-cache-test-kserve-84b86f64f-rm9s2\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:36.973141 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:36.972879    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f25d07ba-799e-4af5-a58e-b403db1aca77-tls-certs\") pod \"precise-prefix-cache-test-kserve-84b86f64f-rm9s2\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:36.973141 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:36.972905    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-tmp-dir\") pod \"precise-prefix-cache-test-kserve-84b86f64f-rm9s2\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:37.074332 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:37.074290    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-tmp-dir\") pod \"precise-prefix-cache-test-kserve-84b86f64f-rm9s2\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:37.074554 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:37.074348    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-84b86f64f-rm9s2\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:37.074554 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:37.074369    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-home\") pod \"precise-prefix-cache-test-kserve-84b86f64f-rm9s2\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:37.074554 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:37.074416    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xlzxg\" (UniqueName: \"kubernetes.io/projected/f25d07ba-799e-4af5-a58e-b403db1aca77-kube-api-access-xlzxg\") pod \"precise-prefix-cache-test-kserve-84b86f64f-rm9s2\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:37.074554 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:37.074457    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-model-cache\") pod \"precise-prefix-cache-test-kserve-84b86f64f-rm9s2\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:37.074554 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:37.074528    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-dshm\") pod \"precise-prefix-cache-test-kserve-84b86f64f-rm9s2\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:37.074812 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:37.074558    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f25d07ba-799e-4af5-a58e-b403db1aca77-tls-certs\") pod \"precise-prefix-cache-test-kserve-84b86f64f-rm9s2\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:37.074812 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:37.074762    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-tmp-dir\") pod \"precise-prefix-cache-test-kserve-84b86f64f-rm9s2\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:37.074909 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:37.074824    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-84b86f64f-rm9s2\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:37.074909 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:37.074861    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-model-cache\") pod \"precise-prefix-cache-test-kserve-84b86f64f-rm9s2\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:37.075010 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:37.074907    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-home\") pod \"precise-prefix-cache-test-kserve-84b86f64f-rm9s2\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:37.077067 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:37.077046    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-dshm\") pod \"precise-prefix-cache-test-kserve-84b86f64f-rm9s2\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:37.077229 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:37.077213    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f25d07ba-799e-4af5-a58e-b403db1aca77-tls-certs\") pod \"precise-prefix-cache-test-kserve-84b86f64f-rm9s2\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:37.086951 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:37.086923    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlzxg\" (UniqueName: \"kubernetes.io/projected/f25d07ba-799e-4af5-a58e-b403db1aca77-kube-api-access-xlzxg\") pod \"precise-prefix-cache-test-kserve-84b86f64f-rm9s2\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:37.209717 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:37.209627    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:37.342724 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:37.342686    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"]
Apr 24 21:45:37.350168 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:45:37.350121    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf25d07ba_799e_4af5_a58e_b403db1aca77.slice/crio-5838afa9e132167ebb94a11309d33a523754c5e23da1a3bf3637fec3c5af0062 WatchSource:0}: Error finding container 5838afa9e132167ebb94a11309d33a523754c5e23da1a3bf3637fec3c5af0062: Status 404 returned error can't find the container with id 5838afa9e132167ebb94a11309d33a523754c5e23da1a3bf3637fec3c5af0062
Apr 24 21:45:37.351789 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:37.351773    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Apr 24 21:45:38.160996 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:38.160956    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2" event={"ID":"f25d07ba-799e-4af5-a58e-b403db1aca77","Type":"ContainerStarted","Data":"c10c6fc76c86015e3a89bcf0ef17862b74b177883a1773d43617eec26d6f0fae"}
Apr 24 21:45:38.160996 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:38.161003    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2" event={"ID":"f25d07ba-799e-4af5-a58e-b403db1aca77","Type":"ContainerStarted","Data":"5838afa9e132167ebb94a11309d33a523754c5e23da1a3bf3637fec3c5af0062"}
Apr 24 21:45:47.010776 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.010746    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-ha-replicas-test-kserve-6946d768c-b8szr_d732973e-b1fb-4776-86cb-cf41990ab276/storage-initializer/0.log"
Apr 24 21:45:47.011144 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.010814    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:45:47.076742 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.076659    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d732973e-b1fb-4776-86cb-cf41990ab276-tls-certs\") pod \"d732973e-b1fb-4776-86cb-cf41990ab276\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") "
Apr 24 21:45:47.076932 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.076760    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-home\") pod \"d732973e-b1fb-4776-86cb-cf41990ab276\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") "
Apr 24 21:45:47.076932 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.076786    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxnk5\" (UniqueName: \"kubernetes.io/projected/d732973e-b1fb-4776-86cb-cf41990ab276-kube-api-access-rxnk5\") pod \"d732973e-b1fb-4776-86cb-cf41990ab276\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") "
Apr 24 21:45:47.076932 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.076819    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-tmp-dir\") pod \"d732973e-b1fb-4776-86cb-cf41990ab276\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") "
Apr 24 21:45:47.076932 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.076858    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-model-cache\") pod \"d732973e-b1fb-4776-86cb-cf41990ab276\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") "
Apr 24 21:45:47.076932 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.076908    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-kserve-provision-location\") pod \"d732973e-b1fb-4776-86cb-cf41990ab276\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") "
Apr 24 21:45:47.077182 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.076935    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-dshm\") pod \"d732973e-b1fb-4776-86cb-cf41990ab276\" (UID: \"d732973e-b1fb-4776-86cb-cf41990ab276\") "
Apr 24 21:45:47.077182 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.077099    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d732973e-b1fb-4776-86cb-cf41990ab276" (UID: "d732973e-b1fb-4776-86cb-cf41990ab276"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:45:47.077182 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.077110    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-home" (OuterVolumeSpecName: "home") pod "d732973e-b1fb-4776-86cb-cf41990ab276" (UID: "d732973e-b1fb-4776-86cb-cf41990ab276"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:45:47.077182 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.077150    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-model-cache" (OuterVolumeSpecName: "model-cache") pod "d732973e-b1fb-4776-86cb-cf41990ab276" (UID: "d732973e-b1fb-4776-86cb-cf41990ab276"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:45:47.077655 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.077455    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-home\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:45:47.077655 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.077478    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-tmp-dir\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:45:47.077655 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.077492    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-model-cache\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:45:47.079075 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.079046    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-dshm" (OuterVolumeSpecName: "dshm") pod "d732973e-b1fb-4776-86cb-cf41990ab276" (UID: "d732973e-b1fb-4776-86cb-cf41990ab276"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:45:47.079170 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.079093    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d732973e-b1fb-4776-86cb-cf41990ab276-kube-api-access-rxnk5" (OuterVolumeSpecName: "kube-api-access-rxnk5") pod "d732973e-b1fb-4776-86cb-cf41990ab276" (UID: "d732973e-b1fb-4776-86cb-cf41990ab276"). InnerVolumeSpecName "kube-api-access-rxnk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Apr 24 21:45:47.079170 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.079112    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d732973e-b1fb-4776-86cb-cf41990ab276-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d732973e-b1fb-4776-86cb-cf41990ab276" (UID: "d732973e-b1fb-4776-86cb-cf41990ab276"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:45:47.096629 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.096592    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "d732973e-b1fb-4776-86cb-cf41990ab276" (UID: "d732973e-b1fb-4776-86cb-cf41990ab276"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:45:47.178839 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.178803    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-kserve-provision-location\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:45:47.178839 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.178837    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d732973e-b1fb-4776-86cb-cf41990ab276-dshm\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:45:47.179051 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.178850    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d732973e-b1fb-4776-86cb-cf41990ab276-tls-certs\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:45:47.179051 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.178865    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxnk5\" (UniqueName: \"kubernetes.io/projected/d732973e-b1fb-4776-86cb-cf41990ab276-kube-api-access-rxnk5\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:45:47.198113 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.198080    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-ha-replicas-test-kserve-6946d768c-b8szr_d732973e-b1fb-4776-86cb-cf41990ab276/storage-initializer/0.log"
Apr 24 21:45:47.198282 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.198121    2569 generic.go:358] "Generic (PLEG): container finished" podID="d732973e-b1fb-4776-86cb-cf41990ab276" containerID="a199bd306cbb424b398f3c5209b1eb1ee4e5b99c3e5bd0563308c4581a03299e" exitCode=137
Apr 24 21:45:47.198282 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.198169    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr" event={"ID":"d732973e-b1fb-4776-86cb-cf41990ab276","Type":"ContainerDied","Data":"a199bd306cbb424b398f3c5209b1eb1ee4e5b99c3e5bd0563308c4581a03299e"}
Apr 24 21:45:47.198282 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.198193    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr" event={"ID":"d732973e-b1fb-4776-86cb-cf41990ab276","Type":"ContainerDied","Data":"f399443590a49d2a98ab0b69558481158e5f66d3b669617170643a1ecbfaa9b3"}
Apr 24 21:45:47.198282 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.198192    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"
Apr 24 21:45:47.198282 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.198264    2569 scope.go:117] "RemoveContainer" containerID="a199bd306cbb424b398f3c5209b1eb1ee4e5b99c3e5bd0563308c4581a03299e"
Apr 24 21:45:47.227398 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.227290    2569 scope.go:117] "RemoveContainer" containerID="a199bd306cbb424b398f3c5209b1eb1ee4e5b99c3e5bd0563308c4581a03299e"
Apr 24 21:45:47.227712 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:45:47.227678    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a199bd306cbb424b398f3c5209b1eb1ee4e5b99c3e5bd0563308c4581a03299e\": container with ID starting with a199bd306cbb424b398f3c5209b1eb1ee4e5b99c3e5bd0563308c4581a03299e not found: ID does not exist" containerID="a199bd306cbb424b398f3c5209b1eb1ee4e5b99c3e5bd0563308c4581a03299e"
Apr 24 21:45:47.227814 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.227711    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a199bd306cbb424b398f3c5209b1eb1ee4e5b99c3e5bd0563308c4581a03299e"} err="failed to get container status \"a199bd306cbb424b398f3c5209b1eb1ee4e5b99c3e5bd0563308c4581a03299e\": rpc error: code = NotFound desc = could not find container \"a199bd306cbb424b398f3c5209b1eb1ee4e5b99c3e5bd0563308c4581a03299e\": container with ID starting with a199bd306cbb424b398f3c5209b1eb1ee4e5b99c3e5bd0563308c4581a03299e not found: ID does not exist"
Apr 24 21:45:47.238252 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.238223    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"]
Apr 24 21:45:47.242008 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.241985    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6946d768c-b8szr"]
Apr 24 21:45:47.961238 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:47.961194    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d732973e-b1fb-4776-86cb-cf41990ab276" path="/var/lib/kubelet/pods/d732973e-b1fb-4776-86cb-cf41990ab276/volumes"
Apr 24 21:45:49.206808 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:49.206776    2569 generic.go:358] "Generic (PLEG): container finished" podID="f25d07ba-799e-4af5-a58e-b403db1aca77" containerID="c10c6fc76c86015e3a89bcf0ef17862b74b177883a1773d43617eec26d6f0fae" exitCode=0
Apr 24 21:45:49.207220 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:49.206852    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2" event={"ID":"f25d07ba-799e-4af5-a58e-b403db1aca77","Type":"ContainerDied","Data":"c10c6fc76c86015e3a89bcf0ef17862b74b177883a1773d43617eec26d6f0fae"}
Apr 24 21:45:50.212457 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:50.212417    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2" event={"ID":"f25d07ba-799e-4af5-a58e-b403db1aca77","Type":"ContainerStarted","Data":"ba71e4319f0076584926147b509e27031d084be84550baef3a9b757f125c646a"}
Apr 24 21:45:50.230705 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:50.230650    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2" podStartSLOduration=14.230634222 podStartE2EDuration="14.230634222s" podCreationTimestamp="2026-04-24 21:45:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:45:50.229417043 +0000 UTC m=+1742.848873673" watchObservedRunningTime="2026-04-24 21:45:50.230634222 +0000 UTC m=+1742.850090847"
Apr 24 21:45:57.210650 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:57.210612    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:57.211115 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:57.210661    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:57.222851 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:57.222823    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:45:57.246606 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:45:57.246585    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:46:09.681107 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:09.681068    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"]
Apr 24 21:46:09.681564 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:09.681467    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2" podUID="f25d07ba-799e-4af5-a58e-b403db1aca77" containerName="main" containerID="cri-o://ba71e4319f0076584926147b509e27031d084be84550baef3a9b757f125c646a" gracePeriod=30
Apr 24 21:46:09.964123 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:09.964102    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:46:09.992624 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:09.992590    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-home\") pod \"f25d07ba-799e-4af5-a58e-b403db1aca77\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") "
Apr 24 21:46:09.992776 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:09.992631    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f25d07ba-799e-4af5-a58e-b403db1aca77-tls-certs\") pod \"f25d07ba-799e-4af5-a58e-b403db1aca77\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") "
Apr 24 21:46:09.992776 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:09.992729    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlzxg\" (UniqueName: \"kubernetes.io/projected/f25d07ba-799e-4af5-a58e-b403db1aca77-kube-api-access-xlzxg\") pod \"f25d07ba-799e-4af5-a58e-b403db1aca77\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") "
Apr 24 21:46:09.992776 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:09.992756    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-tmp-dir\") pod \"f25d07ba-799e-4af5-a58e-b403db1aca77\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") "
Apr 24 21:46:09.992950 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:09.992794    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-kserve-provision-location\") pod \"f25d07ba-799e-4af5-a58e-b403db1aca77\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") "
Apr 24 21:46:09.992950 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:09.992818    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-dshm\") pod \"f25d07ba-799e-4af5-a58e-b403db1aca77\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") "
Apr 24 21:46:09.992950 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:09.992850    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-model-cache\") pod \"f25d07ba-799e-4af5-a58e-b403db1aca77\" (UID: \"f25d07ba-799e-4af5-a58e-b403db1aca77\") "
Apr 24 21:46:09.992950 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:09.992856    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-home" (OuterVolumeSpecName: "home") pod "f25d07ba-799e-4af5-a58e-b403db1aca77" (UID: "f25d07ba-799e-4af5-a58e-b403db1aca77"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:46:09.993150 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:09.993135    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-home\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:46:09.993354 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:09.993284    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f25d07ba-799e-4af5-a58e-b403db1aca77" (UID: "f25d07ba-799e-4af5-a58e-b403db1aca77"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:46:09.993505 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:09.993355    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-model-cache" (OuterVolumeSpecName: "model-cache") pod "f25d07ba-799e-4af5-a58e-b403db1aca77" (UID: "f25d07ba-799e-4af5-a58e-b403db1aca77"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:46:09.995101 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:09.995069    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-dshm" (OuterVolumeSpecName: "dshm") pod "f25d07ba-799e-4af5-a58e-b403db1aca77" (UID: "f25d07ba-799e-4af5-a58e-b403db1aca77"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:46:09.995414 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:09.995393    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f25d07ba-799e-4af5-a58e-b403db1aca77-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f25d07ba-799e-4af5-a58e-b403db1aca77" (UID: "f25d07ba-799e-4af5-a58e-b403db1aca77"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 21:46:09.995752 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:09.995720    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f25d07ba-799e-4af5-a58e-b403db1aca77-kube-api-access-xlzxg" (OuterVolumeSpecName: "kube-api-access-xlzxg") pod "f25d07ba-799e-4af5-a58e-b403db1aca77" (UID: "f25d07ba-799e-4af5-a58e-b403db1aca77"). InnerVolumeSpecName "kube-api-access-xlzxg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Apr 24 21:46:10.055861 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:10.055828    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "f25d07ba-799e-4af5-a58e-b403db1aca77" (UID: "f25d07ba-799e-4af5-a58e-b403db1aca77"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 21:46:10.094192 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:10.094165    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlzxg\" (UniqueName: \"kubernetes.io/projected/f25d07ba-799e-4af5-a58e-b403db1aca77-kube-api-access-xlzxg\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:46:10.094192 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:10.094188    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-tmp-dir\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:46:10.094326 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:10.094199    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-kserve-provision-location\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:46:10.094326 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:10.094207    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-dshm\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:46:10.094326 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:10.094216    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f25d07ba-799e-4af5-a58e-b403db1aca77-model-cache\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:46:10.094326 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:10.094225    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f25d07ba-799e-4af5-a58e-b403db1aca77-tls-certs\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 21:46:10.277892 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:10.277811    2569 generic.go:358] "Generic (PLEG): container finished" podID="f25d07ba-799e-4af5-a58e-b403db1aca77" containerID="ba71e4319f0076584926147b509e27031d084be84550baef3a9b757f125c646a" exitCode=0
Apr 24 21:46:10.278003 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:10.277889    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"
Apr 24 21:46:10.278003 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:10.277891    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2" event={"ID":"f25d07ba-799e-4af5-a58e-b403db1aca77","Type":"ContainerDied","Data":"ba71e4319f0076584926147b509e27031d084be84550baef3a9b757f125c646a"}
Apr 24 21:46:10.278003 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:10.277933    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2" event={"ID":"f25d07ba-799e-4af5-a58e-b403db1aca77","Type":"ContainerDied","Data":"5838afa9e132167ebb94a11309d33a523754c5e23da1a3bf3637fec3c5af0062"}
Apr 24 21:46:10.278003 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:10.277950    2569 scope.go:117] "RemoveContainer" containerID="ba71e4319f0076584926147b509e27031d084be84550baef3a9b757f125c646a"
Apr 24 21:46:10.287358 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:10.287342    2569 scope.go:117] "RemoveContainer" containerID="c10c6fc76c86015e3a89bcf0ef17862b74b177883a1773d43617eec26d6f0fae"
Apr 24 21:46:10.298668 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:10.298648    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"]
Apr 24 21:46:10.302342 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:10.302324    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-84b86f64f-rm9s2"]
Apr 24 21:46:10.355951 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:10.355933    2569 scope.go:117] "RemoveContainer" containerID="ba71e4319f0076584926147b509e27031d084be84550baef3a9b757f125c646a"
Apr 24 21:46:10.356236 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:46:10.356214    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba71e4319f0076584926147b509e27031d084be84550baef3a9b757f125c646a\": container with ID starting with ba71e4319f0076584926147b509e27031d084be84550baef3a9b757f125c646a not found: ID does not exist" containerID="ba71e4319f0076584926147b509e27031d084be84550baef3a9b757f125c646a"
Apr 24 21:46:10.356289 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:10.356243    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba71e4319f0076584926147b509e27031d084be84550baef3a9b757f125c646a"} err="failed to get container status \"ba71e4319f0076584926147b509e27031d084be84550baef3a9b757f125c646a\": rpc error: code = NotFound desc = could not find container \"ba71e4319f0076584926147b509e27031d084be84550baef3a9b757f125c646a\": container with ID starting with ba71e4319f0076584926147b509e27031d084be84550baef3a9b757f125c646a not found: ID does not exist"
Apr 24 21:46:10.356289 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:10.356264    2569 scope.go:117] "RemoveContainer" containerID="c10c6fc76c86015e3a89bcf0ef17862b74b177883a1773d43617eec26d6f0fae"
Apr 24 21:46:10.356508 ip-10-0-131-162 kubenswrapper[2569]: E0424 21:46:10.356493    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c10c6fc76c86015e3a89bcf0ef17862b74b177883a1773d43617eec26d6f0fae\": container with ID starting with c10c6fc76c86015e3a89bcf0ef17862b74b177883a1773d43617eec26d6f0fae not found: ID does not exist" containerID="c10c6fc76c86015e3a89bcf0ef17862b74b177883a1773d43617eec26d6f0fae"
Apr 24 21:46:10.356562 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:10.356512    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c10c6fc76c86015e3a89bcf0ef17862b74b177883a1773d43617eec26d6f0fae"} err="failed to get container status \"c10c6fc76c86015e3a89bcf0ef17862b74b177883a1773d43617eec26d6f0fae\": rpc error: code = NotFound desc = could not find container \"c10c6fc76c86015e3a89bcf0ef17862b74b177883a1773d43617eec26d6f0fae\": container with ID starting with c10c6fc76c86015e3a89bcf0ef17862b74b177883a1773d43617eec26d6f0fae not found: ID does not exist"
Apr 24 21:46:11.961238 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:46:11.961206    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f25d07ba-799e-4af5-a58e-b403db1aca77" path="/var/lib/kubelet/pods/f25d07ba-799e-4af5-a58e-b403db1aca77/volumes"
Apr 24 21:51:33.981513 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:33.981433    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-6f7fd9578-hv8sp"]
Apr 24 21:51:33.982029 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:33.982018    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f25d07ba-799e-4af5-a58e-b403db1aca77" containerName="main"
Apr 24 21:51:33.982079 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:33.982035    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f25d07ba-799e-4af5-a58e-b403db1aca77" containerName="main"
Apr 24 21:51:33.982079 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:33.982052    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d732973e-b1fb-4776-86cb-cf41990ab276" containerName="storage-initializer"
Apr 24 21:51:33.982079 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:33.982063    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d732973e-b1fb-4776-86cb-cf41990ab276" containerName="storage-initializer"
Apr 24 21:51:33.982209 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:33.982093    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f25d07ba-799e-4af5-a58e-b403db1aca77" containerName="storage-initializer"
Apr 24 21:51:33.982209 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:33.982102    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f25d07ba-799e-4af5-a58e-b403db1aca77" containerName="storage-initializer"
Apr 24 21:51:33.982209 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:33.982204    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="d732973e-b1fb-4776-86cb-cf41990ab276" containerName="storage-initializer"
Apr 24 21:51:33.982324 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:33.982223    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="f25d07ba-799e-4af5-a58e-b403db1aca77" containerName="main"
Apr 24 21:51:33.985242 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:33.985222    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-6f7fd9578-hv8sp"
Apr 24 21:51:33.988240 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:33.988217    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Apr 24 21:51:33.988766 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:33.988748    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-w87s7\""
Apr 24 21:51:33.992729 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:33.992599    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-6f7fd9578-hv8sp"]
Apr 24 21:51:34.043640 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:34.043614    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/548d87c7-c351-41e2-acc0-ea042d9c464a-cert\") pod \"llmisvc-controller-manager-6f7fd9578-hv8sp\" (UID: \"548d87c7-c351-41e2-acc0-ea042d9c464a\") " pod="kserve/llmisvc-controller-manager-6f7fd9578-hv8sp"
Apr 24 21:51:34.043760 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:34.043677    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q2ct\" (UniqueName: \"kubernetes.io/projected/548d87c7-c351-41e2-acc0-ea042d9c464a-kube-api-access-9q2ct\") pod \"llmisvc-controller-manager-6f7fd9578-hv8sp\" (UID: \"548d87c7-c351-41e2-acc0-ea042d9c464a\") " pod="kserve/llmisvc-controller-manager-6f7fd9578-hv8sp"
Apr 24 21:51:34.145001 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:34.144967    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9q2ct\" (UniqueName: \"kubernetes.io/projected/548d87c7-c351-41e2-acc0-ea042d9c464a-kube-api-access-9q2ct\") pod \"llmisvc-controller-manager-6f7fd9578-hv8sp\" (UID: \"548d87c7-c351-41e2-acc0-ea042d9c464a\") " pod="kserve/llmisvc-controller-manager-6f7fd9578-hv8sp"
Apr 24 21:51:34.145148 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:34.145111    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/548d87c7-c351-41e2-acc0-ea042d9c464a-cert\") pod \"llmisvc-controller-manager-6f7fd9578-hv8sp\" (UID: \"548d87c7-c351-41e2-acc0-ea042d9c464a\") " pod="kserve/llmisvc-controller-manager-6f7fd9578-hv8sp"
Apr 24 21:51:34.147436 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:34.147401    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/548d87c7-c351-41e2-acc0-ea042d9c464a-cert\") pod \"llmisvc-controller-manager-6f7fd9578-hv8sp\" (UID: \"548d87c7-c351-41e2-acc0-ea042d9c464a\") " pod="kserve/llmisvc-controller-manager-6f7fd9578-hv8sp"
Apr 24 21:51:34.160515 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:34.160494    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q2ct\" (UniqueName: \"kubernetes.io/projected/548d87c7-c351-41e2-acc0-ea042d9c464a-kube-api-access-9q2ct\") pod \"llmisvc-controller-manager-6f7fd9578-hv8sp\" (UID: \"548d87c7-c351-41e2-acc0-ea042d9c464a\") " pod="kserve/llmisvc-controller-manager-6f7fd9578-hv8sp"
Apr 24 21:51:34.296656 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:34.296571    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-6f7fd9578-hv8sp"
Apr 24 21:51:34.419516 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:34.419490    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-6f7fd9578-hv8sp"]
Apr 24 21:51:34.421786 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:51:34.421759    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod548d87c7_c351_41e2_acc0_ea042d9c464a.slice/crio-7ccfe5571e2355457e6047c33ebb93c89a23adf123a826ec7c324060a73d8aee WatchSource:0}: Error finding container 7ccfe5571e2355457e6047c33ebb93c89a23adf123a826ec7c324060a73d8aee: Status 404 returned error can't find the container with id 7ccfe5571e2355457e6047c33ebb93c89a23adf123a826ec7c324060a73d8aee
Apr 24 21:51:34.422967 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:34.422948    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Apr 24 21:51:35.409319 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:35.409284    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-6f7fd9578-hv8sp" event={"ID":"548d87c7-c351-41e2-acc0-ea042d9c464a","Type":"ContainerStarted","Data":"7ccfe5571e2355457e6047c33ebb93c89a23adf123a826ec7c324060a73d8aee"}
Apr 24 21:51:38.423621 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:38.423579    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-6f7fd9578-hv8sp" event={"ID":"548d87c7-c351-41e2-acc0-ea042d9c464a","Type":"ContainerStarted","Data":"cef80c5288febd749ad186b40dde6a14b8e14abac0fb954a04d04f471092a2b2"}
Apr 24 21:51:38.424053 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:38.423654    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-6f7fd9578-hv8sp"
Apr 24 21:51:38.440711 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:51:38.440663    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-6f7fd9578-hv8sp" podStartSLOduration=2.456662491 podStartE2EDuration="5.440649583s" podCreationTimestamp="2026-04-24 21:51:33 +0000 UTC" firstStartedPulling="2026-04-24 21:51:34.423067434 +0000 UTC m=+2087.042524036" lastFinishedPulling="2026-04-24 21:51:37.407054525 +0000 UTC m=+2090.026511128" observedRunningTime="2026-04-24 21:51:38.438511347 +0000 UTC m=+2091.057967972" watchObservedRunningTime="2026-04-24 21:51:38.440649583 +0000 UTC m=+2091.060106207"
Apr 24 21:52:09.429769 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:52:09.429739    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-6f7fd9578-hv8sp"
Apr 24 21:55:11.645375 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.645339    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"]
Apr 24 21:55:11.649901 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.649877    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.652498 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.652476    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Apr 24 21:55:11.652617 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.652504    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"istio-ca-root-cert\""
Apr 24 21:55:11.652617 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.652547    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-2-openshift-default-dockercfg-gjnmd\""
Apr 24 21:55:11.652617 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.652480    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Apr 24 21:55:11.661035 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.661011    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"]
Apr 24 21:55:11.754325 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.754287    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e257fd71-d315-405f-896d-adcdec24499c-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.754541 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.754364    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7dcq\" (UniqueName: \"kubernetes.io/projected/e257fd71-d315-405f-896d-adcdec24499c-kube-api-access-s7dcq\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.754541 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.754505    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e257fd71-d315-405f-896d-adcdec24499c-istio-data\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.754541 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.754539    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e257fd71-d315-405f-896d-adcdec24499c-credential-socket\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.754693 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.754563    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e257fd71-d315-405f-896d-adcdec24499c-istio-token\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.754693 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.754652    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e257fd71-d315-405f-896d-adcdec24499c-istio-podinfo\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.754849 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.754764    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e257fd71-d315-405f-896d-adcdec24499c-workload-socket\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.754849 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.754792    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e257fd71-d315-405f-896d-adcdec24499c-workload-certs\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.754849 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.754818    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e257fd71-d315-405f-896d-adcdec24499c-istio-envoy\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.856306 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.856267    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s7dcq\" (UniqueName: \"kubernetes.io/projected/e257fd71-d315-405f-896d-adcdec24499c-kube-api-access-s7dcq\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.856522 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.856335    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e257fd71-d315-405f-896d-adcdec24499c-istio-data\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.856522 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.856365    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e257fd71-d315-405f-896d-adcdec24499c-credential-socket\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.856522 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.856411    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e257fd71-d315-405f-896d-adcdec24499c-istio-token\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.856696 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.856537    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e257fd71-d315-405f-896d-adcdec24499c-istio-podinfo\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.856696 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.856633    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e257fd71-d315-405f-896d-adcdec24499c-workload-socket\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.856696 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.856675    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e257fd71-d315-405f-896d-adcdec24499c-workload-certs\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.856844 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.856705    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e257fd71-d315-405f-896d-adcdec24499c-istio-envoy\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.856844 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.856749    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e257fd71-d315-405f-896d-adcdec24499c-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.856844 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.856804    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e257fd71-d315-405f-896d-adcdec24499c-credential-socket\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.856844 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.856835    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e257fd71-d315-405f-896d-adcdec24499c-istio-data\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.857035 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.856961    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e257fd71-d315-405f-896d-adcdec24499c-workload-socket\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.857035 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.857009    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e257fd71-d315-405f-896d-adcdec24499c-workload-certs\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.857442 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.857418    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e257fd71-d315-405f-896d-adcdec24499c-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.858841 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.858821    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e257fd71-d315-405f-896d-adcdec24499c-istio-envoy\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.859126 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.859106    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e257fd71-d315-405f-896d-adcdec24499c-istio-podinfo\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.868738 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.868710    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e257fd71-d315-405f-896d-adcdec24499c-istio-token\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.868880 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.868853    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7dcq\" (UniqueName: \"kubernetes.io/projected/e257fd71-d315-405f-896d-adcdec24499c-kube-api-access-s7dcq\") pod \"router-gateway-2-openshift-default-6866b85949-pjzzg\" (UID: \"e257fd71-d315-405f-896d-adcdec24499c\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:11.963447 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:11.963360    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:12.093994 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:12.093924    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"]
Apr 24 21:55:12.096415 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:55:12.096368    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode257fd71_d315_405f_896d_adcdec24499c.slice/crio-9bafb51dfc56ce3875bc5131cd815f3176082b279a98f8998a525b43cd57d235 WatchSource:0}: Error finding container 9bafb51dfc56ce3875bc5131cd815f3176082b279a98f8998a525b43cd57d235: Status 404 returned error can't find the container with id 9bafb51dfc56ce3875bc5131cd815f3176082b279a98f8998a525b43cd57d235
Apr 24 21:55:12.098522 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:12.098490    2569 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Apr 24 21:55:12.098593 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:12.098556    2569 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Apr 24 21:55:12.098593 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:12.098584    2569 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Apr 24 21:55:12.176710 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:12.176667    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg" event={"ID":"e257fd71-d315-405f-896d-adcdec24499c","Type":"ContainerStarted","Data":"da41bfe0b52dcd9813b614b51a9264327c41c0964c83633f022a9a95102969e9"}
Apr 24 21:55:12.176880 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:12.176718    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg" event={"ID":"e257fd71-d315-405f-896d-adcdec24499c","Type":"ContainerStarted","Data":"9bafb51dfc56ce3875bc5131cd815f3176082b279a98f8998a525b43cd57d235"}
Apr 24 21:55:12.195587 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:12.195481    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg" podStartSLOduration=1.195462584 podStartE2EDuration="1.195462584s" podCreationTimestamp="2026-04-24 21:55:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 21:55:12.194661977 +0000 UTC m=+2304.814118604" watchObservedRunningTime="2026-04-24 21:55:12.195462584 +0000 UTC m=+2304.814919206"
Apr 24 21:55:12.963862 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:12.963822    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:15.005589 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:15.005517    2569 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg" podUID="e257fd71-d315-405f-896d-adcdec24499c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Apr 24 21:55:15.765767 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:15.765722    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:15.766097 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:15.766075    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:55:15.767713 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:55:15.767692    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-pjzzg"
Apr 24 21:56:42.082874 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.082840    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"]
Apr 24 21:56:42.086585 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.086566    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 21:56:42.089555 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.089536    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-qdwck\""
Apr 24 21:56:42.089666 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.089537    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-fb-opt-125m-route-f312f5-cb7fb8cf-dockercfg-8n4vs\""
Apr 24 21:56:42.089666 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.089537    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv4e643bc258191ffc517a31cd1d0ddd27-kserve-self-signed-certs\""
Apr 24 21:56:42.096060 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.096041    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"]
Apr 24 21:56:42.185558 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.185520    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 21:56:42.185731 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.185578    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9fr6\" (UniqueName: \"kubernetes.io/projected/3686aaee-a164-47db-a295-48ccda8ae151-kube-api-access-p9fr6\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 21:56:42.185731 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.185642    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 21:56:42.185731 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.185707    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-dshm\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 21:56:42.185854 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.185743    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 21:56:42.185854 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.185774    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3686aaee-a164-47db-a295-48ccda8ae151-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 21:56:42.185854 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.185813    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-home\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 21:56:42.286514 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.286474    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-dshm\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 21:56:42.286691 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.286523    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 21:56:42.286691 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.286558    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3686aaee-a164-47db-a295-48ccda8ae151-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 21:56:42.286691 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.286576    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-home\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 21:56:42.286691 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.286623    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 21:56:42.286691 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.286674    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p9fr6\" (UniqueName: \"kubernetes.io/projected/3686aaee-a164-47db-a295-48ccda8ae151-kube-api-access-p9fr6\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 21:56:42.286941 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.286707    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 21:56:42.286996 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.286943    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 21:56:42.287051 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.287003    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-home\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 21:56:42.287051 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.287024    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 21:56:42.287149 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.287110    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 21:56:42.288877 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.288849    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-dshm\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 21:56:42.288998 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.288920    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3686aaee-a164-47db-a295-48ccda8ae151-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 21:56:42.294603 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.294580    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9fr6\" (UniqueName: \"kubernetes.io/projected/3686aaee-a164-47db-a295-48ccda8ae151-kube-api-access-p9fr6\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 21:56:42.398787 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.398754    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 21:56:42.524859 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.524838    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"]
Apr 24 21:56:42.526906 ip-10-0-131-162 kubenswrapper[2569]: W0424 21:56:42.526875    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3686aaee_a164_47db_a295_48ccda8ae151.slice/crio-c8f60b2609a05cd591cea01ed63b63bc05b55f65be3f6fbcdc9b17d2d2767c95 WatchSource:0}: Error finding container c8f60b2609a05cd591cea01ed63b63bc05b55f65be3f6fbcdc9b17d2d2767c95: Status 404 returned error can't find the container with id c8f60b2609a05cd591cea01ed63b63bc05b55f65be3f6fbcdc9b17d2d2767c95
Apr 24 21:56:42.528934 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:42.528913    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Apr 24 21:56:43.507442 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:43.507404    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1" event={"ID":"3686aaee-a164-47db-a295-48ccda8ae151","Type":"ContainerStarted","Data":"14bed72b6ed353e849ca1da232dd611ca8c57eeb3d6317caccc26e7166367b81"}
Apr 24 21:56:43.507442 ip-10-0-131-162 kubenswrapper[2569]: I0424 21:56:43.507448    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1" event={"ID":"3686aaee-a164-47db-a295-48ccda8ae151","Type":"ContainerStarted","Data":"c8f60b2609a05cd591cea01ed63b63bc05b55f65be3f6fbcdc9b17d2d2767c95"}
Apr 24 22:00:31.142952 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:31.142916    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"]
Apr 24 22:00:31.143372 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:31.143167    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1" podUID="3686aaee-a164-47db-a295-48ccda8ae151" containerName="storage-initializer" containerID="cri-o://14bed72b6ed353e849ca1da232dd611ca8c57eeb3d6317caccc26e7166367b81" gracePeriod=30
Apr 24 22:00:45.613006 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:45.612968    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1_3686aaee-a164-47db-a295-48ccda8ae151/storage-initializer/0.log"
Apr 24 22:00:45.679411 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:45.679367    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-pjzzg_e257fd71-d315-405f-896d-adcdec24499c/istio-proxy/0.log"
Apr 24 22:00:46.686267 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:46.686233    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1_3686aaee-a164-47db-a295-48ccda8ae151/storage-initializer/0.log"
Apr 24 22:00:46.722335 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:46.722302    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-pjzzg_e257fd71-d315-405f-896d-adcdec24499c/istio-proxy/0.log"
Apr 24 22:00:47.745568 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:47.745542    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1_3686aaee-a164-47db-a295-48ccda8ae151/storage-initializer/0.log"
Apr 24 22:00:47.783826 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:47.783789    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-pjzzg_e257fd71-d315-405f-896d-adcdec24499c/istio-proxy/0.log"
Apr 24 22:00:48.785594 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:48.785567    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1_3686aaee-a164-47db-a295-48ccda8ae151/storage-initializer/0.log"
Apr 24 22:00:48.822035 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:48.822006    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-pjzzg_e257fd71-d315-405f-896d-adcdec24499c/istio-proxy/0.log"
Apr 24 22:00:49.838922 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:49.838892    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1_3686aaee-a164-47db-a295-48ccda8ae151/storage-initializer/0.log"
Apr 24 22:00:49.880228 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:49.880198    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-pjzzg_e257fd71-d315-405f-896d-adcdec24499c/istio-proxy/0.log"
Apr 24 22:00:50.890933 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:50.890898    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1_3686aaee-a164-47db-a295-48ccda8ae151/storage-initializer/0.log"
Apr 24 22:00:50.928252 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:50.928213    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-pjzzg_e257fd71-d315-405f-896d-adcdec24499c/istio-proxy/0.log"
Apr 24 22:00:51.928706 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:51.928672    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1_3686aaee-a164-47db-a295-48ccda8ae151/storage-initializer/0.log"
Apr 24 22:00:51.964477 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:51.964448    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-pjzzg_e257fd71-d315-405f-896d-adcdec24499c/istio-proxy/0.log"
Apr 24 22:00:52.973717 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:52.973678    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1_3686aaee-a164-47db-a295-48ccda8ae151/storage-initializer/0.log"
Apr 24 22:00:53.007189 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:53.007161    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-pjzzg_e257fd71-d315-405f-896d-adcdec24499c/istio-proxy/0.log"
Apr 24 22:00:54.026621 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:54.026591    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1_3686aaee-a164-47db-a295-48ccda8ae151/storage-initializer/0.log"
Apr 24 22:00:54.065867 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:54.065839    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-pjzzg_e257fd71-d315-405f-896d-adcdec24499c/istio-proxy/0.log"
Apr 24 22:00:55.085417 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:55.085374    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1_3686aaee-a164-47db-a295-48ccda8ae151/storage-initializer/0.log"
Apr 24 22:00:55.121408 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:55.121368    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-pjzzg_e257fd71-d315-405f-896d-adcdec24499c/istio-proxy/0.log"
Apr 24 22:00:56.184901 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:56.184870    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1_3686aaee-a164-47db-a295-48ccda8ae151/storage-initializer/0.log"
Apr 24 22:00:56.223828 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:56.223800    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-pjzzg_e257fd71-d315-405f-896d-adcdec24499c/istio-proxy/0.log"
Apr 24 22:00:57.282676 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:57.282647    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1_3686aaee-a164-47db-a295-48ccda8ae151/storage-initializer/0.log"
Apr 24 22:00:57.317989 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:57.317964    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-pjzzg_e257fd71-d315-405f-896d-adcdec24499c/istio-proxy/0.log"
Apr 24 22:00:58.223775 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:58.223744    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1_3686aaee-a164-47db-a295-48ccda8ae151/storage-initializer/0.log"
Apr 24 22:00:58.259752 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:58.259715    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-pjzzg_e257fd71-d315-405f-896d-adcdec24499c/istio-proxy/0.log"
Apr 24 22:00:59.161803 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:59.161758    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1_3686aaee-a164-47db-a295-48ccda8ae151/storage-initializer/0.log"
Apr 24 22:00:59.199788 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:00:59.199766    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-2-openshift-default-6866b85949-pjzzg_e257fd71-d315-405f-896d-adcdec24499c/istio-proxy/0.log"
Apr 24 22:01:00.161534 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:00.161506    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-7c5447bb76-q9nvg_635410e6-6fd5-48e0-82e6-e4aed5a9052c/istio-proxy/0.log"
Apr 24 22:01:00.967575 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:00.967546    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-7c5447bb76-q9nvg_635410e6-6fd5-48e0-82e6-e4aed5a9052c/istio-proxy/0.log"
Apr 24 22:01:01.332808 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.332779    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1_3686aaee-a164-47db-a295-48ccda8ae151/storage-initializer/0.log"
Apr 24 22:01:01.332943 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.332857    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 22:01:01.398026 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.397991    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3686aaee-a164-47db-a295-48ccda8ae151-tls-certs\") pod \"3686aaee-a164-47db-a295-48ccda8ae151\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") "
Apr 24 22:01:01.398184 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.398040    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9fr6\" (UniqueName: \"kubernetes.io/projected/3686aaee-a164-47db-a295-48ccda8ae151-kube-api-access-p9fr6\") pod \"3686aaee-a164-47db-a295-48ccda8ae151\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") "
Apr 24 22:01:01.398184 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.398069    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-tmp-dir\") pod \"3686aaee-a164-47db-a295-48ccda8ae151\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") "
Apr 24 22:01:01.398263 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.398176    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-dshm\") pod \"3686aaee-a164-47db-a295-48ccda8ae151\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") "
Apr 24 22:01:01.398263 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.398252    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-home\") pod \"3686aaee-a164-47db-a295-48ccda8ae151\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") "
Apr 24 22:01:01.398339 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.398303    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-model-cache\") pod \"3686aaee-a164-47db-a295-48ccda8ae151\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") "
Apr 24 22:01:01.398339 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.398309    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3686aaee-a164-47db-a295-48ccda8ae151" (UID: "3686aaee-a164-47db-a295-48ccda8ae151"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 22:01:01.398467 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.398367    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-kserve-provision-location\") pod \"3686aaee-a164-47db-a295-48ccda8ae151\" (UID: \"3686aaee-a164-47db-a295-48ccda8ae151\") "
Apr 24 22:01:01.398620 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.398532    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-home" (OuterVolumeSpecName: "home") pod "3686aaee-a164-47db-a295-48ccda8ae151" (UID: "3686aaee-a164-47db-a295-48ccda8ae151"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 22:01:01.398746 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.398723    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-tmp-dir\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 22:01:01.398746 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.398746    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-home\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 22:01:01.398929 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.398790    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-model-cache" (OuterVolumeSpecName: "model-cache") pod "3686aaee-a164-47db-a295-48ccda8ae151" (UID: "3686aaee-a164-47db-a295-48ccda8ae151"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 22:01:01.400285 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.400260    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-dshm" (OuterVolumeSpecName: "dshm") pod "3686aaee-a164-47db-a295-48ccda8ae151" (UID: "3686aaee-a164-47db-a295-48ccda8ae151"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 22:01:01.400674 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.400652    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3686aaee-a164-47db-a295-48ccda8ae151-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3686aaee-a164-47db-a295-48ccda8ae151" (UID: "3686aaee-a164-47db-a295-48ccda8ae151"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Apr 24 22:01:01.400674 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.400665    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3686aaee-a164-47db-a295-48ccda8ae151-kube-api-access-p9fr6" (OuterVolumeSpecName: "kube-api-access-p9fr6") pod "3686aaee-a164-47db-a295-48ccda8ae151" (UID: "3686aaee-a164-47db-a295-48ccda8ae151"). InnerVolumeSpecName "kube-api-access-p9fr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Apr 24 22:01:01.422365 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.422348    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1_3686aaee-a164-47db-a295-48ccda8ae151/storage-initializer/0.log"
Apr 24 22:01:01.422468 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.422409    2569 generic.go:358] "Generic (PLEG): container finished" podID="3686aaee-a164-47db-a295-48ccda8ae151" containerID="14bed72b6ed353e849ca1da232dd611ca8c57eeb3d6317caccc26e7166367b81" exitCode=137
Apr 24 22:01:01.422468 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.422452    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1" event={"ID":"3686aaee-a164-47db-a295-48ccda8ae151","Type":"ContainerDied","Data":"14bed72b6ed353e849ca1da232dd611ca8c57eeb3d6317caccc26e7166367b81"}
Apr 24 22:01:01.422540 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.422480    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1" event={"ID":"3686aaee-a164-47db-a295-48ccda8ae151","Type":"ContainerDied","Data":"c8f60b2609a05cd591cea01ed63b63bc05b55f65be3f6fbcdc9b17d2d2767c95"}
Apr 24 22:01:01.422540 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.422500    2569 scope.go:117] "RemoveContainer" containerID="14bed72b6ed353e849ca1da232dd611ca8c57eeb3d6317caccc26e7166367b81"
Apr 24 22:01:01.422607 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.422540    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
Apr 24 22:01:01.440268 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.440236    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "3686aaee-a164-47db-a295-48ccda8ae151" (UID: "3686aaee-a164-47db-a295-48ccda8ae151"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Apr 24 22:01:01.469912 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.469889    2569 scope.go:117] "RemoveContainer" containerID="14bed72b6ed353e849ca1da232dd611ca8c57eeb3d6317caccc26e7166367b81"
Apr 24 22:01:01.470205 ip-10-0-131-162 kubenswrapper[2569]: E0424 22:01:01.470173    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14bed72b6ed353e849ca1da232dd611ca8c57eeb3d6317caccc26e7166367b81\": container with ID starting with 14bed72b6ed353e849ca1da232dd611ca8c57eeb3d6317caccc26e7166367b81 not found: ID does not exist" containerID="14bed72b6ed353e849ca1da232dd611ca8c57eeb3d6317caccc26e7166367b81"
Apr 24 22:01:01.470301 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.470206    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14bed72b6ed353e849ca1da232dd611ca8c57eeb3d6317caccc26e7166367b81"} err="failed to get container status \"14bed72b6ed353e849ca1da232dd611ca8c57eeb3d6317caccc26e7166367b81\": rpc error: code = NotFound desc = could not find container \"14bed72b6ed353e849ca1da232dd611ca8c57eeb3d6317caccc26e7166367b81\": container with ID starting with 14bed72b6ed353e849ca1da232dd611ca8c57eeb3d6317caccc26e7166367b81 not found: ID does not exist"
Apr 24 22:01:01.499463 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.499410    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9fr6\" (UniqueName: \"kubernetes.io/projected/3686aaee-a164-47db-a295-48ccda8ae151-kube-api-access-p9fr6\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 22:01:01.499463 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.499430    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-dshm\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 22:01:01.499463 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.499442    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-model-cache\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 22:01:01.499463 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.499452    2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3686aaee-a164-47db-a295-48ccda8ae151-kserve-provision-location\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 22:01:01.499463 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.499460    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3686aaee-a164-47db-a295-48ccda8ae151-tls-certs\") on node \"ip-10-0-131-162.ec2.internal\" DevicePath \"\""
Apr 24 22:01:01.763431 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.763359    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"]
Apr 24 22:01:01.766536 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.766507    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7587b89b76-dnrb2_3b69685d-7385-4446-b188-5795eea55e15/manager/0.log"
Apr 24 22:01:01.767902 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.767878    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"]
Apr 24 22:01:01.777593 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.777576    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-844548ff4c-2kll4_40161184-b3c1-48c0-97b9-6eeeb6c54fc8/manager/0.log"
Apr 24 22:01:01.839517 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.839499    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-67566c68b4-59664_0e53de14-6d55-4f8c-96fc-280ab41b6dbc/limitador/0.log"
Apr 24 22:01:01.960492 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:01.960465    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3686aaee-a164-47db-a295-48ccda8ae151" path="/var/lib/kubelet/pods/3686aaee-a164-47db-a295-48ccda8ae151/volumes"
Apr 24 22:01:06.928563 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:06.928532    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9gh4c_fccfd4cf-bc0a-486b-8821-5a6a8737cd44/global-pull-secret-syncer/0.log"
Apr 24 22:01:07.050082 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:07.050048    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jf6mk_a3616b72-2f2e-4eb6-9ba7-cccb369b747d/konnectivity-agent/0.log"
Apr 24 22:01:07.183452 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:07.183356    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-162.ec2.internal_aca2508fa5a89bde3f166bc71272b03f/haproxy/0.log"
Apr 24 22:01:11.030841 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:11.030806    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7587b89b76-dnrb2_3b69685d-7385-4446-b188-5795eea55e15/manager/0.log"
Apr 24 22:01:11.058533 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:11.058498    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-844548ff4c-2kll4_40161184-b3c1-48c0-97b9-6eeeb6c54fc8/manager/0.log"
Apr 24 22:01:11.166879 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:11.166796    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-67566c68b4-59664_0e53de14-6d55-4f8c-96fc-280ab41b6dbc/limitador/0.log"
Apr 24 22:01:12.128434 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.128376    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_419a3eec-3436-4906-b7c4-09159ce540e4/alertmanager/0.log"
Apr 24 22:01:12.150931 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.150897    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_419a3eec-3436-4906-b7c4-09159ce540e4/config-reloader/0.log"
Apr 24 22:01:12.170502 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.170464    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_419a3eec-3436-4906-b7c4-09159ce540e4/kube-rbac-proxy-web/0.log"
Apr 24 22:01:12.193282 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.193249    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_419a3eec-3436-4906-b7c4-09159ce540e4/kube-rbac-proxy/0.log"
Apr 24 22:01:12.212472 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.212438    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_419a3eec-3436-4906-b7c4-09159ce540e4/kube-rbac-proxy-metric/0.log"
Apr 24 22:01:12.234570 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.234540    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_419a3eec-3436-4906-b7c4-09159ce540e4/prom-label-proxy/0.log"
Apr 24 22:01:12.259582 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.259553    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_419a3eec-3436-4906-b7c4-09159ce540e4/init-config-reloader/0.log"
Apr 24 22:01:12.317990 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.317905    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-69db897b98-x7rd5_30fe1833-7b51-45f1-80fd-e27b25a5e82a/kube-state-metrics/0.log"
Apr 24 22:01:12.335005 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.334972    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-69db897b98-x7rd5_30fe1833-7b51-45f1-80fd-e27b25a5e82a/kube-rbac-proxy-main/0.log"
Apr 24 22:01:12.353987 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.353954    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-69db897b98-x7rd5_30fe1833-7b51-45f1-80fd-e27b25a5e82a/kube-rbac-proxy-self/0.log"
Apr 24 22:01:12.377896 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.377865    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6fd764c9f6-wvdt6_d241d572-d4e3-40b6-a749-c692a1d1ca24/metrics-server/0.log"
Apr 24 22:01:12.400349 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.400316    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7dccd58f55-6hk4n_f8679814-3c77-4a01-a7c5-e4064536711f/monitoring-plugin/0.log"
Apr 24 22:01:12.428018 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.427990    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dpzm9_fe14e9fb-5dfc-4c4d-83de-cb303b918323/node-exporter/0.log"
Apr 24 22:01:12.449883 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.449855    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dpzm9_fe14e9fb-5dfc-4c4d-83de-cb303b918323/kube-rbac-proxy/0.log"
Apr 24 22:01:12.468957 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.468929    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dpzm9_fe14e9fb-5dfc-4c4d-83de-cb303b918323/init-textfile/0.log"
Apr 24 22:01:12.638278 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.638245    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-qpm5s_af9903e0-3459-4bde-b42b-715b24c9a4fa/kube-rbac-proxy-main/0.log"
Apr 24 22:01:12.658643 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.658605    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-qpm5s_af9903e0-3459-4bde-b42b-715b24c9a4fa/kube-rbac-proxy-self/0.log"
Apr 24 22:01:12.678545 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.678518    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-qpm5s_af9903e0-3459-4bde-b42b-715b24c9a4fa/openshift-state-metrics/0.log"
Apr 24 22:01:12.731917 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.731884    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0eda6f74-3e5f-4e7d-9ba6-7537620d1120/prometheus/0.log"
Apr 24 22:01:12.750570 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.750546    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0eda6f74-3e5f-4e7d-9ba6-7537620d1120/config-reloader/0.log"
Apr 24 22:01:12.769863 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.769834    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0eda6f74-3e5f-4e7d-9ba6-7537620d1120/thanos-sidecar/0.log"
Apr 24 22:01:12.791185 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.791151    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0eda6f74-3e5f-4e7d-9ba6-7537620d1120/kube-rbac-proxy-web/0.log"
Apr 24 22:01:12.813011 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.812980    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0eda6f74-3e5f-4e7d-9ba6-7537620d1120/kube-rbac-proxy/0.log"
Apr 24 22:01:12.832128 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.832105    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0eda6f74-3e5f-4e7d-9ba6-7537620d1120/kube-rbac-proxy-thanos/0.log"
Apr 24 22:01:12.853888 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.853868    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0eda6f74-3e5f-4e7d-9ba6-7537620d1120/init-config-reloader/0.log"
Apr 24 22:01:12.972295 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:12.972218    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68d84d7d56-rb9td_70235cbe-8222-476f-82f9-dac384f31fc5/telemeter-client/0.log"
Apr 24 22:01:13.000670 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:13.000643    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68d84d7d56-rb9td_70235cbe-8222-476f-82f9-dac384f31fc5/reload/0.log"
Apr 24 22:01:13.032740 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:13.032709    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68d84d7d56-rb9td_70235cbe-8222-476f-82f9-dac384f31fc5/kube-rbac-proxy/0.log"
Apr 24 22:01:13.077491 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:13.077459    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d86fc6796-gc8qh_1e7fe9e3-f045-4684-a90a-a332ae16b229/thanos-query/0.log"
Apr 24 22:01:13.099215 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:13.099181    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d86fc6796-gc8qh_1e7fe9e3-f045-4684-a90a-a332ae16b229/kube-rbac-proxy-web/0.log"
Apr 24 22:01:13.124777 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:13.124742    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d86fc6796-gc8qh_1e7fe9e3-f045-4684-a90a-a332ae16b229/kube-rbac-proxy/0.log"
Apr 24 22:01:13.147611 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:13.147584    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d86fc6796-gc8qh_1e7fe9e3-f045-4684-a90a-a332ae16b229/prom-label-proxy/0.log"
Apr 24 22:01:13.169029 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:13.169008    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d86fc6796-gc8qh_1e7fe9e3-f045-4684-a90a-a332ae16b229/kube-rbac-proxy-rules/0.log"
Apr 24 22:01:13.191546 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:13.191524    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d86fc6796-gc8qh_1e7fe9e3-f045-4684-a90a-a332ae16b229/kube-rbac-proxy-metrics/0.log"
Apr 24 22:01:15.391797 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:15.391770    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8c564f69f-4hd9f_3c7abc73-226a-4d81-8f9a-198998ce37a5/console/0.log"
Apr 24 22:01:15.872186 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:15.872139    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5"]
Apr 24 22:01:15.872720 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:15.872702    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3686aaee-a164-47db-a295-48ccda8ae151" containerName="storage-initializer"
Apr 24 22:01:15.872807 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:15.872722    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3686aaee-a164-47db-a295-48ccda8ae151" containerName="storage-initializer"
Apr 24 22:01:15.872807 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:15.872800    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="3686aaee-a164-47db-a295-48ccda8ae151" containerName="storage-initializer"
Apr 24 22:01:15.878325 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:15.878304    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5"
Apr 24 22:01:15.881404 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:15.881359    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xhf46\"/\"openshift-service-ca.crt\""
Apr 24 22:01:15.881515 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:15.881416    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xhf46\"/\"default-dockercfg-p8nxl\""
Apr 24 22:01:15.881515 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:15.881438    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xhf46\"/\"kube-root-ca.crt\""
Apr 24 22:01:15.883175 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:15.883151    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5"]
Apr 24 22:01:16.035306 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.035268    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06dec0f9-efdc-4456-b56a-39acd4705f15-sys\") pod \"perf-node-gather-daemonset-qxlv5\" (UID: \"06dec0f9-efdc-4456-b56a-39acd4705f15\") " pod="openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5"
Apr 24 22:01:16.035503 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.035367    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxt4c\" (UniqueName: \"kubernetes.io/projected/06dec0f9-efdc-4456-b56a-39acd4705f15-kube-api-access-zxt4c\") pod \"perf-node-gather-daemonset-qxlv5\" (UID: \"06dec0f9-efdc-4456-b56a-39acd4705f15\") " pod="openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5"
Apr 24 22:01:16.035503 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.035449    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06dec0f9-efdc-4456-b56a-39acd4705f15-proc\") pod \"perf-node-gather-daemonset-qxlv5\" (UID: \"06dec0f9-efdc-4456-b56a-39acd4705f15\") " pod="openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5"
Apr 24 22:01:16.035586 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.035502    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06dec0f9-efdc-4456-b56a-39acd4705f15-podres\") pod \"perf-node-gather-daemonset-qxlv5\" (UID: \"06dec0f9-efdc-4456-b56a-39acd4705f15\") " pod="openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5"
Apr 24 22:01:16.035586 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.035530    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06dec0f9-efdc-4456-b56a-39acd4705f15-lib-modules\") pod \"perf-node-gather-daemonset-qxlv5\" (UID: \"06dec0f9-efdc-4456-b56a-39acd4705f15\") " pod="openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5"
Apr 24 22:01:16.136821 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.136729    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zxt4c\" (UniqueName: \"kubernetes.io/projected/06dec0f9-efdc-4456-b56a-39acd4705f15-kube-api-access-zxt4c\") pod \"perf-node-gather-daemonset-qxlv5\" (UID: \"06dec0f9-efdc-4456-b56a-39acd4705f15\") " pod="openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5"
Apr 24 22:01:16.136821 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.136774    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06dec0f9-efdc-4456-b56a-39acd4705f15-proc\") pod \"perf-node-gather-daemonset-qxlv5\" (UID: \"06dec0f9-efdc-4456-b56a-39acd4705f15\") " pod="openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5"
Apr 24 22:01:16.137055 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.136831    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06dec0f9-efdc-4456-b56a-39acd4705f15-podres\") pod \"perf-node-gather-daemonset-qxlv5\" (UID: \"06dec0f9-efdc-4456-b56a-39acd4705f15\") " pod="openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5"
Apr 24 22:01:16.137055 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.136869    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06dec0f9-efdc-4456-b56a-39acd4705f15-lib-modules\") pod \"perf-node-gather-daemonset-qxlv5\" (UID: \"06dec0f9-efdc-4456-b56a-39acd4705f15\") " pod="openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5"
Apr 24 22:01:16.137055 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.136923    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06dec0f9-efdc-4456-b56a-39acd4705f15-sys\") pod \"perf-node-gather-daemonset-qxlv5\" (UID: \"06dec0f9-efdc-4456-b56a-39acd4705f15\") " pod="openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5"
Apr 24 22:01:16.137055 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.136972    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06dec0f9-efdc-4456-b56a-39acd4705f15-podres\") pod \"perf-node-gather-daemonset-qxlv5\" (UID: \"06dec0f9-efdc-4456-b56a-39acd4705f15\") " pod="openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5"
Apr 24 22:01:16.137055 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.136921    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06dec0f9-efdc-4456-b56a-39acd4705f15-proc\") pod \"perf-node-gather-daemonset-qxlv5\" (UID: \"06dec0f9-efdc-4456-b56a-39acd4705f15\") " pod="openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5"
Apr 24 22:01:16.137055 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.136999    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06dec0f9-efdc-4456-b56a-39acd4705f15-sys\") pod \"perf-node-gather-daemonset-qxlv5\" (UID: \"06dec0f9-efdc-4456-b56a-39acd4705f15\") " pod="openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5"
Apr 24 22:01:16.137055 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.137014    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06dec0f9-efdc-4456-b56a-39acd4705f15-lib-modules\") pod \"perf-node-gather-daemonset-qxlv5\" (UID: \"06dec0f9-efdc-4456-b56a-39acd4705f15\") " pod="openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5"
Apr 24 22:01:16.144881 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.144860    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxt4c\" (UniqueName: \"kubernetes.io/projected/06dec0f9-efdc-4456-b56a-39acd4705f15-kube-api-access-zxt4c\") pod \"perf-node-gather-daemonset-qxlv5\" (UID: \"06dec0f9-efdc-4456-b56a-39acd4705f15\") " pod="openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5"
Apr 24 22:01:16.189953 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.189929    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5"
Apr 24 22:01:16.314373 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.314347    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5"]
Apr 24 22:01:16.316612 ip-10-0-131-162 kubenswrapper[2569]: W0424 22:01:16.316581    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod06dec0f9_efdc_4456_b56a_39acd4705f15.slice/crio-af680033f87fe505206cfbcf0102a83bd86f429b033409a1fefcf44a99dfde23 WatchSource:0}: Error finding container af680033f87fe505206cfbcf0102a83bd86f429b033409a1fefcf44a99dfde23: Status 404 returned error can't find the container with id af680033f87fe505206cfbcf0102a83bd86f429b033409a1fefcf44a99dfde23
Apr 24 22:01:16.476597 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.476503    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5" event={"ID":"06dec0f9-efdc-4456-b56a-39acd4705f15","Type":"ContainerStarted","Data":"25de0fcbd707b6a1da165b754f04baf711b3ca30553977c8a464969622fe1f11"}
Apr 24 22:01:16.476597 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.476540    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5" event={"ID":"06dec0f9-efdc-4456-b56a-39acd4705f15","Type":"ContainerStarted","Data":"af680033f87fe505206cfbcf0102a83bd86f429b033409a1fefcf44a99dfde23"}
Apr 24 22:01:16.476597 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.476575    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5"
Apr 24 22:01:16.493740 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.493671    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5" podStartSLOduration=1.493650978 podStartE2EDuration="1.493650978s" podCreationTimestamp="2026-04-24 22:01:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 22:01:16.491717396 +0000 UTC m=+2669.111174023" watchObservedRunningTime="2026-04-24 22:01:16.493650978 +0000 UTC m=+2669.113107603"
Apr 24 22:01:16.734874 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.734793    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xxlvr_7db9a801-20a2-407a-9a59-4ac27c130673/dns/0.log"
Apr 24 22:01:16.753032 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.753005    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xxlvr_7db9a801-20a2-407a-9a59-4ac27c130673/kube-rbac-proxy/0.log"
Apr 24 22:01:16.799545 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:16.799517    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fmb76_a9dfaba2-66af-41a3-8243-3c4e5b0c6ceb/dns-node-resolver/0.log"
Apr 24 22:01:17.290814 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:17.290770    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5595d687-bktl2_dd895c12-8a8d-4d68-9770-2a8d4c33a960/registry/0.log"
Apr 24 22:01:17.315633 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:17.315600    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2g4mv_a99b95b2-a4d2-4609-8097-82171a8a84c6/node-ca/0.log"
Apr 24 22:01:18.134641 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:18.134604    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-7c5447bb76-q9nvg_635410e6-6fd5-48e0-82e6-e4aed5a9052c/istio-proxy/0.log"
Apr 24 22:01:18.589231 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:18.589146    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7tfnv_1028dec7-5f59-4430-92d0-574694e101b1/serve-healthcheck-canary/0.log"
Apr 24 22:01:19.159336 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:19.159299    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qbgk9_114be5a4-3fea-42af-a519-695fa4f7239d/kube-rbac-proxy/0.log"
Apr 24 22:01:19.177752 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:19.177720    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qbgk9_114be5a4-3fea-42af-a519-695fa4f7239d/exporter/0.log"
Apr 24 22:01:19.196581 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:19.196543    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qbgk9_114be5a4-3fea-42af-a519-695fa4f7239d/extractor/0.log"
Apr 24 22:01:21.667536 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:21.667507    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7f997f587c-8xtsj_332ab0d1-5fb6-4a28-b7d7-348fdf59fc8e/manager/0.log"
Apr 24 22:01:22.250156 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:22.250115    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-6f7fd9578-hv8sp_548d87c7-c351-41e2-acc0-ea042d9c464a/manager/0.log"
Apr 24 22:01:22.495169 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:22.495142    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xhf46/perf-node-gather-daemonset-qxlv5"
Apr 24 22:01:22.649861 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:22.649832    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-696fc77849-ft9w6_9139b1f1-263a-46b4-9d76-99bd707dfd00/manager/0.log"
Apr 24 22:01:28.757260 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:28.757203    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppnfd_7839eda1-3d78-433b-97b0-9c26491cd037/kube-multus-additional-cni-plugins/0.log"
Apr 24 22:01:28.775343 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:28.775311    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppnfd_7839eda1-3d78-433b-97b0-9c26491cd037/egress-router-binary-copy/0.log"
Apr 24 22:01:28.793149 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:28.793125    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppnfd_7839eda1-3d78-433b-97b0-9c26491cd037/cni-plugins/0.log"
Apr 24 22:01:28.811225 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:28.811186    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppnfd_7839eda1-3d78-433b-97b0-9c26491cd037/bond-cni-plugin/0.log"
Apr 24 22:01:28.829233 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:28.829203    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppnfd_7839eda1-3d78-433b-97b0-9c26491cd037/routeoverride-cni/0.log"
Apr 24 22:01:28.849245 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:28.849219    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppnfd_7839eda1-3d78-433b-97b0-9c26491cd037/whereabouts-cni-bincopy/0.log"
Apr 24 22:01:28.867747 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:28.867722    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppnfd_7839eda1-3d78-433b-97b0-9c26491cd037/whereabouts-cni/0.log"
Apr 24 22:01:28.938876 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:28.938845    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-f5cf5_c63ed2b6-a107-4890-9ffc-6da7fb948b75/kube-multus/0.log"
Apr 24 22:01:29.054320 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:29.054235    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v4zl5_b2e03e73-fa77-4421-b99b-67c0205f5b37/network-metrics-daemon/0.log"
Apr 24 22:01:29.074458 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:29.074425    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v4zl5_b2e03e73-fa77-4421-b99b-67c0205f5b37/kube-rbac-proxy/0.log"
Apr 24 22:01:30.275483 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:30.275397    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nxnnq_4b964b87-b54e-473c-8ed3-fc3d270c934b/ovn-controller/0.log"
Apr 24 22:01:30.316566 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:30.316538    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nxnnq_4b964b87-b54e-473c-8ed3-fc3d270c934b/ovn-acl-logging/0.log"
Apr 24 22:01:30.338027 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:30.337993    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nxnnq_4b964b87-b54e-473c-8ed3-fc3d270c934b/kube-rbac-proxy-node/0.log"
Apr 24 22:01:30.358630 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:30.358602    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nxnnq_4b964b87-b54e-473c-8ed3-fc3d270c934b/kube-rbac-proxy-ovn-metrics/0.log"
Apr 24 22:01:30.379730 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:30.379702    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nxnnq_4b964b87-b54e-473c-8ed3-fc3d270c934b/northd/0.log"
Apr 24 22:01:30.399867 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:30.399843    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nxnnq_4b964b87-b54e-473c-8ed3-fc3d270c934b/nbdb/0.log"
Apr 24 22:01:30.419422 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:30.419364    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nxnnq_4b964b87-b54e-473c-8ed3-fc3d270c934b/sbdb/0.log"
Apr 24 22:01:30.588233 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:30.588132    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nxnnq_4b964b87-b54e-473c-8ed3-fc3d270c934b/ovnkube-controller/0.log"
Apr 24 22:01:31.944031 ip-10-0-131-162 kubenswrapper[2569]: I0424 22:01:31.943988    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-76jvz_d3357c66-9444-4360-a1f9-e8317c53e78d/network-check-target-container/0.log"