Sep 17 19:04:14.821188 ip-10-0-138-84 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 17 19:04:14.821206 ip-10-0-138-84 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 17 19:04:14.821216 ip-10-0-138-84 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 17 19:04:14.821537 ip-10-0-138-84 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 17 19:04:24.871675 ip-10-0-138-84 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 17 19:04:24.871691 ip-10-0-138-84 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 2538ce9b72114ddb85e7af3563ac8ee9 --
Sep 17 19:06:12.536207 ip-10-0-138-84 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 19:06:16.052254 ip-10-0-138-84 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 19:06:16.052254 ip-10-0-138-84 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 19:06:16.052254 ip-10-0-138-84 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 19:06:16.052254 ip-10-0-138-84 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 19:06:16.052254 ip-10-0-138-84 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 19:06:16.053012 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.052332    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 19:06:16.056506 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056489    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 19:06:16.056506 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056506    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 19:06:16.056573 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056510    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 19:06:16.056573 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056513    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 19:06:16.056573 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056516    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 19:06:16.056573 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056519    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 19:06:16.056573 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056521    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 19:06:16.056573 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056524    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 19:06:16.056573 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056528    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 19:06:16.056573 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056530    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 19:06:16.056573 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056534    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 19:06:16.056573 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056536    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 19:06:16.056573 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056539    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 19:06:16.056573 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056541    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 19:06:16.056573 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056544    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 19:06:16.056573 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056548    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 19:06:16.056573 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056553    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 19:06:16.056573 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056556    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 19:06:16.056573 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056558    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 19:06:16.056573 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056562    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 19:06:16.056573 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056565    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 19:06:16.056573 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056568    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 19:06:16.057053 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056571    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 19:06:16.057053 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056574    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 19:06:16.057053 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056577    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 19:06:16.057053 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056579    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 19:06:16.057053 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056582    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 19:06:16.057053 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056585    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 19:06:16.057053 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056588    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 19:06:16.057053 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056591    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 19:06:16.057053 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056594    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 19:06:16.057053 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056596    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 19:06:16.057053 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056599    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 19:06:16.057053 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056601    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 19:06:16.057053 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056604    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 19:06:16.057053 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056606    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 19:06:16.057053 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056609    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 19:06:16.057053 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056611    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 19:06:16.057053 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056614    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 19:06:16.057053 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056616    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 19:06:16.057053 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056619    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 19:06:16.057053 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056621    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 19:06:16.057582 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056624    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 19:06:16.057582 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056627    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 19:06:16.057582 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056629    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 19:06:16.057582 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056632    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 19:06:16.057582 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056634    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 19:06:16.057582 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056637    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 19:06:16.057582 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056640    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 19:06:16.057582 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056642    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 19:06:16.057582 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056646    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 19:06:16.057582 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056649    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 19:06:16.057582 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056651    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 19:06:16.057582 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056653    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 19:06:16.057582 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056656    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 19:06:16.057582 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056659    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 19:06:16.057582 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056662    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 19:06:16.057582 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056665    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 19:06:16.057582 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056667    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 19:06:16.057582 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056670    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 19:06:16.057582 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056673    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 19:06:16.057582 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056675    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 19:06:16.058082 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056678    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 19:06:16.058082 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056680    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 19:06:16.058082 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056683    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 19:06:16.058082 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056685    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 19:06:16.058082 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056688    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 19:06:16.058082 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056691    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 19:06:16.058082 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056693    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 19:06:16.058082 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056696    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 19:06:16.058082 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056698    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 19:06:16.058082 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056707    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 19:06:16.058082 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056709    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 19:06:16.058082 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056713    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 19:06:16.058082 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056716    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 19:06:16.058082 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056719    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 19:06:16.058082 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056722    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 19:06:16.058082 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056725    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 19:06:16.058082 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056727    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 19:06:16.058082 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056730    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 19:06:16.058082 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056733    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 19:06:16.058082 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056736    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 19:06:16.058558 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056740    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 19:06:16.058558 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056742    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 19:06:16.058558 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056746    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 19:06:16.058558 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056748    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 19:06:16.058558 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056751    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 19:06:16.058558 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056753    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 19:06:16.058558 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056756    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 19:06:16.058558 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056758    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 19:06:16.058558 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056761    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 19:06:16.058558 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056763    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 19:06:16.058558 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056766    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 19:06:16.058558 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056769    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 19:06:16.058558 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056773    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 19:06:16.058558 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056776    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 19:06:16.058558 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056778    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 19:06:16.058558 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056781    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 19:06:16.058558 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.056783    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 19:06:16.058558 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057514    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 19:06:16.058558 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057520    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 19:06:16.059031 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057523    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 19:06:16.059031 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057526    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 19:06:16.059031 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057528    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 19:06:16.059031 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057532    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 19:06:16.059031 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057534    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 19:06:16.059031 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057537    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 19:06:16.059031 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057540    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 19:06:16.059031 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057543    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 19:06:16.059031 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057545    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 19:06:16.059031 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057548    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 19:06:16.059031 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057551    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 19:06:16.059031 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057554    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 19:06:16.059031 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057557    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 19:06:16.059031 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057560    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 19:06:16.059031 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057563    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 19:06:16.059031 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057566    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 19:06:16.059031 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057568    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 19:06:16.059031 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057571    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 19:06:16.059031 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057573    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 19:06:16.059031 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057577    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 19:06:16.059531 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057580    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 19:06:16.059531 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057583    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 19:06:16.059531 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057585    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 19:06:16.059531 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057588    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 19:06:16.059531 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057591    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 19:06:16.059531 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057593    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 19:06:16.059531 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057596    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 19:06:16.059531 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057598    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 19:06:16.059531 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057601    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 19:06:16.059531 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057603    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 19:06:16.059531 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057606    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 19:06:16.059531 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057608    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 19:06:16.059531 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057611    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 19:06:16.059531 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057613    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 19:06:16.059531 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057616    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 19:06:16.059531 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057618    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 19:06:16.059531 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057621    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 19:06:16.059531 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057624    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 19:06:16.059531 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057627    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 19:06:16.059531 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057629    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 19:06:16.060025 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057632    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 19:06:16.060025 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057635    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 19:06:16.060025 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057638    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 19:06:16.060025 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057640    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 19:06:16.060025 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057643    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 19:06:16.060025 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057646    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 19:06:16.060025 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057648    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 19:06:16.060025 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057651    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 19:06:16.060025 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057653    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 19:06:16.060025 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057656    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 19:06:16.060025 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057658    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 19:06:16.060025 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057661    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 19:06:16.060025 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057663    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 19:06:16.060025 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057666    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 19:06:16.060025 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057669    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 19:06:16.060025 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057673    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 19:06:16.060025 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057677    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 19:06:16.060025 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057680    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 19:06:16.060025 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057682    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 19:06:16.060025 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057685    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 19:06:16.060512 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057688    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 19:06:16.060512 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057693    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 19:06:16.060512 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057696    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 19:06:16.060512 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057699    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 19:06:16.060512 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057702    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 19:06:16.060512 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057705    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 19:06:16.060512 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057707    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 19:06:16.060512 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057710    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 19:06:16.060512 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057714    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 19:06:16.060512 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057722    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 19:06:16.060512 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057725    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 19:06:16.060512 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057728    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 19:06:16.060512 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057731    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 19:06:16.060512 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057734    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 19:06:16.060512 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057737    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 19:06:16.060512 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057739    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 19:06:16.060512 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057742    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 19:06:16.060512 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057745    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 19:06:16.060512 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057747    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 19:06:16.060994 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057750    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 19:06:16.060994 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057752    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 19:06:16.060994 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057755    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 19:06:16.060994 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057757    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 19:06:16.060994 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057760    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 19:06:16.060994 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057762    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 19:06:16.060994 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057765    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 19:06:16.060994 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057767    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 19:06:16.060994 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057770    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 19:06:16.060994 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057772    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 19:06:16.060994 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057775    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 19:06:16.060994 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057777    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 19:06:16.060994 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057780    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 19:06:16.060994 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057782    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 19:06:16.060994 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057785    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 19:06:16.060994 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057788    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 19:06:16.060994 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057791    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 19:06:16.060994 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.057793    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 19:06:16.060994 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058185    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 19:06:16.060994 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058190    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 19:06:16.061492 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058193    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 19:06:16.061492 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058195    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 19:06:16.061492 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058198    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 19:06:16.061492 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058201    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 19:06:16.061492 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058203    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 19:06:16.061492 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058206    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 19:06:16.061492 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058208    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 19:06:16.061492 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058211    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 19:06:16.061492 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058214    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 19:06:16.061492 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058216    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 19:06:16.061492 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058219    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 19:06:16.061492 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058221    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 19:06:16.061492 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058224    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 19:06:16.061492 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058227    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 19:06:16.061492 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058230    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 19:06:16.061492 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058232    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 19:06:16.061492 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058235    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 19:06:16.061492 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058237    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 19:06:16.061492 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058240    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 19:06:16.061492 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058242    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 19:06:16.061993 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058245    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 19:06:16.061993 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058247    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 19:06:16.061993 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058250    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 19:06:16.061993 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058253    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 19:06:16.061993 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058255    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 19:06:16.061993 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058257    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 19:06:16.061993 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058260    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 19:06:16.061993 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058262    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 19:06:16.061993 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058265    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 19:06:16.061993 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058267    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 19:06:16.061993 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058270    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 19:06:16.061993 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058275    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 19:06:16.061993 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058278    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 19:06:16.061993 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058281    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 19:06:16.061993 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058284    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 19:06:16.061993 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058287    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 19:06:16.061993 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058289    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 19:06:16.061993 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058292    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 19:06:16.061993 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058295    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 19:06:16.062457 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058298    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 19:06:16.062457 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058300    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 19:06:16.062457 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058303    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 19:06:16.062457 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058306    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 19:06:16.062457 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058308    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 19:06:16.062457 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058311    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 19:06:16.062457 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058314    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 19:06:16.062457 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058318    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 19:06:16.062457 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058321    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 19:06:16.062457 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058325    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 19:06:16.062457 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058329    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 19:06:16.062457 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058332    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 19:06:16.062457 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058335    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 19:06:16.062457 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058338    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 19:06:16.062457 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058340    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 19:06:16.062457 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058343    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 19:06:16.062457 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058345    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 19:06:16.062457 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058348    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 19:06:16.062457 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058350    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 19:06:16.062966 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058352    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 19:06:16.062966 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058355    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 19:06:16.062966 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058357    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 19:06:16.062966 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058360    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 19:06:16.062966 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058363    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 19:06:16.062966 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058365    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 19:06:16.062966 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058367    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 19:06:16.062966 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058370    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 19:06:16.062966 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058372    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 19:06:16.062966 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058375    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 19:06:16.062966 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058379    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 19:06:16.062966 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058382    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 19:06:16.062966 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058384    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 19:06:16.062966 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058386    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 19:06:16.062966 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058389    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 19:06:16.062966 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058392    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 19:06:16.062966 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058394    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 19:06:16.062966 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058397    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 19:06:16.062966 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058400    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 19:06:16.063464 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058402    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 19:06:16.063464 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058405    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 19:06:16.063464 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058407    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 19:06:16.063464 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058410    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 19:06:16.063464 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058412    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 19:06:16.063464 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058415    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 19:06:16.063464 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058417    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 19:06:16.063464 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058419    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 19:06:16.063464 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058422    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 19:06:16.063464 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058424    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 19:06:16.063464 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058427    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 19:06:16.063464 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058429    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 19:06:16.063464 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058432    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 19:06:16.063464 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058434    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 19:06:16.063464 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058437    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 19:06:16.063464 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058439    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 19:06:16.063464 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058441    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 19:06:16.063464 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058444    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 19:06:16.063464 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058446    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 19:06:16.063464 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.058449    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058525    2573 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058561    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058571    2573 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058577    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058586    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058589    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058593    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058597    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058600    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058604    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058607    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058611    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058614    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058616    2573 flags.go:64] FLAG: --cgroup-root=""
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058619    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058622    2573 flags.go:64] FLAG: --client-ca-file=""
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058625    2573 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058628    2573 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058633    2573 flags.go:64] FLAG: --cluster-domain=""
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058635    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058638    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058642    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058645    2573 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 19:06:16.063955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058649    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058652    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058655    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058658    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058661    2573 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058664    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058667    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058670    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058672    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058678    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058681    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058685    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058688    2573 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058691    2573 flags.go:64] FLAG: --enable-server="true"
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058695    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058700    2573 flags.go:64] FLAG: --event-burst="100"
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058703    2573 flags.go:64] FLAG: --event-qps="50"
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058706    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058709    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058712    2573 flags.go:64] FLAG: --eviction-hard=""
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058715    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058718    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058721    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058724    2573 flags.go:64] FLAG: --eviction-soft=""
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058727    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 19:06:16.064554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058729    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058732    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058735    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058738    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058740    2573 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058743    2573 flags.go:64] FLAG: --feature-gates=""
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058747    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058749    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058752    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058755    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058758    2573 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058761    2573 flags.go:64] FLAG: --help="false"
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058764    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-138-84.ec2.internal"
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058767    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058770    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058772    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058777    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058780    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058784    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058788    2573 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058790    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058793    2573 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058796    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058799    2573 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 19:06:16.065188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058802    2573 flags.go:64] FLAG: --kube-reserved=""
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058805    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058807    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058810    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058813    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058815    2573 flags.go:64] FLAG: --lock-file=""
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058818    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058821    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058824    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058829    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058832    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058834    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058837    2573 flags.go:64] FLAG: --logging-format="text"
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058840    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058843    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058846    2573 flags.go:64] FLAG: --manifest-url=""
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058848    2573 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058852    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058855    2573 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058859    2573 flags.go:64] FLAG: --max-pods="110"
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058862    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058865    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058867    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058870    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058889    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 19:06:16.065785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058892    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058897    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058904    2573 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058907    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058910    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058913    2573 flags.go:64] FLAG: --pod-cidr=""
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058917    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058922    2573 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058925    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058928    2573 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058931    2573 flags.go:64] FLAG: --port="10250"
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058933    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058936    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02ce18e7f1a00568f"
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058939    2573 flags.go:64] FLAG: --qos-reserved=""
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058942    2573 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058945    2573 flags.go:64] FLAG: --register-node="true"
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058948    2573 flags.go:64] FLAG: --register-with-taints=""
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058951    2573 flags.go:64] FLAG: --registry-burst="10"
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058954    2573 flags.go:64] FLAG: --registry-qps="5"
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058957    2573 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058959    2573 flags.go:64] FLAG: --reserved-memory=""
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058963    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058965    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058968    2573 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058971    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 19:06:16.066444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058974    2573 flags.go:64] FLAG: --runonce="false"
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058977    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058980    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058983    2573 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058986    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058988    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058991    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.058995    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.059007    2573 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.059010    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.059013    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.059016    2573 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.059018    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.059021    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.059025    2573 flags.go:64] FLAG: --system-cgroups=""
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.059028    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.059033    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.059036    2573 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.059039    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.059047    2573 flags.go:64] FLAG: --tls-min-version=""
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.059050    2573 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.059052    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.059055    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.059058    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.059061    2573 flags.go:64] FLAG: --v="2"
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.059065    2573 flags.go:64] FLAG: --version="false"
Sep 17 19:06:16.067080 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.059069    2573 flags.go:64] FLAG: --vmodule=""
Sep 17 19:06:16.067708 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.059072    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 19:06:16.067708 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.059076    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 19:06:16.067708 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059205    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 19:06:16.067708 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059208    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 19:06:16.067708 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059211    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 19:06:16.067708 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059214    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 19:06:16.067708 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059217    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 19:06:16.067708 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059219    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 19:06:16.067708 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059222    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 19:06:16.067708 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059225    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 19:06:16.067708 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059227    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 19:06:16.067708 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059230    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 19:06:16.067708 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059234    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 19:06:16.067708 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059237    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 19:06:16.067708 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059239    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 19:06:16.067708 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059242    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 19:06:16.067708 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059245    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 19:06:16.067708 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059248    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 19:06:16.067708 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059251    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 19:06:16.067708 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059253    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 19:06:16.068206 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059257    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 19:06:16.068206 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059259    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 19:06:16.068206 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059262    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 19:06:16.068206 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059264    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 19:06:16.068206 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059267    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 19:06:16.068206 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059269    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 19:06:16.068206 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059272    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 19:06:16.068206 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059274    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 19:06:16.068206 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059277    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 19:06:16.068206 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059280    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 19:06:16.068206 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059282    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 19:06:16.068206 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059285    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 19:06:16.068206 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059287    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 19:06:16.068206 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059290    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 19:06:16.068206 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059292    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 19:06:16.068206 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059295    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 19:06:16.068206 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059297    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 19:06:16.068206 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059300    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 19:06:16.068206 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059303    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 19:06:16.068206 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059305    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 19:06:16.068687 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059308    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 19:06:16.068687 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059310    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 19:06:16.068687 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059313    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 19:06:16.068687 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059316    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 19:06:16.068687 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059320    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 19:06:16.068687 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059322    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 19:06:16.068687 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059325    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 19:06:16.068687 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059327    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 19:06:16.068687 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059330    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 19:06:16.068687 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059332    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 19:06:16.068687 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059335    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 19:06:16.068687 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059337    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 19:06:16.068687 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059340    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 19:06:16.068687 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059345    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 19:06:16.068687 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059348    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 19:06:16.068687 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059350    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 19:06:16.068687 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059353    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 19:06:16.068687 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059355    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 19:06:16.068687 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059358    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 19:06:16.068687 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059360    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 19:06:16.069199 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059364    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 19:06:16.069199 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059368    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 19:06:16.069199 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059371    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 19:06:16.069199 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059374    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 19:06:16.069199 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059377    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 19:06:16.069199 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059379    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 19:06:16.069199 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059382    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 19:06:16.069199 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059385    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 19:06:16.069199 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059388    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 19:06:16.069199 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059391    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 19:06:16.069199 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059394    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 19:06:16.069199 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059396    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 19:06:16.069199 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059399    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 19:06:16.069199 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059401    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 19:06:16.069199 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059404    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 19:06:16.069199 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059406    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 19:06:16.069199 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059410    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 19:06:16.069199 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059413    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 19:06:16.069199 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059415    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 19:06:16.069199 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059418    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 19:06:16.069683 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059420    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 19:06:16.069683 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059423    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 19:06:16.069683 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059425    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 19:06:16.069683 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059428    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 19:06:16.069683 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059431    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 19:06:16.069683 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059433    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 19:06:16.069683 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059441    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 19:06:16.069683 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059444    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 19:06:16.069683 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059446    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 19:06:16.069683 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059449    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 19:06:16.069683 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059451    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 19:06:16.069683 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059454    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 19:06:16.069683 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059456    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 19:06:16.069683 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059459    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 19:06:16.069683 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059461    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 19:06:16.069683 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059464    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 19:06:16.069683 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059467    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 19:06:16.069683 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059470    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 19:06:16.069683 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059473    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 19:06:16.070163 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059477    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 19:06:16.070163 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.059480    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 19:06:16.070163 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.060163    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 19:06:16.070163 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.067813    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 19:06:16.070163 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.067827    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 19:06:16.070163 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.067847    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 19:06:16.070163 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.067855    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 19:06:16.070163 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.067930    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 19:06:16.070163 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.067939    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 19:06:16.070163 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.067945    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 19:06:16.070163 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.067951    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 19:06:16.070163 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.067955    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 19:06:16.070163 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.067958    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 19:06:16.070163 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.067961    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 19:06:16.070525 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.067964    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 19:06:16.070525 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.067966    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 19:06:16.070525 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.067969    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 19:06:16.070525 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.067972    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 19:06:16.070525 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.067974    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 19:06:16.070525 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.067979    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 19:06:16.070525 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.067984    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 19:06:16.070525 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.067988    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 19:06:16.070525 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.067991    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 19:06:16.070525 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.067994    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 19:06:16.070525 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.067997    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 19:06:16.070525 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.067999    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 19:06:16.070525 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068002    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 19:06:16.070525 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068005    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 19:06:16.070525 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068007    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 19:06:16.070525 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068010    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 19:06:16.070525 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068013    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 19:06:16.070525 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068017    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 19:06:16.070525 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068021    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 19:06:16.071021 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068025    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 19:06:16.071021 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068029    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 19:06:16.071021 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068034    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 19:06:16.071021 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068038    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 19:06:16.071021 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068041    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 19:06:16.071021 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068043    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 19:06:16.071021 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068046    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 19:06:16.071021 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068049    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 19:06:16.071021 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068051    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 19:06:16.071021 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068054    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 19:06:16.071021 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068056    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 19:06:16.071021 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068059    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 19:06:16.071021 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068061    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 19:06:16.071021 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068063    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 19:06:16.071021 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068067    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 19:06:16.071021 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068069    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 19:06:16.071021 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068072    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 19:06:16.071021 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068075    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 19:06:16.071021 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068077    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 19:06:16.071021 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068081    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 19:06:16.071542 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068083    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 19:06:16.071542 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068085    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 19:06:16.071542 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068088    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 19:06:16.071542 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068091    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 19:06:16.071542 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068093    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 19:06:16.071542 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068096    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 19:06:16.071542 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068100    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 19:06:16.071542 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068104    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 19:06:16.071542 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068108    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 19:06:16.071542 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068112    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 19:06:16.071542 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068116    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 19:06:16.071542 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068118    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 19:06:16.071542 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068121    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 19:06:16.071542 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068123    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 19:06:16.071542 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068126    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 19:06:16.071542 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068129    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 19:06:16.071542 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068132    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 19:06:16.071542 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068135    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 19:06:16.071542 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068137    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 19:06:16.071542 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068140    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 19:06:16.072057 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068142    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 19:06:16.072057 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068145    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 19:06:16.072057 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068147    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 19:06:16.072057 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068149    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 19:06:16.072057 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068152    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 19:06:16.072057 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068155    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 19:06:16.072057 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068157    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 19:06:16.072057 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068160    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 19:06:16.072057 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068162    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 19:06:16.072057 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068165    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 19:06:16.072057 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068167    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 19:06:16.072057 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068170    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 19:06:16.072057 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068173    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 19:06:16.072057 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068176    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 19:06:16.072057 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068180    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 19:06:16.072057 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068184    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 19:06:16.072057 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068188    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 19:06:16.072057 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068192    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 19:06:16.072057 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068196    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 19:06:16.072057 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068199    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 19:06:16.072562 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068202    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 19:06:16.072562 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068204    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 19:06:16.072562 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068207    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 19:06:16.072562 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068209    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 19:06:16.072562 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068212    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 19:06:16.072562 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068215    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 19:06:16.072562 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068217    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 19:06:16.072562 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068221    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 19:06:16.072562 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068224    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 19:06:16.072562 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068228    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 19:06:16.072562 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068231    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 19:06:16.072562 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068234    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 19:06:16.072562 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068237    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 19:06:16.072562 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.068242    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 19:06:16.072920 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068386    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 19:06:16.072920 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068392    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 19:06:16.072920 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068395    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 19:06:16.072920 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068398    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 19:06:16.072920 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068401    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 19:06:16.072920 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068404    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 19:06:16.072920 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068407    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 19:06:16.072920 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068410    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 19:06:16.072920 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068413    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 19:06:16.072920 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068415    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 19:06:16.072920 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068418    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 19:06:16.072920 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068421    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 19:06:16.072920 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068424    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 19:06:16.072920 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068428    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 19:06:16.072920 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068432    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 19:06:16.072920 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068437    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 19:06:16.072920 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068441    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 19:06:16.072920 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068445    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 19:06:16.072920 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068448    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 19:06:16.072920 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068451    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 19:06:16.073388 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068453    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 19:06:16.073388 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068456    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 19:06:16.073388 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068459    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 19:06:16.073388 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068461    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 19:06:16.073388 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068464    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 19:06:16.073388 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068467    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 19:06:16.073388 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068469    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 19:06:16.073388 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068472    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 19:06:16.073388 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068475    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 19:06:16.073388 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068477    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 19:06:16.073388 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068479    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 19:06:16.073388 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068482    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 19:06:16.073388 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068484    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 19:06:16.073388 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068487    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 19:06:16.073388 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068489    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 19:06:16.073388 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068492    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 19:06:16.073388 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068494    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 19:06:16.073388 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068497    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 19:06:16.073388 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068499    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 19:06:16.073388 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068501    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 19:06:16.073941 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068504    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 19:06:16.073941 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068507    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 19:06:16.073941 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068511    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 19:06:16.073941 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068516    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 19:06:16.073941 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068521    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 19:06:16.073941 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068526    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 19:06:16.073941 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068530    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 19:06:16.073941 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068533    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 19:06:16.073941 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068536    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 19:06:16.073941 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068539    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 19:06:16.073941 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068541    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 19:06:16.073941 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068544    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 19:06:16.073941 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068546    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 19:06:16.073941 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068549    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 19:06:16.073941 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068552    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 19:06:16.073941 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068555    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 19:06:16.073941 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068558    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 19:06:16.073941 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068561    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 19:06:16.073941 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068563    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 19:06:16.074397 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068566    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 19:06:16.074397 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068568    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 19:06:16.074397 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068571    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 19:06:16.074397 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068573    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 19:06:16.074397 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068576    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 19:06:16.074397 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068578    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 19:06:16.074397 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068581    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 19:06:16.074397 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068583    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 19:06:16.074397 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068586    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 19:06:16.074397 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068589    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 19:06:16.074397 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068593    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 19:06:16.074397 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068597    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 19:06:16.074397 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068601    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 19:06:16.074397 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068606    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 19:06:16.074397 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068609    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 19:06:16.074397 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068611    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 19:06:16.074397 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068614    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 19:06:16.074397 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068616    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 19:06:16.074397 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068619    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 19:06:16.074397 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068621    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 19:06:16.074937 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068624    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 19:06:16.074937 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068626    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 19:06:16.074937 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068628    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 19:06:16.074937 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068631    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 19:06:16.074937 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068633    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 19:06:16.074937 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068636    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 19:06:16.074937 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068639    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 19:06:16.074937 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068641    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 19:06:16.074937 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068643    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 19:06:16.074937 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068647    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 19:06:16.074937 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068651    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 19:06:16.074937 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068654    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 19:06:16.074937 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068656    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 19:06:16.074937 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068659    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 19:06:16.074937 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068661    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 19:06:16.074937 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068664    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 19:06:16.074937 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068667    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 19:06:16.074937 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068669    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 19:06:16.074937 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068674    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 19:06:16.075403 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:16.068679    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 19:06:16.075403 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.068687    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 19:06:16.075403 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.068801    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 19:06:16.075403 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.071654    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 19:06:16.075403 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.072901    2573 server.go:1019] "Starting client certificate rotation"
Sep 17 19:06:16.075403 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.073002    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 19:06:16.075403 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.073734    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 19:06:16.077682 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.077659    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 19:06:16.079381 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.079115    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 19:06:16.083801 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.083785    2573 log.go:25] "Validated CRI v1 runtime API"
Sep 17 19:06:16.085344 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.085330    2573 log.go:25] "Validated CRI v1 image API"
Sep 17 19:06:16.087360 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.087341    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 19:06:16.089716 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.089697    2573 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9145665d-a73c-402b-81a0-438b881d5383:/dev/nvme0n1p3 a6a4f801-0968-43b2-913a-40579bad1689:/dev/nvme0n1p4]
Sep 17 19:06:16.089779 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.089714    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 19:06:16.093989 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.093842    2573 manager.go:216] Machine: {Timestamp:2026-09-17 19:06:16.093373655 +0000 UTC m=+2.032730568 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098134 MemoryCapacity:32812150784 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24867973134b4578409256346dbbc3 SystemUUID:ec248679-7313-4b45-7840-9256346dbbc3 BootID:2538ce9b-7211-4ddb-85e7-af3563ac8ee9 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ec:35:f4:61 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ec:35:f4:61 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:b5:26:3f:7d:2b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812150784 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 19:06:16.093989 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.093977    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 19:06:16.094145 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.094051    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 19:06:16.095747 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.095722    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 19:06:16.095897 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.095748    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-84.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 19:06:16.097095 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.097085    2573 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 19:06:16.097129 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.097098    2573 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 19:06:16.097129 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.097106    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 19:06:16.097129 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.097115    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 19:06:16.097203 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.097182    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 19:06:16.101686 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.101673    2573 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 19:06:16.101813 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.101803    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 19:06:16.101860 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.101837    2573 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 19:06:16.101860 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.101848    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 19:06:16.101956 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.101862    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 19:06:16.101956 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.101871    2573 kubelet.go:398] "Adding apiserver pod source"
Sep 17 19:06:16.101956 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.101893    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 19:06:16.102202 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.102190    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 19:06:16.102239 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.102214    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 19:06:16.104511 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.104493    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 17 19:06:16.106661 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.106638    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 19:06:16.108008 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.107977    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 19:06:16.108096 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.108019    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 19:06:16.109183 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.109166    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 19:06:16.109257 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.109189    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 19:06:16.109257 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.109200    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 19:06:16.109257 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.109208    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 19:06:16.109257 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.109220    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 19:06:16.109257 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.109229    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 19:06:16.109257 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.109254    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 19:06:16.109506 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.109263    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 19:06:16.109506 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.109274    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 19:06:16.109506 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.109283    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 19:06:16.109506 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.109296    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 19:06:16.109506 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.109305    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 19:06:16.109506 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.109333    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 19:06:16.109506 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.109347    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 19:06:16.113365 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.113349    2573 server.go:1268] "Started kubelet"
Sep 17 19:06:16.113459 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.113412    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 19:06:16.113496 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.113430    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 19:06:16.113496 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.113488    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 19:06:16.113928 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.113910    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-84.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 19:06:16.114134 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:16.114083    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 19:06:16.114224 ip-10-0-138-84 systemd[1]: Started Kubernetes Kubelet.
Sep 17 19:06:16.114710 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:16.114127    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-84.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 19:06:16.114710 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.114602    2573 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 19:06:16.115239 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.115135    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 19:06:16.119010 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:16.118983    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 19:06:16.121990 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.121974    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 19:06:16.121990 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.121985    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 19:06:16.122120 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:16.122091    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 17 19:06:16.122566 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.122548    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 19:06:16.122661 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.122569    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 19:06:16.122661 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.122551    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 19:06:16.122757 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.122683    2573 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 19:06:16.122757 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.122690    2573 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 19:06:16.123033 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.122800    2573 factory.go:55] Registering systemd factory
Sep 17 19:06:16.123033 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.122815    2573 factory.go:223] Registration of the systemd container factory successfully
Sep 17 19:06:16.123033 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.123007    2573 factory.go:153] Registering CRI-O factory
Sep 17 19:06:16.123033 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.123022    2573 factory.go:223] Registration of the crio container factory successfully
Sep 17 19:06:16.123233 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.123072    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 19:06:16.123233 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.123091    2573 factory.go:103] Registering Raw factory
Sep 17 19:06:16.123233 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.123106    2573 manager.go:1196] Started watching for new ooms in manager
Sep 17 19:06:16.123415 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.123402    2573 manager.go:349] Starting recovery of all containers
Sep 17 19:06:16.125031 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:16.125001    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-84.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 19:06:16.125031 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:16.125009    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 17 19:06:16.129778 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.129723    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 19:06:16.132148 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.132127    2573 manager.go:354] Recovery completed
Sep 17 19:06:16.145702 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.145682    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 19:06:16.147608 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.147592    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 19:06:16.147680 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.147621    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 19:06:16.147680 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.147632    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientPID"
Sep 17 19:06:16.148135 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.148119    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 19:06:16.148135 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.148132    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 19:06:16.148259 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.148144    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 19:06:16.148259 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.148148    2573 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 19:06:16.148829 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.148815    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 19:06:16.148906 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.148842    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 19:06:16.148906 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.148855    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientPID"
Sep 17 19:06:16.150321 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.150309    2573 policy_none.go:49] "None policy: Start"
Sep 17 19:06:16.150377 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.150323    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 19:06:16.150377 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.150333    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 19:06:16.152246 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.152235    2573 policy_none.go:47] "Start"
Sep 17 19:06:16.159669 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:16.158589    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-84.ec2.internal.18d6312e20b4b0dd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-84.ec2.internal,UID:ip-10-0-138-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-84.ec2.internal,},FirstTimestamp:2026-09-17 19:06:16.113320157 +0000 UTC m=+2.052677069,LastTimestamp:2026-09-17 19:06:16.113320157 +0000 UTC m=+2.052677069,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-84.ec2.internal,}"
Sep 17 19:06:16.168139 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.168120    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f826r"
Sep 17 19:06:16.171466 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:16.171401    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-84.ec2.internal.18d6312e22bfe21c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-84.ec2.internal,UID:ip-10-0-138-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-84.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-84.ec2.internal,},FirstTimestamp:2026-09-17 19:06:16.147608092 +0000 UTC m=+2.086965003,LastTimestamp:2026-09-17 19:06:16.147608092 +0000 UTC m=+2.086965003,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-84.ec2.internal,}"
Sep 17 19:06:16.174192 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.174175    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f826r"
Sep 17 19:06:16.193501 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.193487    2573 manager.go:337] "Starting Device Plugin manager"
Sep 17 19:06:16.205421 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:16.193519    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 19:06:16.205421 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.193529    2573 server.go:87] "Starting device plugin registration server"
Sep 17 19:06:16.205421 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.193740    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 19:06:16.205421 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.193763    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 19:06:16.205421 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.193856    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 19:06:16.205421 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.193948    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 19:06:16.205421 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.193956    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 19:06:16.205421 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:16.194524    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 19:06:16.205421 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:16.194562    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 17 19:06:16.219220 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.219197    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 19:06:16.219306 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.219245    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 19:06:16.219306 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.219266    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 19:06:16.219306 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:16.219301    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 19:06:16.221973 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.221958    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 19:06:16.294462 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.294438    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 19:06:16.295918 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.295899    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 19:06:16.296009 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.295929    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 19:06:16.296009 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.295940    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientPID"
Sep 17 19:06:16.296009 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.295963    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-84.ec2.internal"
Sep 17 19:06:16.308370 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.308325    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-84.ec2.internal"
Sep 17 19:06:16.308370 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:16.308349    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-84.ec2.internal\": node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 17 19:06:16.319760 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.319738    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-84.ec2.internal"]
Sep 17 19:06:16.319852 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.319797    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 19:06:16.321114 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.321098    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 19:06:16.321193 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.321126    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 19:06:16.321193 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.321141    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientPID"
Sep 17 19:06:16.323351 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.323338    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 19:06:16.323483 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.323467    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal"
Sep 17 19:06:16.323519 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.323504    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 19:06:16.324028 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.324015    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 19:06:16.324083 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.324048    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 19:06:16.324083 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.324060    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientPID"
Sep 17 19:06:16.324176 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.324058    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 19:06:16.324209 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.324198    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 19:06:16.324239 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.324211    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientPID"
Sep 17 19:06:16.326257 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.326244    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-84.ec2.internal"
Sep 17 19:06:16.326308 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.326268    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 19:06:16.326909 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.326896    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 19:06:16.326973 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.326920    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 19:06:16.326973 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.326930    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientPID"
Sep 17 19:06:16.343591 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:16.343575    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 17 19:06:16.350484 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:16.350469    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-84.ec2.internal\" not found" node="ip-10-0-138-84.ec2.internal"
Sep 17 19:06:16.354821 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:16.354805    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-84.ec2.internal\" not found" node="ip-10-0-138-84.ec2.internal"
Sep 17 19:06:16.423442 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.423416    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ec83bea1a1b00938d6509815f8b6f1d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal\" (UID: \"0ec83bea1a1b00938d6509815f8b6f1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal"
Sep 17 19:06:16.423442 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.423442    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ec83bea1a1b00938d6509815f8b6f1d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal\" (UID: \"0ec83bea1a1b00938d6509815f8b6f1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal"
Sep 17 19:06:16.423620 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.423459    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/650f74a4f22bb301be07e776d42e3b65-config\") pod \"kube-apiserver-proxy-ip-10-0-138-84.ec2.internal\" (UID: \"650f74a4f22bb301be07e776d42e3b65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-84.ec2.internal"
Sep 17 19:06:16.444668 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:16.444646    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 17 19:06:16.524002 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.523978    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ec83bea1a1b00938d6509815f8b6f1d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal\" (UID: \"0ec83bea1a1b00938d6509815f8b6f1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal"
Sep 17 19:06:16.524093 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.524015    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ec83bea1a1b00938d6509815f8b6f1d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal\" (UID: \"0ec83bea1a1b00938d6509815f8b6f1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal"
Sep 17 19:06:16.524093 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.524036    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/650f74a4f22bb301be07e776d42e3b65-config\") pod \"kube-apiserver-proxy-ip-10-0-138-84.ec2.internal\" (UID: \"650f74a4f22bb301be07e776d42e3b65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-84.ec2.internal"
Sep 17 19:06:16.524093 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.524074    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/650f74a4f22bb301be07e776d42e3b65-config\") pod \"kube-apiserver-proxy-ip-10-0-138-84.ec2.internal\" (UID: \"650f74a4f22bb301be07e776d42e3b65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-84.ec2.internal"
Sep 17 19:06:16.524093 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.524086    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ec83bea1a1b00938d6509815f8b6f1d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal\" (UID: \"0ec83bea1a1b00938d6509815f8b6f1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal"
Sep 17 19:06:16.524233 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.524097    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ec83bea1a1b00938d6509815f8b6f1d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal\" (UID: \"0ec83bea1a1b00938d6509815f8b6f1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal"
Sep 17 19:06:16.545075 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:16.545053    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 17 19:06:16.645893 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:16.645798    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 17 19:06:16.653963 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.653945    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal"
Sep 17 19:06:16.658044 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:16.658020    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-84.ec2.internal"
Sep 17 19:06:16.746372 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:16.746212    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 17 19:06:16.846785 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:16.846753    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 17 19:06:16.947246 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:16.947221    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 17 19:06:17.047958 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:17.047932    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 17 19:06:17.072117 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:17.072093    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 19:06:17.072482 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:17.072244    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 19:06:17.148945 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:17.148921    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 17 19:06:17.182127 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:17.182082    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 19:01:16 +0000 UTC" deadline="2028-04-19 16:40:46.607082308 +0000 UTC"
Sep 17 19:06:17.182127 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:17.182125    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13917h34m29.424961034s"
Sep 17 19:06:17.249765 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:17.249739    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 17 19:06:17.264865 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:17.264844    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 19:06:17.287307 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:17.287268    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod650f74a4f22bb301be07e776d42e3b65.slice/crio-9fe488abcad5b505387a3524a8cfc76ca3a599a1626428a21c542e86b9af9996 WatchSource:0}: Error finding container 9fe488abcad5b505387a3524a8cfc76ca3a599a1626428a21c542e86b9af9996: Status 404 returned error can't find the container with id 9fe488abcad5b505387a3524a8cfc76ca3a599a1626428a21c542e86b9af9996
Sep 17 19:06:17.292972 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:17.292854    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec83bea1a1b00938d6509815f8b6f1d.slice/crio-e7a2897f7d380017c7b8c60b477112c3a2c863c532ed1887471bcedd62f0e127 WatchSource:0}: Error finding container e7a2897f7d380017c7b8c60b477112c3a2c863c532ed1887471bcedd62f0e127: Status 404 returned error can't find the container with id e7a2897f7d380017c7b8c60b477112c3a2c863c532ed1887471bcedd62f0e127
Sep 17 19:06:17.293162 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:17.293148    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 19:06:17.322384 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:17.322358    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal"
Sep 17 19:06:17.336330 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:17.336308    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 19:06:17.338246 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:17.338230    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-84.ec2.internal"
Sep 17 19:06:17.346555 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:17.346536    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 19:06:17.348726 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:17.348709    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 19:06:17.607336 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:17.607252    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 19:06:18.074101 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.074071    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 19:06:18.102589 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.102559    2573 apiserver.go:52] "Watching apiserver"
Sep 17 19:06:18.110778 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.110755    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 19:06:18.111164 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.111140    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-6sp4v","kube-system/kube-apiserver-proxy-ip-10-0-138-84.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk","openshift-cluster-node-tuning-operator/tuned-xsvnv","openshift-image-registry/node-ca-h5vqv","openshift-multus/multus-5vtc4","openshift-multus/network-metrics-daemon-fxwkw","openshift-network-diagnostics/network-check-target-nw2xp","kube-system/konnectivity-agent-6f5gw","openshift-dns/node-resolver-6cnk9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal","openshift-multus/multus-additional-cni-plugins-sx5k8","openshift-network-operator/iptables-alerter-4xv6q","openshift-ovn-kubernetes/ovnkube-node-vbxgv"]
Sep 17 19:06:18.113704 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.113686    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:18.113792 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:18.113771    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxwkw" podUID="b7c8049f-7c97-4d5f-8279-ea12aba931cc"
Sep 17 19:06:18.115804 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.115779    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4xv6q"
Sep 17 19:06:18.117989 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.117966    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk"
Sep 17 19:06:18.118593 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.118575    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 19:06:18.118679 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.118597    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 19:06:18.119115 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.118961    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 19:06:18.119115 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.119056    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lmqvs\""
Sep 17 19:06:18.120042 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.120005    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 19:06:18.120286 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.120265    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 19:06:18.120353 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.120312    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.120683 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.120531    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 19:06:18.120683 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.120626    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-csmsx\""
Sep 17 19:06:18.123069 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.122243    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 19:06:18.123069 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.122455    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 19:06:18.123069 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.122782    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dcc46\""
Sep 17 19:06:18.123069 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.122815    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h5vqv"
Sep 17 19:06:18.123069 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.122861    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 19:06:18.124741 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.124724    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.125175 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.125155    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 19:06:18.125277 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.125207    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 19:06:18.125567 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.125550    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 19:06:18.125774 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.125759    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mx6q8\""
Sep 17 19:06:18.127409 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.126912    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 19:06:18.127409 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.126970    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qnkzk\""
Sep 17 19:06:18.127409 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.127187    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 19:06:18.127409 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.127302    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 19:06:18.127894 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.127487    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 19:06:18.127894 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.127641    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6f5gw"
Sep 17 19:06:18.129408 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.129382    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:18.129492 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:18.129443    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sp4v" podUID="273ee390-dd66-4cfa-b503-c9d1983d5e0a"
Sep 17 19:06:18.129768 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.129749    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 19:06:18.129865 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.129845    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2klb7\""
Sep 17 19:06:18.129939 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.129911    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 19:06:18.131677 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.131655    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-host\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.131774 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.131690    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-cnibin\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.131827 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.131791    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-host-run-k8s-cni-cncf-io\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.131827 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.131815    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4rmj\" (UniqueName: \"kubernetes.io/projected/e7aca5fb-181a-48f6-a75d-12d69ccb0167-kube-api-access-m4rmj\") pod \"aws-ebs-csi-driver-node-cmtjk\" (UID: \"e7aca5fb-181a-48f6-a75d-12d69ccb0167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk"
Sep 17 19:06:18.131942 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.131839    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c545dfa9-0c6e-4493-8f12-cd63c012cb53-serviceca\") pod \"node-ca-h5vqv\" (UID: \"c545dfa9-0c6e-4493-8f12-cd63c012cb53\") " pod="openshift-image-registry/node-ca-h5vqv"
Sep 17 19:06:18.131942 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.131862    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-multus-conf-dir\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.131942 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.131904    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jpql\" (UniqueName: \"kubernetes.io/projected/0e0e5f4d-981b-487c-a961-f7b0039e78cd-kube-api-access-8jpql\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.131942 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.131919    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.131942 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.131927    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjvbz\" (UniqueName: \"kubernetes.io/projected/b7c8049f-7c97-4d5f-8279-ea12aba931cc-kube-api-access-bjvbz\") pod \"network-metrics-daemon-fxwkw\" (UID: \"b7c8049f-7c97-4d5f-8279-ea12aba931cc\") " pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:18.132133 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.131949    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-etc-modprobe-d\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.132133 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.131974    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-etc-systemd\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.132133 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.131995    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-run\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.132133 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.132016    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e0e5f4d-981b-487c-a961-f7b0039e78cd-cni-binary-copy\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.132133 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.132039    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-host-var-lib-cni-bin\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.132133 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.132060    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-hostroot\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.132133 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.132082    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7aca5fb-181a-48f6-a75d-12d69ccb0167-etc-selinux\") pod \"aws-ebs-csi-driver-node-cmtjk\" (UID: \"e7aca5fb-181a-48f6-a75d-12d69ccb0167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk"
Sep 17 19:06:18.132133 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.132106    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-etc-kubernetes\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.132133 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.132129    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w8l9\" (UniqueName: \"kubernetes.io/projected/3d12801a-7163-4260-8f73-d1370505195b-kube-api-access-6w8l9\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.132419 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.132152    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-host-run-netns\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.132419 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.132179    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1783fc9d-0786-47b1-b64b-bb1cd5f3cdb9-host-slash\") pod \"iptables-alerter-4xv6q\" (UID: \"1783fc9d-0786-47b1-b64b-bb1cd5f3cdb9\") " pod="openshift-network-operator/iptables-alerter-4xv6q"
Sep 17 19:06:18.132419 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.132202    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7aca5fb-181a-48f6-a75d-12d69ccb0167-socket-dir\") pod \"aws-ebs-csi-driver-node-cmtjk\" (UID: \"e7aca5fb-181a-48f6-a75d-12d69ccb0167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk"
Sep 17 19:06:18.132419 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.132258    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-system-cni-dir\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.132419 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.132282    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-host-var-lib-kubelet\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.132419 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.132304    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-etc-kubernetes\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.132419 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.132328    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs\") pod \"network-metrics-daemon-fxwkw\" (UID: \"b7c8049f-7c97-4d5f-8279-ea12aba931cc\") " pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:18.132419 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.132362    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7aca5fb-181a-48f6-a75d-12d69ccb0167-device-dir\") pod \"aws-ebs-csi-driver-node-cmtjk\" (UID: \"e7aca5fb-181a-48f6-a75d-12d69ccb0167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk"
Sep 17 19:06:18.132419 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.132384    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-etc-sysconfig\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.132711 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.132408    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3d12801a-7163-4260-8f73-d1370505195b-etc-tuned\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.132711 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.132455    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-multus-cni-dir\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.132711 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.132508    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-multus-socket-dir-parent\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.132711 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.132536    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-etc-sysctl-d\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.132711 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.132594    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d12801a-7163-4260-8f73-d1370505195b-tmp\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.133492 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.132623    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-host-var-lib-cni-multus\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.133595 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.133522    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e0e5f4d-981b-487c-a961-f7b0039e78cd-multus-daemon-config\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.134577 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.134556    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-76vv6\""
Sep 17 19:06:18.135018 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.134994    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 19:06:18.135285 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.135270    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 19:06:18.135536 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.135516    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 19:06:18.138009 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.137979    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 19:06:18.138103 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.138094    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 19:06:18.138385 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.138358    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6cnk9"
Sep 17 19:06:18.138440 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.138426    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 19:06:18.138518 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.138497    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 19:06:18.138782 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.138767    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:18.139271 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.138851    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psshr\" (UniqueName: \"kubernetes.io/projected/1783fc9d-0786-47b1-b64b-bb1cd5f3cdb9-kube-api-access-psshr\") pod \"iptables-alerter-4xv6q\" (UID: \"1783fc9d-0786-47b1-b64b-bb1cd5f3cdb9\") " pod="openshift-network-operator/iptables-alerter-4xv6q"
Sep 17 19:06:18.139271 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.138924    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7aca5fb-181a-48f6-a75d-12d69ccb0167-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cmtjk\" (UID: \"e7aca5fb-181a-48f6-a75d-12d69ccb0167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk"
Sep 17 19:06:18.139271 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:18.138943    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw2xp" podUID="deeaf161-dbf1-4057-b88c-9881a12733d0"
Sep 17 19:06:18.139271 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.138953    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7aca5fb-181a-48f6-a75d-12d69ccb0167-registration-dir\") pod \"aws-ebs-csi-driver-node-cmtjk\" (UID: \"e7aca5fb-181a-48f6-a75d-12d69ccb0167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk"
Sep 17 19:06:18.139271 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.139007    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-etc-sysctl-conf\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.139271 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.139052    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-lib-modules\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.139271 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.139085    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-var-lib-kubelet\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.139271 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.139115    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c545dfa9-0c6e-4493-8f12-cd63c012cb53-host\") pod \"node-ca-h5vqv\" (UID: \"c545dfa9-0c6e-4493-8f12-cd63c012cb53\") " pod="openshift-image-registry/node-ca-h5vqv"
Sep 17 19:06:18.139271 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.139146    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6xdk\" (UniqueName: \"kubernetes.io/projected/c545dfa9-0c6e-4493-8f12-cd63c012cb53-kube-api-access-j6xdk\") pod \"node-ca-h5vqv\" (UID: \"c545dfa9-0c6e-4493-8f12-cd63c012cb53\") " pod="openshift-image-registry/node-ca-h5vqv"
Sep 17 19:06:18.139271 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.139172    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-host-run-multus-certs\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.139271 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.139227    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1783fc9d-0786-47b1-b64b-bb1cd5f3cdb9-iptables-alerter-script\") pod \"iptables-alerter-4xv6q\" (UID: \"1783fc9d-0786-47b1-b64b-bb1cd5f3cdb9\") " pod="openshift-network-operator/iptables-alerter-4xv6q"
Sep 17 19:06:18.139271 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.139258    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7aca5fb-181a-48f6-a75d-12d69ccb0167-sys-fs\") pod \"aws-ebs-csi-driver-node-cmtjk\" (UID: \"e7aca5fb-181a-48f6-a75d-12d69ccb0167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk"
Sep 17 19:06:18.139271 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.139279    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-sys\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.140419 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.140396    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sx5k8"
Sep 17 19:06:18.140598 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.140580    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 19:06:18.141414 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.140955    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 19:06:18.141414 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.140960    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h6r4v\""
Sep 17 19:06:18.142632 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.142610    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 19:06:18.142838 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.142815    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 19:06:18.142944 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.142920    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wzg6z\""
Sep 17 19:06:18.165654 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.165030    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6bswx"
Sep 17 19:06:18.174276 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.174255    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6bswx"
Sep 17 19:06:18.223625 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.223598    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 19:06:18.226864 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.226776    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal" event={"ID":"0ec83bea1a1b00938d6509815f8b6f1d","Type":"ContainerStarted","Data":"e7a2897f7d380017c7b8c60b477112c3a2c863c532ed1887471bcedd62f0e127"}
Sep 17 19:06:18.228083 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.228059    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-84.ec2.internal" event={"ID":"650f74a4f22bb301be07e776d42e3b65","Type":"ContainerStarted","Data":"9fe488abcad5b505387a3524a8cfc76ca3a599a1626428a21c542e86b9af9996"}
Sep 17 19:06:18.239779 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.239750    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7js7j\" (UniqueName: \"kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j\") pod \"network-check-target-nw2xp\" (UID: \"deeaf161-dbf1-4057-b88c-9881a12733d0\") " pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:18.239925 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.239797    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-etc-kubernetes\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.239925 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.239825    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w8l9\" (UniqueName: \"kubernetes.io/projected/3d12801a-7163-4260-8f73-d1370505195b-kube-api-access-6w8l9\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.239925 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.239851    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-host-run-netns\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.239925 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.239873    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7aca5fb-181a-48f6-a75d-12d69ccb0167-device-dir\") pod \"aws-ebs-csi-driver-node-cmtjk\" (UID: \"e7aca5fb-181a-48f6-a75d-12d69ccb0167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk"
Sep 17 19:06:18.239925 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.239916    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/273ee390-dd66-4cfa-b503-c9d1983d5e0a-dbus\") pod \"global-pull-secret-syncer-6sp4v\" (UID: \"273ee390-dd66-4cfa-b503-c9d1983d5e0a\") " pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:18.240178 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.239938    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-host-slash\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.240178 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.239959    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4169f431-6727-4b3e-a060-a59d9924854e-cni-binary-copy\") pod \"multus-additional-cni-plugins-sx5k8\" (UID: \"4169f431-6727-4b3e-a060-a59d9924854e\") " pod="openshift-multus/multus-additional-cni-plugins-sx5k8"
Sep 17 19:06:18.240178 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.239984    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-etc-sysconfig\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.240178 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240006    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3d12801a-7163-4260-8f73-d1370505195b-etc-tuned\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.240178 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240027    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-multus-cni-dir\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.240178 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240050    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-multus-socket-dir-parent\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.240178 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240097    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/273ee390-dd66-4cfa-b503-c9d1983d5e0a-kubelet-config\") pod \"global-pull-secret-syncer-6sp4v\" (UID: \"273ee390-dd66-4cfa-b503-c9d1983d5e0a\") " pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:18.240178 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240119    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-node-log\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.240178 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240140    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/71d0cb8b-edaf-4832-a653-81ddd6c84cca-konnectivity-ca\") pod \"konnectivity-agent-6f5gw\" (UID: \"71d0cb8b-edaf-4832-a653-81ddd6c84cca\") " pod="kube-system/konnectivity-agent-6f5gw"
Sep 17 19:06:18.240178 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240174    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d12801a-7163-4260-8f73-d1370505195b-tmp\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.240716 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240219    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psshr\" (UniqueName: \"kubernetes.io/projected/1783fc9d-0786-47b1-b64b-bb1cd5f3cdb9-kube-api-access-psshr\") pod \"iptables-alerter-4xv6q\" (UID: \"1783fc9d-0786-47b1-b64b-bb1cd5f3cdb9\") " pod="openshift-network-operator/iptables-alerter-4xv6q"
Sep 17 19:06:18.240716 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240244    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7aca5fb-181a-48f6-a75d-12d69ccb0167-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cmtjk\" (UID: \"e7aca5fb-181a-48f6-a75d-12d69ccb0167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk"
Sep 17 19:06:18.240716 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240272    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-run-systemd\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.240716 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240297    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/93bb0a24-3334-4d1f-a905-6f50ccd815ce-ovn-node-metrics-cert\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.240716 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240332    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c4cc155d-43c9-4590-964c-a6564c0ca4e2-hosts-file\") pod \"node-resolver-6cnk9\" (UID: \"c4cc155d-43c9-4590-964c-a6564c0ca4e2\") " pod="openshift-dns/node-resolver-6cnk9"
Sep 17 19:06:18.240716 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240356    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-etc-sysctl-conf\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.240716 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240379    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-lib-modules\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.240716 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240406    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c545dfa9-0c6e-4493-8f12-cd63c012cb53-host\") pod \"node-ca-h5vqv\" (UID: \"c545dfa9-0c6e-4493-8f12-cd63c012cb53\") " pod="openshift-image-registry/node-ca-h5vqv"
Sep 17 19:06:18.240716 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240441    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-host-run-multus-certs\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.240716 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240474    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4169f431-6727-4b3e-a060-a59d9924854e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sx5k8\" (UID: \"4169f431-6727-4b3e-a060-a59d9924854e\") " pod="openshift-multus/multus-additional-cni-plugins-sx5k8"
Sep 17 19:06:18.240716 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240499    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-host\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.240716 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240523    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-cnibin\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.240716 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240546    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-systemd-units\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.240716 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240574    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.240716 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240609    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-multus-conf-dir\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.240716 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jpql\" (UniqueName: \"kubernetes.io/projected/0e0e5f4d-981b-487c-a961-f7b0039e78cd-kube-api-access-8jpql\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.240716 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240658    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4169f431-6727-4b3e-a060-a59d9924854e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sx5k8\" (UID: \"4169f431-6727-4b3e-a060-a59d9924854e\") " pod="openshift-multus/multus-additional-cni-plugins-sx5k8"
Sep 17 19:06:18.241513 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240683    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-etc-modprobe-d\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.241513 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240708    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-hostroot\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.241513 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240743    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1783fc9d-0786-47b1-b64b-bb1cd5f3cdb9-host-slash\") pod \"iptables-alerter-4xv6q\" (UID: \"1783fc9d-0786-47b1-b64b-bb1cd5f3cdb9\") " pod="openshift-network-operator/iptables-alerter-4xv6q"
Sep 17 19:06:18.241513 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240775    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7aca5fb-181a-48f6-a75d-12d69ccb0167-socket-dir\") pod \"aws-ebs-csi-driver-node-cmtjk\" (UID: \"e7aca5fb-181a-48f6-a75d-12d69ccb0167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk"
Sep 17 19:06:18.241513 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240801    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-run-ovn\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.241513 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240825    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-host-cni-bin\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.241513 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240850    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/93bb0a24-3334-4d1f-a905-6f50ccd815ce-ovnkube-config\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.241513 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240912    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/93bb0a24-3334-4d1f-a905-6f50ccd815ce-ovnkube-script-lib\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.241513 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240939    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4169f431-6727-4b3e-a060-a59d9924854e-cnibin\") pod \"multus-additional-cni-plugins-sx5k8\" (UID: \"4169f431-6727-4b3e-a060-a59d9924854e\") " pod="openshift-multus/multus-additional-cni-plugins-sx5k8"
Sep 17 19:06:18.241513 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.240972    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-system-cni-dir\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.241513 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241001    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-host-var-lib-kubelet\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.241513 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241027    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-etc-kubernetes\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.241513 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241062    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs\") pod \"network-metrics-daemon-fxwkw\" (UID: \"b7c8049f-7c97-4d5f-8279-ea12aba931cc\") " pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:18.241513 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241088    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret\") pod \"global-pull-secret-syncer-6sp4v\" (UID: \"273ee390-dd66-4cfa-b503-c9d1983d5e0a\") " pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:18.241513 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241111    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-host-kubelet\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.241513 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241133    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-etc-openvswitch\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.241513 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241157    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-log-socket\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.242400 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241181    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-host-cni-netd\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.242400 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241209    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4169f431-6727-4b3e-a060-a59d9924854e-system-cni-dir\") pod \"multus-additional-cni-plugins-sx5k8\" (UID: \"4169f431-6727-4b3e-a060-a59d9924854e\") " pod="openshift-multus/multus-additional-cni-plugins-sx5k8"
Sep 17 19:06:18.242400 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241236    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-etc-sysctl-d\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.242400 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241261    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-host-var-lib-cni-multus\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.242400 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241286    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e0e5f4d-981b-487c-a961-f7b0039e78cd-multus-daemon-config\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.242400 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241309    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7aca5fb-181a-48f6-a75d-12d69ccb0167-registration-dir\") pod \"aws-ebs-csi-driver-node-cmtjk\" (UID: \"e7aca5fb-181a-48f6-a75d-12d69ccb0167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk"
Sep 17 19:06:18.242400 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241331    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/93bb0a24-3334-4d1f-a905-6f50ccd815ce-env-overrides\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.242400 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241358    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcfxv\" (UniqueName: \"kubernetes.io/projected/93bb0a24-3334-4d1f-a905-6f50ccd815ce-kube-api-access-rcfxv\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.242400 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241382    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4cc155d-43c9-4590-964c-a6564c0ca4e2-tmp-dir\") pod \"node-resolver-6cnk9\" (UID: \"c4cc155d-43c9-4590-964c-a6564c0ca4e2\") " pod="openshift-dns/node-resolver-6cnk9"
Sep 17 19:06:18.242400 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241408    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-var-lib-kubelet\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.242400 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241436    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6xdk\" (UniqueName: \"kubernetes.io/projected/c545dfa9-0c6e-4493-8f12-cd63c012cb53-kube-api-access-j6xdk\") pod \"node-ca-h5vqv\" (UID: \"c545dfa9-0c6e-4493-8f12-cd63c012cb53\") " pod="openshift-image-registry/node-ca-h5vqv"
Sep 17 19:06:18.242400 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241461    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1783fc9d-0786-47b1-b64b-bb1cd5f3cdb9-iptables-alerter-script\") pod \"iptables-alerter-4xv6q\" (UID: \"1783fc9d-0786-47b1-b64b-bb1cd5f3cdb9\") " pod="openshift-network-operator/iptables-alerter-4xv6q"
Sep 17 19:06:18.242400 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241507    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7aca5fb-181a-48f6-a75d-12d69ccb0167-sys-fs\") pod \"aws-ebs-csi-driver-node-cmtjk\" (UID: \"e7aca5fb-181a-48f6-a75d-12d69ccb0167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk"
Sep 17 19:06:18.242400 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241535    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4rmj\" (UniqueName: \"kubernetes.io/projected/e7aca5fb-181a-48f6-a75d-12d69ccb0167-kube-api-access-m4rmj\") pod \"aws-ebs-csi-driver-node-cmtjk\" (UID: \"e7aca5fb-181a-48f6-a75d-12d69ccb0167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk"
Sep 17 19:06:18.242400 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241560    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4169f431-6727-4b3e-a060-a59d9924854e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sx5k8\" (UID: \"4169f431-6727-4b3e-a060-a59d9924854e\") " pod="openshift-multus/multus-additional-cni-plugins-sx5k8"
Sep 17 19:06:18.242400 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241586    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-sys\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.242400 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241610    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-host-run-k8s-cni-cncf-io\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.243244 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241637    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-host-run-netns\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.243244 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241670    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-var-lib-openvswitch\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.243244 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241696    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vq7s\" (UniqueName: \"kubernetes.io/projected/c4cc155d-43c9-4590-964c-a6564c0ca4e2-kube-api-access-5vq7s\") pod \"node-resolver-6cnk9\" (UID: \"c4cc155d-43c9-4590-964c-a6564c0ca4e2\") " pod="openshift-dns/node-resolver-6cnk9"
Sep 17 19:06:18.243244 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241721    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c545dfa9-0c6e-4493-8f12-cd63c012cb53-serviceca\") pod \"node-ca-h5vqv\" (UID: \"c545dfa9-0c6e-4493-8f12-cd63c012cb53\") " pod="openshift-image-registry/node-ca-h5vqv"
Sep 17 19:06:18.243244 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241746    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjvbz\" (UniqueName: \"kubernetes.io/projected/b7c8049f-7c97-4d5f-8279-ea12aba931cc-kube-api-access-bjvbz\") pod \"network-metrics-daemon-fxwkw\" (UID: \"b7c8049f-7c97-4d5f-8279-ea12aba931cc\") " pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:18.243244 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241770    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-run-openvswitch\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.243244 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241802    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlq4k\" (UniqueName: \"kubernetes.io/projected/4169f431-6727-4b3e-a060-a59d9924854e-kube-api-access-zlq4k\") pod \"multus-additional-cni-plugins-sx5k8\" (UID: \"4169f431-6727-4b3e-a060-a59d9924854e\") " pod="openshift-multus/multus-additional-cni-plugins-sx5k8"
Sep 17 19:06:18.243244 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241832    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-etc-systemd\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.243244 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241865    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-run\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.243244 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241907    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e0e5f4d-981b-487c-a961-f7b0039e78cd-cni-binary-copy\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.243244 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241936    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-host-var-lib-cni-bin\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.243244 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241963    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7aca5fb-181a-48f6-a75d-12d69ccb0167-etc-selinux\") pod \"aws-ebs-csi-driver-node-cmtjk\" (UID: \"e7aca5fb-181a-48f6-a75d-12d69ccb0167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk"
Sep 17 19:06:18.243244 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.241989    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.243244 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.242016    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/71d0cb8b-edaf-4832-a653-81ddd6c84cca-agent-certs\") pod \"konnectivity-agent-6f5gw\" (UID: \"71d0cb8b-edaf-4832-a653-81ddd6c84cca\") " pod="kube-system/konnectivity-agent-6f5gw"
Sep 17 19:06:18.243244 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.242129    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-etc-kubernetes\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.243244 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.242362    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-host-run-netns\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.243244 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.242409    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7aca5fb-181a-48f6-a75d-12d69ccb0167-device-dir\") pod \"aws-ebs-csi-driver-node-cmtjk\" (UID: \"e7aca5fb-181a-48f6-a75d-12d69ccb0167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk"
Sep 17 19:06:18.244058 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.242462    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-etc-sysconfig\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.244058 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.242779    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 19:06:18.244058 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.243277    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-etc-kubernetes\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.244058 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.243386    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-cnibin\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.244058 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.243458    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-multus-socket-dir-parent\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.244058 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.243458    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-multus-cni-dir\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.244058 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.243521    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-multus-conf-dir\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.244058 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.243624    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-etc-modprobe-d\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.244058 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.243686    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-host-var-lib-cni-multus\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.244058 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.243693    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-hostroot\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.244058 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.243729    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1783fc9d-0786-47b1-b64b-bb1cd5f3cdb9-host-slash\") pod \"iptables-alerter-4xv6q\" (UID: \"1783fc9d-0786-47b1-b64b-bb1cd5f3cdb9\") " pod="openshift-network-operator/iptables-alerter-4xv6q"
Sep 17 19:06:18.244058 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:18.243793    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 19:06:18.244058 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.243835    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-system-cni-dir\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.244058 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:18.243897    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs podName:b7c8049f-7c97-4d5f-8279-ea12aba931cc nodeName:}" failed. No retries permitted until 2026-09-17 19:06:18.743839118 +0000 UTC m=+4.683196019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs") pod "network-metrics-daemon-fxwkw" (UID: "b7c8049f-7c97-4d5f-8279-ea12aba931cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 19:06:18.244058 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.244005    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-etc-sysctl-d\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.244058 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.244049    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7aca5fb-181a-48f6-a75d-12d69ccb0167-socket-dir\") pod \"aws-ebs-csi-driver-node-cmtjk\" (UID: \"e7aca5fb-181a-48f6-a75d-12d69ccb0167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk"
Sep 17 19:06:18.244798 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.244099    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7aca5fb-181a-48f6-a75d-12d69ccb0167-sys-fs\") pod \"aws-ebs-csi-driver-node-cmtjk\" (UID: \"e7aca5fb-181a-48f6-a75d-12d69ccb0167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk"
Sep 17 19:06:18.244798 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.244156    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7aca5fb-181a-48f6-a75d-12d69ccb0167-registration-dir\") pod \"aws-ebs-csi-driver-node-cmtjk\" (UID: \"e7aca5fb-181a-48f6-a75d-12d69ccb0167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk"
Sep 17 19:06:18.244798 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.243897    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-host-var-lib-kubelet\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.244798 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.244235    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e0e5f4d-981b-487c-a961-f7b0039e78cd-multus-daemon-config\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.244798 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.244424    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-var-lib-kubelet\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.244798 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.244479    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-run\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.244798 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.244547    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-etc-systemd\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.244798 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.244590    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-host-var-lib-cni-bin\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.244798 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.244698    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-sys\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.244798 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.244745    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1783fc9d-0786-47b1-b64b-bb1cd5f3cdb9-iptables-alerter-script\") pod \"iptables-alerter-4xv6q\" (UID: \"1783fc9d-0786-47b1-b64b-bb1cd5f3cdb9\") " pod="openshift-network-operator/iptables-alerter-4xv6q"
Sep 17 19:06:18.244798 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.244751    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-host-run-k8s-cni-cncf-io\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.245315 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.244849    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7aca5fb-181a-48f6-a75d-12d69ccb0167-etc-selinux\") pod \"aws-ebs-csi-driver-node-cmtjk\" (UID: \"e7aca5fb-181a-48f6-a75d-12d69ccb0167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk"
Sep 17 19:06:18.245315 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.245006    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-etc-sysctl-conf\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.245315 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.245054    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e0e5f4d-981b-487c-a961-f7b0039e78cd-cni-binary-copy\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.245315 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.245118    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e0e5f4d-981b-487c-a961-f7b0039e78cd-host-run-multus-certs\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.245315 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.245169    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c545dfa9-0c6e-4493-8f12-cd63c012cb53-serviceca\") pod \"node-ca-h5vqv\" (UID: \"c545dfa9-0c6e-4493-8f12-cd63c012cb53\") " pod="openshift-image-registry/node-ca-h5vqv"
Sep 17 19:06:18.245315 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.245205    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-lib-modules\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.245315 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.245240    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7aca5fb-181a-48f6-a75d-12d69ccb0167-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cmtjk\" (UID: \"e7aca5fb-181a-48f6-a75d-12d69ccb0167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk"
Sep 17 19:06:18.245315 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.245245    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c545dfa9-0c6e-4493-8f12-cd63c012cb53-host\") pod \"node-ca-h5vqv\" (UID: \"c545dfa9-0c6e-4493-8f12-cd63c012cb53\") " pod="openshift-image-registry/node-ca-h5vqv"
Sep 17 19:06:18.245315 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.245289    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d12801a-7163-4260-8f73-d1370505195b-host\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.247616 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.247586    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3d12801a-7163-4260-8f73-d1370505195b-etc-tuned\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.248168 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.248128    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d12801a-7163-4260-8f73-d1370505195b-tmp\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.253717 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.253697    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w8l9\" (UniqueName: \"kubernetes.io/projected/3d12801a-7163-4260-8f73-d1370505195b-kube-api-access-6w8l9\") pod \"tuned-xsvnv\" (UID: \"3d12801a-7163-4260-8f73-d1370505195b\") " pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.259502 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.259478    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psshr\" (UniqueName: \"kubernetes.io/projected/1783fc9d-0786-47b1-b64b-bb1cd5f3cdb9-kube-api-access-psshr\") pod \"iptables-alerter-4xv6q\" (UID: \"1783fc9d-0786-47b1-b64b-bb1cd5f3cdb9\") " pod="openshift-network-operator/iptables-alerter-4xv6q"
Sep 17 19:06:18.260114 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.260092    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4rmj\" (UniqueName: \"kubernetes.io/projected/e7aca5fb-181a-48f6-a75d-12d69ccb0167-kube-api-access-m4rmj\") pod \"aws-ebs-csi-driver-node-cmtjk\" (UID: \"e7aca5fb-181a-48f6-a75d-12d69ccb0167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk"
Sep 17 19:06:18.260225 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.260203    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jpql\" (UniqueName: \"kubernetes.io/projected/0e0e5f4d-981b-487c-a961-f7b0039e78cd-kube-api-access-8jpql\") pod \"multus-5vtc4\" (UID: \"0e0e5f4d-981b-487c-a961-f7b0039e78cd\") " pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.262282 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.262228    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjvbz\" (UniqueName: \"kubernetes.io/projected/b7c8049f-7c97-4d5f-8279-ea12aba931cc-kube-api-access-bjvbz\") pod \"network-metrics-daemon-fxwkw\" (UID: \"b7c8049f-7c97-4d5f-8279-ea12aba931cc\") " pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:18.269914 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.269873    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6xdk\" (UniqueName: \"kubernetes.io/projected/c545dfa9-0c6e-4493-8f12-cd63c012cb53-kube-api-access-j6xdk\") pod \"node-ca-h5vqv\" (UID: \"c545dfa9-0c6e-4493-8f12-cd63c012cb53\") " pod="openshift-image-registry/node-ca-h5vqv"
Sep 17 19:06:18.342323 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.342234    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-run-ovn\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.342918 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.342545    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-run-ovn\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.345032 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.342269    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-host-cni-bin\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.345032 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.344990    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-host-cni-bin\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.345032 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.344989    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/93bb0a24-3334-4d1f-a905-6f50ccd815ce-ovnkube-config\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.345248 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.345151    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/93bb0a24-3334-4d1f-a905-6f50ccd815ce-ovnkube-script-lib\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.345248 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.345190    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4169f431-6727-4b3e-a060-a59d9924854e-cnibin\") pod \"multus-additional-cni-plugins-sx5k8\" (UID: \"4169f431-6727-4b3e-a060-a59d9924854e\") " pod="openshift-multus/multus-additional-cni-plugins-sx5k8"
Sep 17 19:06:18.345248 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.345242    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret\") pod \"global-pull-secret-syncer-6sp4v\" (UID: \"273ee390-dd66-4cfa-b503-c9d1983d5e0a\") " pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:18.345384 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.345270    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-host-kubelet\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.345384 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.345316    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-etc-openvswitch\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.345384 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.345348    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-log-socket\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.345384 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.345379    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-host-cni-netd\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.345559 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.345404    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4169f431-6727-4b3e-a060-a59d9924854e-system-cni-dir\") pod \"multus-additional-cni-plugins-sx5k8\" (UID: \"4169f431-6727-4b3e-a060-a59d9924854e\") " pod="openshift-multus/multus-additional-cni-plugins-sx5k8"
Sep 17 19:06:18.345559 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.345436    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/93bb0a24-3334-4d1f-a905-6f50ccd815ce-env-overrides\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.345559 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.345467    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcfxv\" (UniqueName: \"kubernetes.io/projected/93bb0a24-3334-4d1f-a905-6f50ccd815ce-kube-api-access-rcfxv\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.345559 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.345497    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4cc155d-43c9-4590-964c-a6564c0ca4e2-tmp-dir\") pod \"node-resolver-6cnk9\" (UID: \"c4cc155d-43c9-4590-964c-a6564c0ca4e2\") " pod="openshift-dns/node-resolver-6cnk9"
Sep 17 19:06:18.345559 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.345533    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4169f431-6727-4b3e-a060-a59d9924854e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sx5k8\" (UID: \"4169f431-6727-4b3e-a060-a59d9924854e\") " pod="openshift-multus/multus-additional-cni-plugins-sx5k8"
Sep 17 19:06:18.345797 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.345646    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-host-run-netns\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.345797 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.345710    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-var-lib-openvswitch\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.345797 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.345729    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/93bb0a24-3334-4d1f-a905-6f50ccd815ce-ovnkube-config\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.345797 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.345742    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vq7s\" (UniqueName: \"kubernetes.io/projected/c4cc155d-43c9-4590-964c-a6564c0ca4e2-kube-api-access-5vq7s\") pod \"node-resolver-6cnk9\" (UID: \"c4cc155d-43c9-4590-964c-a6564c0ca4e2\") " pod="openshift-dns/node-resolver-6cnk9"
Sep 17 19:06:18.345797 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.345786    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-run-openvswitch\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.346046 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.345852    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlq4k\" (UniqueName: \"kubernetes.io/projected/4169f431-6727-4b3e-a060-a59d9924854e-kube-api-access-zlq4k\") pod \"multus-additional-cni-plugins-sx5k8\" (UID: \"4169f431-6727-4b3e-a060-a59d9924854e\") " pod="openshift-multus/multus-additional-cni-plugins-sx5k8"
Sep 17 19:06:18.346046 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.345935    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.346046 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.345967    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/71d0cb8b-edaf-4832-a653-81ddd6c84cca-agent-certs\") pod \"konnectivity-agent-6f5gw\" (UID: \"71d0cb8b-edaf-4832-a653-81ddd6c84cca\") " pod="kube-system/konnectivity-agent-6f5gw"
Sep 17 19:06:18.346046 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.345995    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7js7j\" (UniqueName: \"kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j\") pod \"network-check-target-nw2xp\" (UID: \"deeaf161-dbf1-4057-b88c-9881a12733d0\") " pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:18.346046 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.346029    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/273ee390-dd66-4cfa-b503-c9d1983d5e0a-dbus\") pod \"global-pull-secret-syncer-6sp4v\" (UID: \"273ee390-dd66-4cfa-b503-c9d1983d5e0a\") " pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:18.346261 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.346089    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-host-slash\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.346261 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.346120    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4169f431-6727-4b3e-a060-a59d9924854e-cni-binary-copy\") pod \"multus-additional-cni-plugins-sx5k8\" (UID: \"4169f431-6727-4b3e-a060-a59d9924854e\") " pod="openshift-multus/multus-additional-cni-plugins-sx5k8"
Sep 17 19:06:18.346261 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.346194    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/273ee390-dd66-4cfa-b503-c9d1983d5e0a-kubelet-config\") pod \"global-pull-secret-syncer-6sp4v\" (UID: \"273ee390-dd66-4cfa-b503-c9d1983d5e0a\") " pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:18.346261 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.346233    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-node-log\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.346436 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.346275    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/71d0cb8b-edaf-4832-a653-81ddd6c84cca-konnectivity-ca\") pod \"konnectivity-agent-6f5gw\" (UID: \"71d0cb8b-edaf-4832-a653-81ddd6c84cca\") " pod="kube-system/konnectivity-agent-6f5gw"
Sep 17 19:06:18.346436 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.346303    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-run-systemd\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.346436 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.346332    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/93bb0a24-3334-4d1f-a905-6f50ccd815ce-ovn-node-metrics-cert\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.346436 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.346386    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c4cc155d-43c9-4590-964c-a6564c0ca4e2-hosts-file\") pod \"node-resolver-6cnk9\" (UID: \"c4cc155d-43c9-4590-964c-a6564c0ca4e2\") " pod="openshift-dns/node-resolver-6cnk9"
Sep 17 19:06:18.346436 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.346421    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4169f431-6727-4b3e-a060-a59d9924854e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sx5k8\" (UID: \"4169f431-6727-4b3e-a060-a59d9924854e\") " pod="openshift-multus/multus-additional-cni-plugins-sx5k8"
Sep 17 19:06:18.346650 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.346452    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-systemd-units\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.346650 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.346487    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.346650 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.346536    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4169f431-6727-4b3e-a060-a59d9924854e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sx5k8\" (UID: \"4169f431-6727-4b3e-a060-a59d9924854e\") " pod="openshift-multus/multus-additional-cni-plugins-sx5k8"
Sep 17 19:06:18.346813 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.346787    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4169f431-6727-4b3e-a060-a59d9924854e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sx5k8\" (UID: \"4169f431-6727-4b3e-a060-a59d9924854e\") " pod="openshift-multus/multus-additional-cni-plugins-sx5k8"
Sep 17 19:06:18.346955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.346894    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-run-openvswitch\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.347031 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.346985    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-node-log\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.347087 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.347011    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4169f431-6727-4b3e-a060-a59d9924854e-system-cni-dir\") pod \"multus-additional-cni-plugins-sx5k8\" (UID: \"4169f431-6727-4b3e-a060-a59d9924854e\") " pod="openshift-multus/multus-additional-cni-plugins-sx5k8"
Sep 17 19:06:18.347180 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.347157    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-host-run-netns\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.347250 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.347232    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-var-lib-openvswitch\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.347406 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.347386    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c4cc155d-43c9-4590-964c-a6564c0ca4e2-hosts-file\") pod \"node-resolver-6cnk9\" (UID: \"c4cc155d-43c9-4590-964c-a6564c0ca4e2\") " pod="openshift-dns/node-resolver-6cnk9"
Sep 17 19:06:18.347470 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.347461    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-run-systemd\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.347562 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.347516    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/93bb0a24-3334-4d1f-a905-6f50ccd815ce-env-overrides\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.347618 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.347505    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/71d0cb8b-edaf-4832-a653-81ddd6c84cca-konnectivity-ca\") pod \"konnectivity-agent-6f5gw\" (UID: \"71d0cb8b-edaf-4832-a653-81ddd6c84cca\") " pod="kube-system/konnectivity-agent-6f5gw"
Sep 17 19:06:18.347618 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.347546    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/273ee390-dd66-4cfa-b503-c9d1983d5e0a-dbus\") pod \"global-pull-secret-syncer-6sp4v\" (UID: \"273ee390-dd66-4cfa-b503-c9d1983d5e0a\") " pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:18.347618 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.347582    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.347768 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.347672    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-host-slash\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.347768 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.347756    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4169f431-6727-4b3e-a060-a59d9924854e-cnibin\") pod \"multus-additional-cni-plugins-sx5k8\" (UID: \"4169f431-6727-4b3e-a060-a59d9924854e\") " pod="openshift-multus/multus-additional-cni-plugins-sx5k8"
Sep 17 19:06:18.347858 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.347821    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/93bb0a24-3334-4d1f-a905-6f50ccd815ce-ovnkube-script-lib\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.349217 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.348273    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4169f431-6727-4b3e-a060-a59d9924854e-cni-binary-copy\") pod \"multus-additional-cni-plugins-sx5k8\" (UID: \"4169f431-6727-4b3e-a060-a59d9924854e\") " pod="openshift-multus/multus-additional-cni-plugins-sx5k8"
Sep 17 19:06:18.349217 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.348448    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-host-kubelet\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.349217 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:18.348591    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 19:06:18.349217 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:18.348663    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret podName:273ee390-dd66-4cfa-b503-c9d1983d5e0a nodeName:}" failed. No retries permitted until 2026-09-17 19:06:18.848645588 +0000 UTC m=+4.788002488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret") pod "global-pull-secret-syncer-6sp4v" (UID: "273ee390-dd66-4cfa-b503-c9d1983d5e0a") : object "kube-system"/"original-pull-secret" not registered
Sep 17 19:06:18.349217 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.348908    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.349610 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.349179    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4cc155d-43c9-4590-964c-a6564c0ca4e2-tmp-dir\") pod \"node-resolver-6cnk9\" (UID: \"c4cc155d-43c9-4590-964c-a6564c0ca4e2\") " pod="openshift-dns/node-resolver-6cnk9"
Sep 17 19:06:18.349610 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.349327    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-log-socket\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.349610 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.349285    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-etc-openvswitch\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.349610 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.349365    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-host-cni-netd\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.349610 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.349411    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/93bb0a24-3334-4d1f-a905-6f50ccd815ce-systemd-units\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.349610 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.349432    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/273ee390-dd66-4cfa-b503-c9d1983d5e0a-kubelet-config\") pod \"global-pull-secret-syncer-6sp4v\" (UID: \"273ee390-dd66-4cfa-b503-c9d1983d5e0a\") " pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:18.349959 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.349752    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4169f431-6727-4b3e-a060-a59d9924854e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sx5k8\" (UID: \"4169f431-6727-4b3e-a060-a59d9924854e\") " pod="openshift-multus/multus-additional-cni-plugins-sx5k8"
Sep 17 19:06:18.349959 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.349914    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4169f431-6727-4b3e-a060-a59d9924854e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sx5k8\" (UID: \"4169f431-6727-4b3e-a060-a59d9924854e\") " pod="openshift-multus/multus-additional-cni-plugins-sx5k8"
Sep 17 19:06:18.351776 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.351753    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/71d0cb8b-edaf-4832-a653-81ddd6c84cca-agent-certs\") pod \"konnectivity-agent-6f5gw\" (UID: \"71d0cb8b-edaf-4832-a653-81ddd6c84cca\") " pod="kube-system/konnectivity-agent-6f5gw"
Sep 17 19:06:18.352620 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.352581    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/93bb0a24-3334-4d1f-a905-6f50ccd815ce-ovn-node-metrics-cert\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.357088 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.357054    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcfxv\" (UniqueName: \"kubernetes.io/projected/93bb0a24-3334-4d1f-a905-6f50ccd815ce-kube-api-access-rcfxv\") pod \"ovnkube-node-vbxgv\" (UID: \"93bb0a24-3334-4d1f-a905-6f50ccd815ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.358083 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:18.358046    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 19:06:18.358183 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:18.358089    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 19:06:18.358183 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:18.358103    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7js7j for pod openshift-network-diagnostics/network-check-target-nw2xp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 19:06:18.358282 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:18.358199    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j podName:deeaf161-dbf1-4057-b88c-9881a12733d0 nodeName:}" failed. No retries permitted until 2026-09-17 19:06:18.858180393 +0000 UTC m=+4.797537294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7js7j" (UniqueName: "kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j") pod "network-check-target-nw2xp" (UID: "deeaf161-dbf1-4057-b88c-9881a12733d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 19:06:18.360945 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.360922    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vq7s\" (UniqueName: \"kubernetes.io/projected/c4cc155d-43c9-4590-964c-a6564c0ca4e2-kube-api-access-5vq7s\") pod \"node-resolver-6cnk9\" (UID: \"c4cc155d-43c9-4590-964c-a6564c0ca4e2\") " pod="openshift-dns/node-resolver-6cnk9"
Sep 17 19:06:18.362815 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.362786    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlq4k\" (UniqueName: \"kubernetes.io/projected/4169f431-6727-4b3e-a060-a59d9924854e-kube-api-access-zlq4k\") pod \"multus-additional-cni-plugins-sx5k8\" (UID: \"4169f431-6727-4b3e-a060-a59d9924854e\") " pod="openshift-multus/multus-additional-cni-plugins-sx5k8"
Sep 17 19:06:18.432162 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.432128    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4xv6q"
Sep 17 19:06:18.440161 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.440132    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk"
Sep 17 19:06:18.451168 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.451141    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xsvnv"
Sep 17 19:06:18.458813 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.458788    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h5vqv"
Sep 17 19:06:18.467689 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.467666    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5vtc4"
Sep 17 19:06:18.475990 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.475965    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6f5gw"
Sep 17 19:06:18.485837 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.485818    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:18.494683 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.494660    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6cnk9"
Sep 17 19:06:18.501269 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.501245    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sx5k8"
Sep 17 19:06:18.749392 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.749350    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs\") pod \"network-metrics-daemon-fxwkw\" (UID: \"b7c8049f-7c97-4d5f-8279-ea12aba931cc\") " pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:18.749585 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:18.749543    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 19:06:18.749650 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:18.749623    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs podName:b7c8049f-7c97-4d5f-8279-ea12aba931cc nodeName:}" failed. No retries permitted until 2026-09-17 19:06:19.749602108 +0000 UTC m=+5.688959011 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs") pod "network-metrics-daemon-fxwkw" (UID: "b7c8049f-7c97-4d5f-8279-ea12aba931cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 19:06:18.850441 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.850402    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret\") pod \"global-pull-secret-syncer-6sp4v\" (UID: \"273ee390-dd66-4cfa-b503-c9d1983d5e0a\") " pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:18.850636 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:18.850594    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 19:06:18.850701 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:18.850679    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret podName:273ee390-dd66-4cfa-b503-c9d1983d5e0a nodeName:}" failed. No retries permitted until 2026-09-17 19:06:19.850657465 +0000 UTC m=+5.790014371 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret") pod "global-pull-secret-syncer-6sp4v" (UID: "273ee390-dd66-4cfa-b503-c9d1983d5e0a") : object "kube-system"/"original-pull-secret" not registered
Sep 17 19:06:18.951010 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:18.950968    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7js7j\" (UniqueName: \"kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j\") pod \"network-check-target-nw2xp\" (UID: \"deeaf161-dbf1-4057-b88c-9881a12733d0\") " pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:18.951173 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:18.951131    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 19:06:18.951173 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:18.951150    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 19:06:18.951173 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:18.951162    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7js7j for pod openshift-network-diagnostics/network-check-target-nw2xp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 19:06:18.951344 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:18.951230    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j podName:deeaf161-dbf1-4057-b88c-9881a12733d0 nodeName:}" failed. No retries permitted until 2026-09-17 19:06:19.951210678 +0000 UTC m=+5.890567580 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7js7j" (UniqueName: "kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j") pod "network-check-target-nw2xp" (UID: "deeaf161-dbf1-4057-b88c-9881a12733d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 19:06:19.177912 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:19.177803    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 19:01:18 +0000 UTC" deadline="2028-04-21 09:21:38.799769732 +0000 UTC"
Sep 17 19:06:19.177912 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:19.177845    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13958h15m19.621930304s"
Sep 17 19:06:19.303703 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:19.303535    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4169f431_6727_4b3e_a060_a59d9924854e.slice/crio-be160169f974a6715a9ee5b0f14e261b3d36b817716ba7c8dbe75b17fa4f0148 WatchSource:0}: Error finding container be160169f974a6715a9ee5b0f14e261b3d36b817716ba7c8dbe75b17fa4f0148: Status 404 returned error can't find the container with id be160169f974a6715a9ee5b0f14e261b3d36b817716ba7c8dbe75b17fa4f0148
Sep 17 19:06:19.306645 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:19.306615    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e0e5f4d_981b_487c_a961_f7b0039e78cd.slice/crio-0deddbccf4088396e2040ff46af794bbc32a7518412225b451a1fe7b3d5a48db WatchSource:0}: Error finding container 0deddbccf4088396e2040ff46af794bbc32a7518412225b451a1fe7b3d5a48db: Status 404 returned error can't find the container with id 0deddbccf4088396e2040ff46af794bbc32a7518412225b451a1fe7b3d5a48db
Sep 17 19:06:19.326725 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:19.326701    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7aca5fb_181a_48f6_a75d_12d69ccb0167.slice/crio-0942f6259d49bdec11a72296afe78ae85171fe3f1eea477c441067252edd7685 WatchSource:0}: Error finding container 0942f6259d49bdec11a72296afe78ae85171fe3f1eea477c441067252edd7685: Status 404 returned error can't find the container with id 0942f6259d49bdec11a72296afe78ae85171fe3f1eea477c441067252edd7685
Sep 17 19:06:19.327647 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:19.327621    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93bb0a24_3334_4d1f_a905_6f50ccd815ce.slice/crio-e7a35b501032b7d2bfe0ef4876a96d52073820e998644bfa16a5ff6d41df6409 WatchSource:0}: Error finding container e7a35b501032b7d2bfe0ef4876a96d52073820e998644bfa16a5ff6d41df6409: Status 404 returned error can't find the container with id e7a35b501032b7d2bfe0ef4876a96d52073820e998644bfa16a5ff6d41df6409
Sep 17 19:06:19.328536 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:19.328488    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d12801a_7163_4260_8f73_d1370505195b.slice/crio-fd7976d6ba4d354526e88fab770c34bcab36c03371a2dc2d7570bda0502fb2b1 WatchSource:0}: Error finding container fd7976d6ba4d354526e88fab770c34bcab36c03371a2dc2d7570bda0502fb2b1: Status 404 returned error can't find the container with id fd7976d6ba4d354526e88fab770c34bcab36c03371a2dc2d7570bda0502fb2b1
Sep 17 19:06:19.329174 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:19.329156    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4cc155d_43c9_4590_964c_a6564c0ca4e2.slice/crio-88db74a11e3c378610c6c76b66192835894035442e82f571ed47a1a8a3b0512d WatchSource:0}: Error finding container 88db74a11e3c378610c6c76b66192835894035442e82f571ed47a1a8a3b0512d: Status 404 returned error can't find the container with id 88db74a11e3c378610c6c76b66192835894035442e82f571ed47a1a8a3b0512d
Sep 17 19:06:19.330685 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:19.330552    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc545dfa9_0c6e_4493_8f12_cd63c012cb53.slice/crio-c4f16b5e13a4f7be8cd18099db3b50d51cf541775bb0053507b0064a52e7a002 WatchSource:0}: Error finding container c4f16b5e13a4f7be8cd18099db3b50d51cf541775bb0053507b0064a52e7a002: Status 404 returned error can't find the container with id c4f16b5e13a4f7be8cd18099db3b50d51cf541775bb0053507b0064a52e7a002
Sep 17 19:06:19.758273 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:19.758042    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs\") pod \"network-metrics-daemon-fxwkw\" (UID: \"b7c8049f-7c97-4d5f-8279-ea12aba931cc\") " pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:19.758461 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:19.758213    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 19:06:19.758461 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:19.758368    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs podName:b7c8049f-7c97-4d5f-8279-ea12aba931cc nodeName:}" failed. No retries permitted until 2026-09-17 19:06:21.758347205 +0000 UTC m=+7.697704104 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs") pod "network-metrics-daemon-fxwkw" (UID: "b7c8049f-7c97-4d5f-8279-ea12aba931cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 19:06:19.859704 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:19.859585    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret\") pod \"global-pull-secret-syncer-6sp4v\" (UID: \"273ee390-dd66-4cfa-b503-c9d1983d5e0a\") " pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:19.859854 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:19.859798    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 19:06:19.859951 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:19.859867    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret podName:273ee390-dd66-4cfa-b503-c9d1983d5e0a nodeName:}" failed. No retries permitted until 2026-09-17 19:06:21.859844833 +0000 UTC m=+7.799201738 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret") pod "global-pull-secret-syncer-6sp4v" (UID: "273ee390-dd66-4cfa-b503-c9d1983d5e0a") : object "kube-system"/"original-pull-secret" not registered
Sep 17 19:06:19.960972 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:19.960280    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7js7j\" (UniqueName: \"kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j\") pod \"network-check-target-nw2xp\" (UID: \"deeaf161-dbf1-4057-b88c-9881a12733d0\") " pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:19.960972 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:19.960487    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 19:06:19.960972 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:19.960507    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 19:06:19.960972 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:19.960524    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7js7j for pod openshift-network-diagnostics/network-check-target-nw2xp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 19:06:19.960972 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:19.960594    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j podName:deeaf161-dbf1-4057-b88c-9881a12733d0 nodeName:}" failed. No retries permitted until 2026-09-17 19:06:21.96056824 +0000 UTC m=+7.899925147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7js7j" (UniqueName: "kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j") pod "network-check-target-nw2xp" (UID: "deeaf161-dbf1-4057-b88c-9881a12733d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 19:06:20.178349 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:20.178116    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 19:01:18 +0000 UTC" deadline="2028-06-23 18:41:38.11228939 +0000 UTC"
Sep 17 19:06:20.178349 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:20.178161    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15479h35m17.934135735s"
Sep 17 19:06:20.222981 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:20.222494    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:20.222981 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:20.222615    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw2xp" podUID="deeaf161-dbf1-4057-b88c-9881a12733d0"
Sep 17 19:06:20.222981 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:20.222937    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:20.223323 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:20.223029    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sp4v" podUID="273ee390-dd66-4cfa-b503-c9d1983d5e0a"
Sep 17 19:06:20.223323 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:20.223075    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:20.223323 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:20.223139    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxwkw" podUID="b7c8049f-7c97-4d5f-8279-ea12aba931cc"
Sep 17 19:06:20.255367 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:20.255196    2573 generic.go:356] "Generic (PLEG): container finished" podID="0ec83bea1a1b00938d6509815f8b6f1d" containerID="12bfc03a6abc148bb8168ce5f0d433956e9f17881d6b6d61b3519b33067c341e" exitCode=0
Sep 17 19:06:20.255367 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:20.255279    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal" event={"ID":"0ec83bea1a1b00938d6509815f8b6f1d","Type":"ContainerDied","Data":"12bfc03a6abc148bb8168ce5f0d433956e9f17881d6b6d61b3519b33067c341e"}
Sep 17 19:06:20.262058 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:20.260391    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-84.ec2.internal" event={"ID":"650f74a4f22bb301be07e776d42e3b65","Type":"ContainerStarted","Data":"4a67ce7900caad20ec71b48c9e8b15fbb72855e219b3adf8f5e5f17d37d69a94"}
Sep 17 19:06:20.272374 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:20.272124    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv" event={"ID":"93bb0a24-3334-4d1f-a905-6f50ccd815ce","Type":"ContainerStarted","Data":"e7a35b501032b7d2bfe0ef4876a96d52073820e998644bfa16a5ff6d41df6409"}
Sep 17 19:06:20.284228 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:20.284017    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xsvnv" event={"ID":"3d12801a-7163-4260-8f73-d1370505195b","Type":"ContainerStarted","Data":"fd7976d6ba4d354526e88fab770c34bcab36c03371a2dc2d7570bda0502fb2b1"}
Sep 17 19:06:20.296639 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:20.296608    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h5vqv" event={"ID":"c545dfa9-0c6e-4493-8f12-cd63c012cb53","Type":"ContainerStarted","Data":"c4f16b5e13a4f7be8cd18099db3b50d51cf541775bb0053507b0064a52e7a002"}
Sep 17 19:06:20.308898 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:20.308835    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6cnk9" event={"ID":"c4cc155d-43c9-4590-964c-a6564c0ca4e2","Type":"ContainerStarted","Data":"88db74a11e3c378610c6c76b66192835894035442e82f571ed47a1a8a3b0512d"}
Sep 17 19:06:20.312812 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:20.312457    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk" event={"ID":"e7aca5fb-181a-48f6-a75d-12d69ccb0167","Type":"ContainerStarted","Data":"0942f6259d49bdec11a72296afe78ae85171fe3f1eea477c441067252edd7685"}
Sep 17 19:06:20.316546 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:20.316487    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5vtc4" event={"ID":"0e0e5f4d-981b-487c-a961-f7b0039e78cd","Type":"ContainerStarted","Data":"0deddbccf4088396e2040ff46af794bbc32a7518412225b451a1fe7b3d5a48db"}
Sep 17 19:06:20.319807 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:20.319780    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sx5k8" event={"ID":"4169f431-6727-4b3e-a060-a59d9924854e","Type":"ContainerStarted","Data":"be160169f974a6715a9ee5b0f14e261b3d36b817716ba7c8dbe75b17fa4f0148"}
Sep 17 19:06:20.322721 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:20.322692    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6f5gw" event={"ID":"71d0cb8b-edaf-4832-a653-81ddd6c84cca","Type":"ContainerStarted","Data":"c7ca8377fd4e775535d6e82876238f1cf71ad197f246754b5201e126587b8b40"}
Sep 17 19:06:20.344611 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:20.344578    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4xv6q" event={"ID":"1783fc9d-0786-47b1-b64b-bb1cd5f3cdb9","Type":"ContainerStarted","Data":"75ec86e1c31c316f4061656c91628d681f0f8e982bcf2ed706497358f4c897b4"}
Sep 17 19:06:21.380437 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:21.380333    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal" event={"ID":"0ec83bea1a1b00938d6509815f8b6f1d","Type":"ContainerStarted","Data":"942e22ef4186167c35cd12b06691f9c69b92e5d3adee67d6426f2b03eb34ec7b"}
Sep 17 19:06:21.397386 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:21.397092    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-84.ec2.internal" podStartSLOduration=4.39707166 podStartE2EDuration="4.39707166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:06:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:06:20.296477493 +0000 UTC m=+6.235834416" watchObservedRunningTime="2026-09-17 19:06:21.39707166 +0000 UTC m=+7.336428583"
Sep 17 19:06:21.773761 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:21.773720    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs\") pod \"network-metrics-daemon-fxwkw\" (UID: \"b7c8049f-7c97-4d5f-8279-ea12aba931cc\") " pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:21.774006 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:21.773962    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 19:06:21.774186 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:21.774039    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs podName:b7c8049f-7c97-4d5f-8279-ea12aba931cc nodeName:}" failed. No retries permitted until 2026-09-17 19:06:25.77401921 +0000 UTC m=+11.713376111 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs") pod "network-metrics-daemon-fxwkw" (UID: "b7c8049f-7c97-4d5f-8279-ea12aba931cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 19:06:21.875067 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:21.875030    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret\") pod \"global-pull-secret-syncer-6sp4v\" (UID: \"273ee390-dd66-4cfa-b503-c9d1983d5e0a\") " pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:21.875298 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:21.875188    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 19:06:21.875298 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:21.875249    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret podName:273ee390-dd66-4cfa-b503-c9d1983d5e0a nodeName:}" failed. No retries permitted until 2026-09-17 19:06:25.875232699 +0000 UTC m=+11.814589603 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret") pod "global-pull-secret-syncer-6sp4v" (UID: "273ee390-dd66-4cfa-b503-c9d1983d5e0a") : object "kube-system"/"original-pull-secret" not registered
Sep 17 19:06:21.975492 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:21.975450    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7js7j\" (UniqueName: \"kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j\") pod \"network-check-target-nw2xp\" (UID: \"deeaf161-dbf1-4057-b88c-9881a12733d0\") " pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:21.975763 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:21.975617    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 19:06:21.975763 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:21.975640    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 19:06:21.975763 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:21.975652    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7js7j for pod openshift-network-diagnostics/network-check-target-nw2xp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 19:06:21.975763 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:21.975715    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j podName:deeaf161-dbf1-4057-b88c-9881a12733d0 nodeName:}" failed. No retries permitted until 2026-09-17 19:06:25.975694996 +0000 UTC m=+11.915051901 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7js7j" (UniqueName: "kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j") pod "network-check-target-nw2xp" (UID: "deeaf161-dbf1-4057-b88c-9881a12733d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 19:06:22.222552 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:22.222522    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:22.222727 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:22.222668    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxwkw" podUID="b7c8049f-7c97-4d5f-8279-ea12aba931cc"
Sep 17 19:06:22.223053 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:22.223016    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:22.223249 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:22.223122    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw2xp" podUID="deeaf161-dbf1-4057-b88c-9881a12733d0"
Sep 17 19:06:22.223249 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:22.223155    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:22.223249 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:22.223235    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sp4v" podUID="273ee390-dd66-4cfa-b503-c9d1983d5e0a"
Sep 17 19:06:24.221034 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:24.221000    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:24.221401 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:24.221164    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sp4v" podUID="273ee390-dd66-4cfa-b503-c9d1983d5e0a"
Sep 17 19:06:24.221606 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:24.221585    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:24.221705 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:24.221683    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw2xp" podUID="deeaf161-dbf1-4057-b88c-9881a12733d0"
Sep 17 19:06:24.221902 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:24.221855    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:24.222019 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:24.221996    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxwkw" podUID="b7c8049f-7c97-4d5f-8279-ea12aba931cc"
Sep 17 19:06:25.809936 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:25.809296    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs\") pod \"network-metrics-daemon-fxwkw\" (UID: \"b7c8049f-7c97-4d5f-8279-ea12aba931cc\") " pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:25.809936 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:25.809495    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 19:06:25.809936 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:25.809557    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs podName:b7c8049f-7c97-4d5f-8279-ea12aba931cc nodeName:}" failed. No retries permitted until 2026-09-17 19:06:33.809538138 +0000 UTC m=+19.748895041 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs") pod "network-metrics-daemon-fxwkw" (UID: "b7c8049f-7c97-4d5f-8279-ea12aba931cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 19:06:25.909820 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:25.909783    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret\") pod \"global-pull-secret-syncer-6sp4v\" (UID: \"273ee390-dd66-4cfa-b503-c9d1983d5e0a\") " pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:25.910475 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:25.910023    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 19:06:25.910475 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:25.910091    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret podName:273ee390-dd66-4cfa-b503-c9d1983d5e0a nodeName:}" failed. No retries permitted until 2026-09-17 19:06:33.910078121 +0000 UTC m=+19.849435024 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret") pod "global-pull-secret-syncer-6sp4v" (UID: "273ee390-dd66-4cfa-b503-c9d1983d5e0a") : object "kube-system"/"original-pull-secret" not registered
Sep 17 19:06:26.010453 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:26.010409    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7js7j\" (UniqueName: \"kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j\") pod \"network-check-target-nw2xp\" (UID: \"deeaf161-dbf1-4057-b88c-9881a12733d0\") " pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:26.010643 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:26.010617    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 19:06:26.010704 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:26.010646    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 19:06:26.010704 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:26.010658    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7js7j for pod openshift-network-diagnostics/network-check-target-nw2xp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 19:06:26.010782 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:26.010720    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j podName:deeaf161-dbf1-4057-b88c-9881a12733d0 nodeName:}" failed. No retries permitted until 2026-09-17 19:06:34.01070145 +0000 UTC m=+19.950058367 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7js7j" (UniqueName: "kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j") pod "network-check-target-nw2xp" (UID: "deeaf161-dbf1-4057-b88c-9881a12733d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 19:06:26.220341 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:26.220313    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:26.220538 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:26.220413    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw2xp" podUID="deeaf161-dbf1-4057-b88c-9881a12733d0"
Sep 17 19:06:26.220538 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:26.220464    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:26.220651 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:26.220541    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxwkw" podUID="b7c8049f-7c97-4d5f-8279-ea12aba931cc"
Sep 17 19:06:26.220651 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:26.220577    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:26.220651 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:26.220636    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sp4v" podUID="273ee390-dd66-4cfa-b503-c9d1983d5e0a"
Sep 17 19:06:28.224480 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:28.223991    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:28.224480 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:28.224018    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:28.224480 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:28.224095    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sp4v" podUID="273ee390-dd66-4cfa-b503-c9d1983d5e0a"
Sep 17 19:06:28.224480 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:28.224124    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:28.224480 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:28.224251    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxwkw" podUID="b7c8049f-7c97-4d5f-8279-ea12aba931cc"
Sep 17 19:06:28.224480 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:28.224301    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw2xp" podUID="deeaf161-dbf1-4057-b88c-9881a12733d0"
Sep 17 19:06:30.219892 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:30.219837    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:30.220268 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:30.219985    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw2xp" podUID="deeaf161-dbf1-4057-b88c-9881a12733d0"
Sep 17 19:06:30.220307 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:30.220294    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:30.220378 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:30.220360    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxwkw" podUID="b7c8049f-7c97-4d5f-8279-ea12aba931cc"
Sep 17 19:06:30.220529 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:30.220506    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:30.220661 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:30.220595    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sp4v" podUID="273ee390-dd66-4cfa-b503-c9d1983d5e0a"
Sep 17 19:06:32.220615 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:32.220581    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:32.221108 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:32.220647    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:32.221108 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:32.220649    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:32.221108 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:32.220744    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sp4v" podUID="273ee390-dd66-4cfa-b503-c9d1983d5e0a"
Sep 17 19:06:32.221108 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:32.220851    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw2xp" podUID="deeaf161-dbf1-4057-b88c-9881a12733d0"
Sep 17 19:06:32.221108 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:32.220975    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxwkw" podUID="b7c8049f-7c97-4d5f-8279-ea12aba931cc"
Sep 17 19:06:33.869780 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:33.869743    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs\") pod \"network-metrics-daemon-fxwkw\" (UID: \"b7c8049f-7c97-4d5f-8279-ea12aba931cc\") " pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:33.870257 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:33.869929    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 19:06:33.870257 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:33.869996    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs podName:b7c8049f-7c97-4d5f-8279-ea12aba931cc nodeName:}" failed. No retries permitted until 2026-09-17 19:06:49.869980891 +0000 UTC m=+35.809337793 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs") pod "network-metrics-daemon-fxwkw" (UID: "b7c8049f-7c97-4d5f-8279-ea12aba931cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 19:06:33.970600 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:33.970562    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret\") pod \"global-pull-secret-syncer-6sp4v\" (UID: \"273ee390-dd66-4cfa-b503-c9d1983d5e0a\") " pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:33.970770 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:33.970672    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 19:06:33.970770 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:33.970734    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret podName:273ee390-dd66-4cfa-b503-c9d1983d5e0a nodeName:}" failed. No retries permitted until 2026-09-17 19:06:49.970715645 +0000 UTC m=+35.910072565 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret") pod "global-pull-secret-syncer-6sp4v" (UID: "273ee390-dd66-4cfa-b503-c9d1983d5e0a") : object "kube-system"/"original-pull-secret" not registered
Sep 17 19:06:34.071615 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:34.071582    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7js7j\" (UniqueName: \"kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j\") pod \"network-check-target-nw2xp\" (UID: \"deeaf161-dbf1-4057-b88c-9881a12733d0\") " pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:34.071789 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:34.071769    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 19:06:34.071832 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:34.071790    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 19:06:34.071832 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:34.071800    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7js7j for pod openshift-network-diagnostics/network-check-target-nw2xp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 19:06:34.071961 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:34.071854    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j podName:deeaf161-dbf1-4057-b88c-9881a12733d0 nodeName:}" failed. No retries permitted until 2026-09-17 19:06:50.071839914 +0000 UTC m=+36.011196813 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7js7j" (UniqueName: "kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j") pod "network-check-target-nw2xp" (UID: "deeaf161-dbf1-4057-b88c-9881a12733d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 19:06:34.220155 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:34.220116    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:34.220309 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:34.220235    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw2xp" podUID="deeaf161-dbf1-4057-b88c-9881a12733d0"
Sep 17 19:06:34.220309 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:34.220124    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:34.220406 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:34.220330    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxwkw" podUID="b7c8049f-7c97-4d5f-8279-ea12aba931cc"
Sep 17 19:06:34.220406 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:34.220115    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:34.220406 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:34.220388    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sp4v" podUID="273ee390-dd66-4cfa-b503-c9d1983d5e0a"
Sep 17 19:06:36.220613 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:36.220582    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:36.221020 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:36.220706    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxwkw" podUID="b7c8049f-7c97-4d5f-8279-ea12aba931cc"
Sep 17 19:06:36.221020 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:36.220781    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:36.221020 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:36.220872    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sp4v" podUID="273ee390-dd66-4cfa-b503-c9d1983d5e0a"
Sep 17 19:06:36.221020 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:36.220965    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:36.221231 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:36.221159    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw2xp" podUID="deeaf161-dbf1-4057-b88c-9881a12733d0"
Sep 17 19:06:37.417094 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:37.416941    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h5vqv" event={"ID":"c545dfa9-0c6e-4493-8f12-cd63c012cb53","Type":"ContainerStarted","Data":"79730befd25a2c36a88bbda833ffbf85abc50b5119ae2a732b05b5152d816222"}
Sep 17 19:06:37.418426 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:37.418403    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6cnk9" event={"ID":"c4cc155d-43c9-4590-964c-a6564c0ca4e2","Type":"ContainerStarted","Data":"4a57451ad72f4068783460e1b411593c9e30169803f0f774e683dedc402c8045"}
Sep 17 19:06:37.420008 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:37.419968    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk" event={"ID":"e7aca5fb-181a-48f6-a75d-12d69ccb0167","Type":"ContainerStarted","Data":"3f35143a1fa80688948a89298d964dfc623c73243871473e6e09566b49cac9c3"}
Sep 17 19:06:37.421722 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:37.421689    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5vtc4" event={"ID":"0e0e5f4d-981b-487c-a961-f7b0039e78cd","Type":"ContainerStarted","Data":"3cd880b09c6f9e3366228e7e79df4aa7562320f4def02bb9140cc5090354fdfa"}
Sep 17 19:06:37.423359 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:37.423316    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sx5k8" event={"ID":"4169f431-6727-4b3e-a060-a59d9924854e","Type":"ContainerStarted","Data":"477b7da9a07c8bf4703db05ebb9ab6cfff541273d299aeec14ba4230322afe6b"}
Sep 17 19:06:37.424692 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:37.424668    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6f5gw" event={"ID":"71d0cb8b-edaf-4832-a653-81ddd6c84cca","Type":"ContainerStarted","Data":"71878632c35be9283de67ede10284fc22b9f7cbfed556984b9a8d4ce744eac07"}
Sep 17 19:06:37.427704 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:37.427685    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xsvnv" event={"ID":"3d12801a-7163-4260-8f73-d1370505195b","Type":"ContainerStarted","Data":"c6c5d388821bd64c88d7838546ca75586c86c3bcef55b1396dbc3485d87479a0"}
Sep 17 19:06:37.435204 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:37.435165    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h5vqv" podStartSLOduration=3.97468111 podStartE2EDuration="21.435153962s" totalImagesPullingTime="17.460472852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:06:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:06:37.43496124 +0000 UTC m=+23.374318161" watchObservedRunningTime="2026-09-17 19:06:37.435153962 +0000 UTC m=+23.374510884"
Sep 17 19:06:37.435404 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:37.435387    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal" podStartSLOduration=20.435382039 podStartE2EDuration="20.435382039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:06:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:06:21.397369628 +0000 UTC m=+7.336726549" watchObservedRunningTime="2026-09-17 19:06:37.435382039 +0000 UTC m=+23.374738960"
Sep 17 19:06:37.481297 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:37.481252    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6f5gw" podStartSLOduration=11.172715362 podStartE2EDuration="21.481237251s" totalImagesPullingTime="10.308521889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:06:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:06:37.48116489 +0000 UTC m=+23.420521811" watchObservedRunningTime="2026-09-17 19:06:37.481237251 +0000 UTC m=+23.420594173"
Sep 17 19:06:37.506512 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:37.506471    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xsvnv" podStartSLOduration=3.666533277 podStartE2EDuration="21.506457995s" totalImagesPullingTime="17.839924718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:06:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:06:37.505822269 +0000 UTC m=+23.445179200" watchObservedRunningTime="2026-09-17 19:06:37.506457995 +0000 UTC m=+23.445814916"
Sep 17 19:06:38.222592 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:38.222567    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:38.222742 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:38.222666    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:38.222742 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:38.222691    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:38.222742 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:38.222682    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sp4v" podUID="273ee390-dd66-4cfa-b503-c9d1983d5e0a"
Sep 17 19:06:38.222835 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:38.222772    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw2xp" podUID="deeaf161-dbf1-4057-b88c-9881a12733d0"
Sep 17 19:06:38.222868 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:38.222852    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxwkw" podUID="b7c8049f-7c97-4d5f-8279-ea12aba931cc"
Sep 17 19:06:38.431812 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:38.431777    2573 generic.go:356] "Generic (PLEG): container finished" podID="4169f431-6727-4b3e-a060-a59d9924854e" containerID="477b7da9a07c8bf4703db05ebb9ab6cfff541273d299aeec14ba4230322afe6b" exitCode=0
Sep 17 19:06:38.432631 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:38.431868    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sx5k8" event={"ID":"4169f431-6727-4b3e-a060-a59d9924854e","Type":"ContainerDied","Data":"477b7da9a07c8bf4703db05ebb9ab6cfff541273d299aeec14ba4230322afe6b"}
Sep 17 19:06:38.435139 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:38.435106    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbxgv_93bb0a24-3334-4d1f-a905-6f50ccd815ce/ovn-acl-logging/0.log"
Sep 17 19:06:38.435518 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:38.435494    2573 generic.go:356] "Generic (PLEG): container finished" podID="93bb0a24-3334-4d1f-a905-6f50ccd815ce" containerID="6f9d18313671a73b373f07c0f05ef9b02c577d03769d9e5eef656dd878021620" exitCode=1
Sep 17 19:06:38.435647 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:38.435619    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv" event={"ID":"93bb0a24-3334-4d1f-a905-6f50ccd815ce","Type":"ContainerStarted","Data":"6e161ed600aea4725f737c781e4e343da98cc0e98863f8e00c1301c6336da085"}
Sep 17 19:06:38.435757 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:38.435703    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv" event={"ID":"93bb0a24-3334-4d1f-a905-6f50ccd815ce","Type":"ContainerStarted","Data":"82c4d7e0a648236c47b9507cbc9bdffefee85d06bf4a15309f842f0af04f6390"}
Sep 17 19:06:38.435757 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:38.435745    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv" event={"ID":"93bb0a24-3334-4d1f-a905-6f50ccd815ce","Type":"ContainerStarted","Data":"38fcedbf0641292a561d1519e64269579154c1472e34325652e63c724cc9d8b4"}
Sep 17 19:06:38.435873 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:38.435775    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv" event={"ID":"93bb0a24-3334-4d1f-a905-6f50ccd815ce","Type":"ContainerStarted","Data":"3b4372847fd9b68c09503fce405639a3f15e95118b7d42440aac508eaca74e08"}
Sep 17 19:06:38.435873 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:38.435820    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv" event={"ID":"93bb0a24-3334-4d1f-a905-6f50ccd815ce","Type":"ContainerStarted","Data":"9c0f84a1b1403d7a3af295834531a29000e1dd8fbea18a45ac702cc0f14b5c89"}
Sep 17 19:06:38.435873 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:38.435856    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv" event={"ID":"93bb0a24-3334-4d1f-a905-6f50ccd815ce","Type":"ContainerDied","Data":"6f9d18313671a73b373f07c0f05ef9b02c577d03769d9e5eef656dd878021620"}
Sep 17 19:06:38.457024 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:38.456986    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6cnk9" podStartSLOduration=4.641101749 podStartE2EDuration="22.456971338s" totalImagesPullingTime="17.815869589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:06:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:06:37.527053149 +0000 UTC m=+23.466410071" watchObservedRunningTime="2026-09-17 19:06:38.456971338 +0000 UTC m=+24.396328259"
Sep 17 19:06:38.475008 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:38.474912    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5vtc4" podStartSLOduration=4.586162384 podStartE2EDuration="22.474898125s" totalImagesPullingTime="17.888735741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:06:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:06:38.474607492 +0000 UTC m=+24.413964413" watchObservedRunningTime="2026-09-17 19:06:38.474898125 +0000 UTC m=+24.414255045"
Sep 17 19:06:38.697866 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:38.697846    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 19:06:39.207360 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:39.207241    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T19:06:38.697860797Z","UUID":"b2c85b15-99f2-48cd-9a49-0eb7bdc2824e","Handler":null,"Name":"","Endpoint":""}
Sep 17 19:06:39.208770 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:39.208744    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 19:06:39.208917 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:39.208780    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 19:06:39.441032 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:39.440994    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk" event={"ID":"e7aca5fb-181a-48f6-a75d-12d69ccb0167","Type":"ContainerStarted","Data":"eee837b60a960ad09bdfed4bc7f05d55a16593b119a544cf97d5fb7b15fb9090"}
Sep 17 19:06:39.442835 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:39.442801    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4xv6q" event={"ID":"1783fc9d-0786-47b1-b64b-bb1cd5f3cdb9","Type":"ContainerStarted","Data":"ba2fe522de86aaec0202402eb77c2faea5922c468794fc5380159b38679857f1"}
Sep 17 19:06:39.468918 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:39.468798    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4xv6q" podStartSLOduration=5.600312966 podStartE2EDuration="23.468777035s" totalImagesPullingTime="17.868464069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:06:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:06:39.468361049 +0000 UTC m=+25.407717971" watchObservedRunningTime="2026-09-17 19:06:39.468777035 +0000 UTC m=+25.408133961"
Sep 17 19:06:40.220328 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:40.220291    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:40.220328 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:40.220326    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:40.220568 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:40.220298    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:40.220568 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:40.220440    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sp4v" podUID="273ee390-dd66-4cfa-b503-c9d1983d5e0a"
Sep 17 19:06:40.220568 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:40.220479    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxwkw" podUID="b7c8049f-7c97-4d5f-8279-ea12aba931cc"
Sep 17 19:06:40.220694 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:40.220569    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw2xp" podUID="deeaf161-dbf1-4057-b88c-9881a12733d0"
Sep 17 19:06:40.449162 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:40.449136    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbxgv_93bb0a24-3334-4d1f-a905-6f50ccd815ce/ovn-acl-logging/0.log"
Sep 17 19:06:40.449595 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:40.449529    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv" event={"ID":"93bb0a24-3334-4d1f-a905-6f50ccd815ce","Type":"ContainerStarted","Data":"93fb392fe3b08d12102b2c2f1d68680eaba6557c674892f46ca2b917cd9e1266"}
Sep 17 19:06:40.451931 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:40.451904    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk" event={"ID":"e7aca5fb-181a-48f6-a75d-12d69ccb0167","Type":"ContainerStarted","Data":"dc3a6767dffc049168d828030ed789cd42e95d9ff12e99cb2e934be116b53c71"}
Sep 17 19:06:42.219758 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:42.219720    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:42.220235 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:42.219835    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw2xp" podUID="deeaf161-dbf1-4057-b88c-9881a12733d0"
Sep 17 19:06:42.220235 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:42.219972    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:42.220235 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:42.220070    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxwkw" podUID="b7c8049f-7c97-4d5f-8279-ea12aba931cc"
Sep 17 19:06:42.220235 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:42.220122    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:42.220235 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:42.220194    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sp4v" podUID="273ee390-dd66-4cfa-b503-c9d1983d5e0a"
Sep 17 19:06:42.387164 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:42.387122    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6f5gw"
Sep 17 19:06:42.387786 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:42.387762    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6f5gw"
Sep 17 19:06:42.403843 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:42.403780    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmtjk" podStartSLOduration=6.74829724 podStartE2EDuration="26.403757676s" totalImagesPullingTime="19.655460436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:06:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:06:40.474942627 +0000 UTC m=+26.414299559" watchObservedRunningTime="2026-09-17 19:06:42.403757676 +0000 UTC m=+28.343114596"
Sep 17 19:06:43.461308 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:43.461045    2573 generic.go:356] "Generic (PLEG): container finished" podID="4169f431-6727-4b3e-a060-a59d9924854e" containerID="0abe5c103bca9440c07c5af53646ec5b444fec1a2015614435a8054389d38c8c" exitCode=0
Sep 17 19:06:43.462206 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:43.461087    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sx5k8" event={"ID":"4169f431-6727-4b3e-a060-a59d9924854e","Type":"ContainerDied","Data":"0abe5c103bca9440c07c5af53646ec5b444fec1a2015614435a8054389d38c8c"}
Sep 17 19:06:43.465114 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:43.465095    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbxgv_93bb0a24-3334-4d1f-a905-6f50ccd815ce/ovn-acl-logging/0.log"
Sep 17 19:06:43.465467 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:43.465444    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv" event={"ID":"93bb0a24-3334-4d1f-a905-6f50ccd815ce","Type":"ContainerStarted","Data":"4abf7df672eb574356c5d26682d4034c7243f97aede6309554f49987cf27201b"}
Sep 17 19:06:43.465740 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:43.465723    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:43.465946 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:43.465931    2573 scope.go:117] "RemoveContainer" containerID="6f9d18313671a73b373f07c0f05ef9b02c577d03769d9e5eef656dd878021620"
Sep 17 19:06:43.481451 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:43.481431    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:44.220213 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:44.219701    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:44.220213 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:44.219826    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw2xp" podUID="deeaf161-dbf1-4057-b88c-9881a12733d0"
Sep 17 19:06:44.220213 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:44.220021    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:44.220213 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:44.220141    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxwkw" podUID="b7c8049f-7c97-4d5f-8279-ea12aba931cc"
Sep 17 19:06:44.220213 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:44.220222    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:44.220623 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:44.220299    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sp4v" podUID="273ee390-dd66-4cfa-b503-c9d1983d5e0a"
Sep 17 19:06:44.472679 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:44.472441    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbxgv_93bb0a24-3334-4d1f-a905-6f50ccd815ce/ovn-acl-logging/0.log"
Sep 17 19:06:44.473165 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:44.472973    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv" event={"ID":"93bb0a24-3334-4d1f-a905-6f50ccd815ce","Type":"ContainerStarted","Data":"26b5d88a6d014791f550ed73368d791367381186214236962b8951ffd0899077"}
Sep 17 19:06:44.473259 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:44.473238    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:44.473384 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:44.473294    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:44.489867 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:44.489839    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:06:44.510045 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:44.509991    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv" podStartSLOduration=10.652692634 podStartE2EDuration="28.509969243s" totalImagesPullingTime="17.857276609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:06:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:06:44.508531388 +0000 UTC m=+30.447888345" watchObservedRunningTime="2026-09-17 19:06:44.509969243 +0000 UTC m=+30.449326162"
Sep 17 19:06:44.760449 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:44.760420    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fxwkw"]
Sep 17 19:06:44.760693 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:44.760532    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:44.760693 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:44.760631    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxwkw" podUID="b7c8049f-7c97-4d5f-8279-ea12aba931cc"
Sep 17 19:06:44.763421 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:44.763395    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6sp4v"]
Sep 17 19:06:44.763514 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:44.763492    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:44.763614 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:44.763591    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sp4v" podUID="273ee390-dd66-4cfa-b503-c9d1983d5e0a"
Sep 17 19:06:44.764161 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:44.764143    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nw2xp"]
Sep 17 19:06:44.764225 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:44.764216    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:44.764331 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:44.764283    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw2xp" podUID="deeaf161-dbf1-4057-b88c-9881a12733d0"
Sep 17 19:06:45.477460 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:45.477429    2573 generic.go:356] "Generic (PLEG): container finished" podID="4169f431-6727-4b3e-a060-a59d9924854e" containerID="be1bf4786f858ae757e8d9c9bacd7dcd263b5fc57ab55ae3c0b65f8cfe9bb8a8" exitCode=0
Sep 17 19:06:45.477823 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:45.477511    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sx5k8" event={"ID":"4169f431-6727-4b3e-a060-a59d9924854e","Type":"ContainerDied","Data":"be1bf4786f858ae757e8d9c9bacd7dcd263b5fc57ab55ae3c0b65f8cfe9bb8a8"}
Sep 17 19:06:46.221033 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:46.221002    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:46.221206 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:46.221098    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sp4v" podUID="273ee390-dd66-4cfa-b503-c9d1983d5e0a"
Sep 17 19:06:46.221206 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:46.221145    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:46.221306 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:46.221262    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxwkw" podUID="b7c8049f-7c97-4d5f-8279-ea12aba931cc"
Sep 17 19:06:46.221306 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:46.221292    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:46.221451 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:46.221349    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw2xp" podUID="deeaf161-dbf1-4057-b88c-9881a12733d0"
Sep 17 19:06:47.484535 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:47.484503    2573 generic.go:356] "Generic (PLEG): container finished" podID="4169f431-6727-4b3e-a060-a59d9924854e" containerID="7befd11b29b4780e8c42ae959aba08af2acc0045d29da770d5a13711e28e0d78" exitCode=0
Sep 17 19:06:47.485024 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:47.484553    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sx5k8" event={"ID":"4169f431-6727-4b3e-a060-a59d9924854e","Type":"ContainerDied","Data":"7befd11b29b4780e8c42ae959aba08af2acc0045d29da770d5a13711e28e0d78"}
Sep 17 19:06:47.994756 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:47.994719    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6f5gw"
Sep 17 19:06:47.995015 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:47.994856    2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 17 19:06:47.995372 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:47.995352    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6f5gw"
Sep 17 19:06:48.220020 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:48.219843    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:48.220020 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:48.219843    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:48.220020 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:48.219894    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:48.220020 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:48.219978    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw2xp" podUID="deeaf161-dbf1-4057-b88c-9881a12733d0"
Sep 17 19:06:48.220301 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:48.220096    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxwkw" podUID="b7c8049f-7c97-4d5f-8279-ea12aba931cc"
Sep 17 19:06:48.220301 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:48.220182    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6sp4v" podUID="273ee390-dd66-4cfa-b503-c9d1983d5e0a"
Sep 17 19:06:49.885760 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:49.885536    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs\") pod \"network-metrics-daemon-fxwkw\" (UID: \"b7c8049f-7c97-4d5f-8279-ea12aba931cc\") " pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:49.886105 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:49.885674    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 19:06:49.886105 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:49.885854    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs podName:b7c8049f-7c97-4d5f-8279-ea12aba931cc nodeName:}" failed. No retries permitted until 2026-09-17 19:07:21.885838353 +0000 UTC m=+67.825195276 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs") pod "network-metrics-daemon-fxwkw" (UID: "b7c8049f-7c97-4d5f-8279-ea12aba931cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 19:06:49.913704 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:49.913677    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeReady"
Sep 17 19:06:49.913847 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:49.913825    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 19:06:49.958976 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:49.958942    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7dc6c7b94f-shpbb"]
Sep 17 19:06:49.984250 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:49.984220    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x6b8k"]
Sep 17 19:06:49.984384 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:49.984331    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:49.986152 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:49.986123    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret\") pod \"global-pull-secret-syncer-6sp4v\" (UID: \"273ee390-dd66-4cfa-b503-c9d1983d5e0a\") " pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:49.986310 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:49.986291    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 19:06:49.986426 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:49.986356    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret podName:273ee390-dd66-4cfa-b503-c9d1983d5e0a nodeName:}" failed. No retries permitted until 2026-09-17 19:07:21.986337976 +0000 UTC m=+67.925694875 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret") pod "global-pull-secret-syncer-6sp4v" (UID: "273ee390-dd66-4cfa-b503-c9d1983d5e0a") : object "kube-system"/"original-pull-secret" not registered
Sep 17 19:06:49.986870 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:49.986849    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4tjxz\""
Sep 17 19:06:49.987043 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:49.986849    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 17 19:06:49.987123 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:49.987107    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 17 19:06:49.990933 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:49.990908    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 17 19:06:49.994276 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:49.993319    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 17 19:06:50.000392 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.000369    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dc6c7b94f-shpbb"]
Sep 17 19:06:50.000512 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.000406    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x6b8k"
Sep 17 19:06:50.000512 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.000428    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7jdjw"]
Sep 17 19:06:50.004967 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.004948    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 19:06:50.005078 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.005015    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 19:06:50.005137 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.005121    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rj77f\""
Sep 17 19:06:50.017862 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.017840    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x6b8k"]
Sep 17 19:06:50.017971 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.017909    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7jdjw"]
Sep 17 19:06:50.017971 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.017929    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7jdjw"
Sep 17 19:06:50.021395 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.021375    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 19:06:50.021485 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.021450    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 19:06:50.021485 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.021463    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cmft5\""
Sep 17 19:06:50.021627 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.021597    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 19:06:50.087366 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.087281    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-image-registry-private-configuration\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.087366 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.087321    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2c48\" (UniqueName: \"kubernetes.io/projected/0a637dc8-de44-4812-b512-b17407738093-kube-api-access-m2c48\") pod \"dns-default-x6b8k\" (UID: \"0a637dc8-de44-4812-b512-b17407738093\") " pod="openshift-dns/dns-default-x6b8k"
Sep 17 19:06:50.087366 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.087337    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-ca-trust-extracted\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.087366 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.087353    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-bound-sa-token\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.087366 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.087370    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md5zr\" (UniqueName: \"kubernetes.io/projected/3fb9b16c-03f2-4f40-abc6-c4ce643dbf1c-kube-api-access-md5zr\") pod \"ingress-canary-7jdjw\" (UID: \"3fb9b16c-03f2-4f40-abc6-c4ce643dbf1c\") " pod="openshift-ingress-canary/ingress-canary-7jdjw"
Sep 17 19:06:50.087652 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.087402    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-trusted-ca\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.087652 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.087427    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a637dc8-de44-4812-b512-b17407738093-tmp-dir\") pod \"dns-default-x6b8k\" (UID: \"0a637dc8-de44-4812-b512-b17407738093\") " pod="openshift-dns/dns-default-x6b8k"
Sep 17 19:06:50.087652 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.087441    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf6qs\" (UniqueName: \"kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-kube-api-access-wf6qs\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.087652 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.087531    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3fb9b16c-03f2-4f40-abc6-c4ce643dbf1c-cert\") pod \"ingress-canary-7jdjw\" (UID: \"3fb9b16c-03f2-4f40-abc6-c4ce643dbf1c\") " pod="openshift-ingress-canary/ingress-canary-7jdjw"
Sep 17 19:06:50.087652 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.087565    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.087652 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.087595    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a637dc8-de44-4812-b512-b17407738093-config-volume\") pod \"dns-default-x6b8k\" (UID: \"0a637dc8-de44-4812-b512-b17407738093\") " pod="openshift-dns/dns-default-x6b8k"
Sep 17 19:06:50.087652 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.087612    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a637dc8-de44-4812-b512-b17407738093-metrics-tls\") pod \"dns-default-x6b8k\" (UID: \"0a637dc8-de44-4812-b512-b17407738093\") " pod="openshift-dns/dns-default-x6b8k"
Sep 17 19:06:50.087652 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.087627    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-installation-pull-secrets\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.087652 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.087648    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7js7j\" (UniqueName: \"kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j\") pod \"network-check-target-nw2xp\" (UID: \"deeaf161-dbf1-4057-b88c-9881a12733d0\") " pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:50.088014 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.087671    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-certificates\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.088014 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:50.087764    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 19:06:50.088014 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:50.087785    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 19:06:50.088014 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:50.087795    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7js7j for pod openshift-network-diagnostics/network-check-target-nw2xp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 19:06:50.088014 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:50.087841    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j podName:deeaf161-dbf1-4057-b88c-9881a12733d0 nodeName:}" failed. No retries permitted until 2026-09-17 19:07:22.087827166 +0000 UTC m=+68.027184064 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7js7j" (UniqueName: "kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j") pod "network-check-target-nw2xp" (UID: "deeaf161-dbf1-4057-b88c-9881a12733d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 19:06:50.188580 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.188545    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-image-registry-private-configuration\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.188580 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.188586    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2c48\" (UniqueName: \"kubernetes.io/projected/0a637dc8-de44-4812-b512-b17407738093-kube-api-access-m2c48\") pod \"dns-default-x6b8k\" (UID: \"0a637dc8-de44-4812-b512-b17407738093\") " pod="openshift-dns/dns-default-x6b8k"
Sep 17 19:06:50.188809 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.188612    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-ca-trust-extracted\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.188809 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.188645    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-bound-sa-token\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.188809 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.188673    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md5zr\" (UniqueName: \"kubernetes.io/projected/3fb9b16c-03f2-4f40-abc6-c4ce643dbf1c-kube-api-access-md5zr\") pod \"ingress-canary-7jdjw\" (UID: \"3fb9b16c-03f2-4f40-abc6-c4ce643dbf1c\") " pod="openshift-ingress-canary/ingress-canary-7jdjw"
Sep 17 19:06:50.188809 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.188704    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-trusted-ca\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.188809 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.188730    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a637dc8-de44-4812-b512-b17407738093-tmp-dir\") pod \"dns-default-x6b8k\" (UID: \"0a637dc8-de44-4812-b512-b17407738093\") " pod="openshift-dns/dns-default-x6b8k"
Sep 17 19:06:50.188809 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.188753    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf6qs\" (UniqueName: \"kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-kube-api-access-wf6qs\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.189138 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.188813    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3fb9b16c-03f2-4f40-abc6-c4ce643dbf1c-cert\") pod \"ingress-canary-7jdjw\" (UID: \"3fb9b16c-03f2-4f40-abc6-c4ce643dbf1c\") " pod="openshift-ingress-canary/ingress-canary-7jdjw"
Sep 17 19:06:50.189138 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.188853    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.189138 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:50.188970    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 19:06:50.189138 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:50.188985    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dc6c7b94f-shpbb: secret "image-registry-tls" not found
Sep 17 19:06:50.189138 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.188984    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a637dc8-de44-4812-b512-b17407738093-config-volume\") pod \"dns-default-x6b8k\" (UID: \"0a637dc8-de44-4812-b512-b17407738093\") " pod="openshift-dns/dns-default-x6b8k"
Sep 17 19:06:50.189138 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.189011    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a637dc8-de44-4812-b512-b17407738093-metrics-tls\") pod \"dns-default-x6b8k\" (UID: \"0a637dc8-de44-4812-b512-b17407738093\") " pod="openshift-dns/dns-default-x6b8k"
Sep 17 19:06:50.189138 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:50.189039    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls podName:d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0 nodeName:}" failed. No retries permitted until 2026-09-17 19:06:50.689019524 +0000 UTC m=+36.628376423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls") pod "image-registry-7dc6c7b94f-shpbb" (UID: "d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0") : secret "image-registry-tls" not found
Sep 17 19:06:50.189138 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.189057    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-installation-pull-secrets\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.189138 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.189059    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-ca-trust-extracted\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.189138 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.189103    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-certificates\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.189612 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.189264    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a637dc8-de44-4812-b512-b17407738093-tmp-dir\") pod \"dns-default-x6b8k\" (UID: \"0a637dc8-de44-4812-b512-b17407738093\") " pod="openshift-dns/dns-default-x6b8k"
Sep 17 19:06:50.189612 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.189550    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a637dc8-de44-4812-b512-b17407738093-config-volume\") pod \"dns-default-x6b8k\" (UID: \"0a637dc8-de44-4812-b512-b17407738093\") " pod="openshift-dns/dns-default-x6b8k"
Sep 17 19:06:50.189612 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:50.189065    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 19:06:50.189761 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.189623    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-certificates\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.189761 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:50.189663    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a637dc8-de44-4812-b512-b17407738093-metrics-tls podName:0a637dc8-de44-4812-b512-b17407738093 nodeName:}" failed. No retries permitted until 2026-09-17 19:06:50.689642819 +0000 UTC m=+36.628999721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a637dc8-de44-4812-b512-b17407738093-metrics-tls") pod "dns-default-x6b8k" (UID: "0a637dc8-de44-4812-b512-b17407738093") : secret "dns-default-metrics-tls" not found
Sep 17 19:06:50.189858 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.189827    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-trusted-ca\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.194115 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.194090    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3fb9b16c-03f2-4f40-abc6-c4ce643dbf1c-cert\") pod \"ingress-canary-7jdjw\" (UID: \"3fb9b16c-03f2-4f40-abc6-c4ce643dbf1c\") " pod="openshift-ingress-canary/ingress-canary-7jdjw"
Sep 17 19:06:50.194277 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.194251    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-image-registry-private-configuration\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.194704 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.194680    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-installation-pull-secrets\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.199460 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.199413    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md5zr\" (UniqueName: \"kubernetes.io/projected/3fb9b16c-03f2-4f40-abc6-c4ce643dbf1c-kube-api-access-md5zr\") pod \"ingress-canary-7jdjw\" (UID: \"3fb9b16c-03f2-4f40-abc6-c4ce643dbf1c\") " pod="openshift-ingress-canary/ingress-canary-7jdjw"
Sep 17 19:06:50.199727 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.199698    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2c48\" (UniqueName: \"kubernetes.io/projected/0a637dc8-de44-4812-b512-b17407738093-kube-api-access-m2c48\") pod \"dns-default-x6b8k\" (UID: \"0a637dc8-de44-4812-b512-b17407738093\") " pod="openshift-dns/dns-default-x6b8k"
Sep 17 19:06:50.200001 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.199954    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-bound-sa-token\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.200893 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.200856    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf6qs\" (UniqueName: \"kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-kube-api-access-wf6qs\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.220004 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.219972    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:06:50.220004 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.219997    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:06:50.220204 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.220190    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:06:50.224849 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.224831    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 19:06:50.224965 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.224931    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lsqsv\""
Sep 17 19:06:50.225084 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.225023    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 19:06:50.225214 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.225202    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 19:06:50.225269 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.225236    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 19:06:50.225269 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.225238    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-72wlh\""
Sep 17 19:06:50.328840 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.328804    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7jdjw"
Sep 17 19:06:50.649316 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.649231    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7jdjw"]
Sep 17 19:06:50.691743 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.691713    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:50.691921 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:50.691785    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a637dc8-de44-4812-b512-b17407738093-metrics-tls\") pod \"dns-default-x6b8k\" (UID: \"0a637dc8-de44-4812-b512-b17407738093\") " pod="openshift-dns/dns-default-x6b8k"
Sep 17 19:06:50.691921 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:50.691910    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 19:06:50.692030 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:50.691931    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dc6c7b94f-shpbb: secret "image-registry-tls" not found
Sep 17 19:06:50.692030 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:50.691950    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 19:06:50.692030 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:50.691998    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls podName:d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0 nodeName:}" failed. No retries permitted until 2026-09-17 19:06:51.691977478 +0000 UTC m=+37.631334407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls") pod "image-registry-7dc6c7b94f-shpbb" (UID: "d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0") : secret "image-registry-tls" not found
Sep 17 19:06:50.692030 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:50.692019    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a637dc8-de44-4812-b512-b17407738093-metrics-tls podName:0a637dc8-de44-4812-b512-b17407738093 nodeName:}" failed. No retries permitted until 2026-09-17 19:06:51.692012452 +0000 UTC m=+37.631369350 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a637dc8-de44-4812-b512-b17407738093-metrics-tls") pod "dns-default-x6b8k" (UID: "0a637dc8-de44-4812-b512-b17407738093") : secret "dns-default-metrics-tls" not found
Sep 17 19:06:51.699663 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:51.699628    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:51.699663 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:51.699669    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a637dc8-de44-4812-b512-b17407738093-metrics-tls\") pod \"dns-default-x6b8k\" (UID: \"0a637dc8-de44-4812-b512-b17407738093\") " pod="openshift-dns/dns-default-x6b8k"
Sep 17 19:06:51.700635 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:51.699812    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 19:06:51.700635 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:51.699817    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 19:06:51.700635 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:51.699840    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dc6c7b94f-shpbb: secret "image-registry-tls" not found
Sep 17 19:06:51.700635 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:51.699874    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a637dc8-de44-4812-b512-b17407738093-metrics-tls podName:0a637dc8-de44-4812-b512-b17407738093 nodeName:}" failed. No retries permitted until 2026-09-17 19:06:53.699855277 +0000 UTC m=+39.639212180 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a637dc8-de44-4812-b512-b17407738093-metrics-tls") pod "dns-default-x6b8k" (UID: "0a637dc8-de44-4812-b512-b17407738093") : secret "dns-default-metrics-tls" not found
Sep 17 19:06:51.700635 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:51.699921    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls podName:d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0 nodeName:}" failed. No retries permitted until 2026-09-17 19:06:53.699910967 +0000 UTC m=+39.639267872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls") pod "image-registry-7dc6c7b94f-shpbb" (UID: "d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0") : secret "image-registry-tls" not found
Sep 17 19:06:51.988625 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:51.988559    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fb9b16c_03f2_4f40_abc6_c4ce643dbf1c.slice/crio-49f8d7d43b2d7fb793a5d6aa80dfcd28c814df8e75fe406442d0be230275753c WatchSource:0}: Error finding container 49f8d7d43b2d7fb793a5d6aa80dfcd28c814df8e75fe406442d0be230275753c: Status 404 returned error can't find the container with id 49f8d7d43b2d7fb793a5d6aa80dfcd28c814df8e75fe406442d0be230275753c
Sep 17 19:06:52.499325 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:52.499291    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7jdjw" event={"ID":"3fb9b16c-03f2-4f40-abc6-c4ce643dbf1c","Type":"ContainerStarted","Data":"49f8d7d43b2d7fb793a5d6aa80dfcd28c814df8e75fe406442d0be230275753c"}
Sep 17 19:06:52.502778 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:52.502743    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sx5k8" event={"ID":"4169f431-6727-4b3e-a060-a59d9924854e","Type":"ContainerStarted","Data":"1ee1390314cf43a9665ee21223301686e1594d6fd6f70cb775e0b3eddca6d63d"}
Sep 17 19:06:53.508287 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:53.508251    2573 generic.go:356] "Generic (PLEG): container finished" podID="4169f431-6727-4b3e-a060-a59d9924854e" containerID="1ee1390314cf43a9665ee21223301686e1594d6fd6f70cb775e0b3eddca6d63d" exitCode=0
Sep 17 19:06:53.508637 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:53.508286    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sx5k8" event={"ID":"4169f431-6727-4b3e-a060-a59d9924854e","Type":"ContainerDied","Data":"1ee1390314cf43a9665ee21223301686e1594d6fd6f70cb775e0b3eddca6d63d"}
Sep 17 19:06:53.716568 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:53.716533    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:53.716758 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:53.716586    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a637dc8-de44-4812-b512-b17407738093-metrics-tls\") pod \"dns-default-x6b8k\" (UID: \"0a637dc8-de44-4812-b512-b17407738093\") " pod="openshift-dns/dns-default-x6b8k"
Sep 17 19:06:53.716758 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:53.716688    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 19:06:53.716758 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:53.716692    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 19:06:53.716758 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:53.716713    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dc6c7b94f-shpbb: secret "image-registry-tls" not found
Sep 17 19:06:53.716758 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:53.716751    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a637dc8-de44-4812-b512-b17407738093-metrics-tls podName:0a637dc8-de44-4812-b512-b17407738093 nodeName:}" failed. No retries permitted until 2026-09-17 19:06:57.716734811 +0000 UTC m=+43.656091713 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a637dc8-de44-4812-b512-b17407738093-metrics-tls") pod "dns-default-x6b8k" (UID: "0a637dc8-de44-4812-b512-b17407738093") : secret "dns-default-metrics-tls" not found
Sep 17 19:06:53.717058 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:53.716781    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls podName:d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0 nodeName:}" failed. No retries permitted until 2026-09-17 19:06:57.716763877 +0000 UTC m=+43.656120779 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls") pod "image-registry-7dc6c7b94f-shpbb" (UID: "d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0") : secret "image-registry-tls" not found
Sep 17 19:06:54.514149 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:54.514117    2573 generic.go:356] "Generic (PLEG): container finished" podID="4169f431-6727-4b3e-a060-a59d9924854e" containerID="fd02b2860e0cea97e5c4576595df4fba3f720e6dc197909650420269109d80be" exitCode=0
Sep 17 19:06:54.514484 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:54.514176    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sx5k8" event={"ID":"4169f431-6727-4b3e-a060-a59d9924854e","Type":"ContainerDied","Data":"fd02b2860e0cea97e5c4576595df4fba3f720e6dc197909650420269109d80be"}
Sep 17 19:06:55.517544 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:55.517507    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7jdjw" event={"ID":"3fb9b16c-03f2-4f40-abc6-c4ce643dbf1c","Type":"ContainerStarted","Data":"e82097fc640ad9b6f46ac2f50b449db32bb0ca241741a824209799e6186a37e1"}
Sep 17 19:06:55.520995 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:55.520970    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sx5k8" event={"ID":"4169f431-6727-4b3e-a060-a59d9924854e","Type":"ContainerStarted","Data":"93fa2d0bcb6f5e5bb5debc2f2bc7b37e79f9ca144936437e558ba290e170b078"}
Sep 17 19:06:55.540821 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:55.540777    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7jdjw" podStartSLOduration=3.932051564 podStartE2EDuration="6.540763068s" totalImagesPullingTime="2.608711504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:06:55.539542094 +0000 UTC m=+41.478899014" watchObservedRunningTime="2026-09-17 19:06:55.540763068 +0000 UTC m=+41.480119989"
Sep 17 19:06:55.567474 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:55.567426    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sx5k8" podStartSLOduration=10.498660663 podStartE2EDuration="39.567407596s" totalImagesPullingTime="29.068746933s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:06:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:06:55.566765039 +0000 UTC m=+41.506121961" watchObservedRunningTime="2026-09-17 19:06:55.567407596 +0000 UTC m=+41.506764517"
Sep 17 19:06:56.084497 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.084459    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-w58tj"]
Sep 17 19:06:56.098412 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.098383    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-w58tj"
Sep 17 19:06:56.103069 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.103047    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 17 19:06:56.103962 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.103933    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 17 19:06:56.103962 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.103933    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-kd2lq\""
Sep 17 19:06:56.105608 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.105179    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-w58tj"]
Sep 17 19:06:56.204099 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.204066    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-rqk5q"]
Sep 17 19:06:56.205866 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.205847    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-rqk5q"
Sep 17 19:06:56.210566 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.210544    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 17 19:06:56.210845 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.210825    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 17 19:06:56.211078 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.211064    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 17 19:06:56.211158 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.211072    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2q8zd\""
Sep 17 19:06:56.227066 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.227044    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-rqk5q"]
Sep 17 19:06:56.236606 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.236581    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq2pp\" (UniqueName: \"kubernetes.io/projected/1cbf7088-792c-472e-b3a2-cf096e8cdbd3-kube-api-access-nq2pp\") pod \"volume-data-source-validator-5c4db8bdf9-w58tj\" (UID: \"1cbf7088-792c-472e-b3a2-cf096e8cdbd3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-w58tj"
Sep 17 19:06:56.337416 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.337323    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq2pp\" (UniqueName: \"kubernetes.io/projected/1cbf7088-792c-472e-b3a2-cf096e8cdbd3-kube-api-access-nq2pp\") pod \"volume-data-source-validator-5c4db8bdf9-w58tj\" (UID: \"1cbf7088-792c-472e-b3a2-cf096e8cdbd3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-w58tj"
Sep 17 19:06:56.337565 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.337449    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/021a38a2-56b2-4037-b526-6a9a9794eb02-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-rqk5q\" (UID: \"021a38a2-56b2-4037-b526-6a9a9794eb02\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-rqk5q"
Sep 17 19:06:56.337565 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.337477    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjzt9\" (UniqueName: \"kubernetes.io/projected/021a38a2-56b2-4037-b526-6a9a9794eb02-kube-api-access-qjzt9\") pod \"cluster-samples-operator-685d7d68b5-rqk5q\" (UID: \"021a38a2-56b2-4037-b526-6a9a9794eb02\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-rqk5q"
Sep 17 19:06:56.348692 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.348658    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq2pp\" (UniqueName: \"kubernetes.io/projected/1cbf7088-792c-472e-b3a2-cf096e8cdbd3-kube-api-access-nq2pp\") pod \"volume-data-source-validator-5c4db8bdf9-w58tj\" (UID: \"1cbf7088-792c-472e-b3a2-cf096e8cdbd3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-w58tj"
Sep 17 19:06:56.408580 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.408539    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-w58tj"
Sep 17 19:06:56.438778 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.438747    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/021a38a2-56b2-4037-b526-6a9a9794eb02-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-rqk5q\" (UID: \"021a38a2-56b2-4037-b526-6a9a9794eb02\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-rqk5q"
Sep 17 19:06:56.438996 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.438787    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjzt9\" (UniqueName: \"kubernetes.io/projected/021a38a2-56b2-4037-b526-6a9a9794eb02-kube-api-access-qjzt9\") pod \"cluster-samples-operator-685d7d68b5-rqk5q\" (UID: \"021a38a2-56b2-4037-b526-6a9a9794eb02\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-rqk5q"
Sep 17 19:06:56.438996 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:56.438926    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 19:06:56.439111 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:56.439001    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/021a38a2-56b2-4037-b526-6a9a9794eb02-samples-operator-tls podName:021a38a2-56b2-4037-b526-6a9a9794eb02 nodeName:}" failed. No retries permitted until 2026-09-17 19:06:56.938984404 +0000 UTC m=+42.878341323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/021a38a2-56b2-4037-b526-6a9a9794eb02-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-rqk5q" (UID: "021a38a2-56b2-4037-b526-6a9a9794eb02") : secret "samples-operator-tls" not found
Sep 17 19:06:56.457308 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.455762    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjzt9\" (UniqueName: \"kubernetes.io/projected/021a38a2-56b2-4037-b526-6a9a9794eb02-kube-api-access-qjzt9\") pod \"cluster-samples-operator-685d7d68b5-rqk5q\" (UID: \"021a38a2-56b2-4037-b526-6a9a9794eb02\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-rqk5q"
Sep 17 19:06:56.676980 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.676902    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-w58tj"]
Sep 17 19:06:56.679589 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:06:56.679559    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cbf7088_792c_472e_b3a2_cf096e8cdbd3.slice/crio-ffa98c7d6e94a2d9924cdcf58c60662d3ddf1234b17c7815553d5c8996d29f71 WatchSource:0}: Error finding container ffa98c7d6e94a2d9924cdcf58c60662d3ddf1234b17c7815553d5c8996d29f71: Status 404 returned error can't find the container with id ffa98c7d6e94a2d9924cdcf58c60662d3ddf1234b17c7815553d5c8996d29f71
Sep 17 19:06:56.943222 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:56.943187    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/021a38a2-56b2-4037-b526-6a9a9794eb02-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-rqk5q\" (UID: \"021a38a2-56b2-4037-b526-6a9a9794eb02\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-rqk5q"
Sep 17 19:06:56.943377 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:56.943342    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 19:06:56.943425 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:56.943408    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/021a38a2-56b2-4037-b526-6a9a9794eb02-samples-operator-tls podName:021a38a2-56b2-4037-b526-6a9a9794eb02 nodeName:}" failed. No retries permitted until 2026-09-17 19:06:57.943392815 +0000 UTC m=+43.882749713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/021a38a2-56b2-4037-b526-6a9a9794eb02-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-rqk5q" (UID: "021a38a2-56b2-4037-b526-6a9a9794eb02") : secret "samples-operator-tls" not found
Sep 17 19:06:57.527204 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:57.527164    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-w58tj" event={"ID":"1cbf7088-792c-472e-b3a2-cf096e8cdbd3","Type":"ContainerStarted","Data":"ffa98c7d6e94a2d9924cdcf58c60662d3ddf1234b17c7815553d5c8996d29f71"}
Sep 17 19:06:57.751081 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:57.751000    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:06:57.751430 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:57.751098    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 19:06:57.751430 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:57.751118    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dc6c7b94f-shpbb: secret "image-registry-tls" not found
Sep 17 19:06:57.751430 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:57.751125    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a637dc8-de44-4812-b512-b17407738093-metrics-tls\") pod \"dns-default-x6b8k\" (UID: \"0a637dc8-de44-4812-b512-b17407738093\") " pod="openshift-dns/dns-default-x6b8k"
Sep 17 19:06:57.751430 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:57.751163    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls podName:d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0 nodeName:}" failed. No retries permitted until 2026-09-17 19:07:05.751149861 +0000 UTC m=+51.690506782 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls") pod "image-registry-7dc6c7b94f-shpbb" (UID: "d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0") : secret "image-registry-tls" not found
Sep 17 19:06:57.751430 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:57.751220    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 19:06:57.751430 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:57.751272    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a637dc8-de44-4812-b512-b17407738093-metrics-tls podName:0a637dc8-de44-4812-b512-b17407738093 nodeName:}" failed. No retries permitted until 2026-09-17 19:07:05.751256505 +0000 UTC m=+51.690613404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a637dc8-de44-4812-b512-b17407738093-metrics-tls") pod "dns-default-x6b8k" (UID: "0a637dc8-de44-4812-b512-b17407738093") : secret "dns-default-metrics-tls" not found
Sep 17 19:06:57.953111 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:57.953082    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/021a38a2-56b2-4037-b526-6a9a9794eb02-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-rqk5q\" (UID: \"021a38a2-56b2-4037-b526-6a9a9794eb02\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-rqk5q"
Sep 17 19:06:57.953229 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:57.953202    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 19:06:57.953266 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:57.953254    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/021a38a2-56b2-4037-b526-6a9a9794eb02-samples-operator-tls podName:021a38a2-56b2-4037-b526-6a9a9794eb02 nodeName:}" failed. No retries permitted until 2026-09-17 19:06:59.95324102 +0000 UTC m=+45.892597918 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/021a38a2-56b2-4037-b526-6a9a9794eb02-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-rqk5q" (UID: "021a38a2-56b2-4037-b526-6a9a9794eb02") : secret "samples-operator-tls" not found
Sep 17 19:06:58.162605 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.162565    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-g429k"]
Sep 17 19:06:58.166318 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.166300    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:06:58.170126 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.170109    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 19:06:58.170213 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.170112    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 19:06:58.170648 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.170633    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 19:06:58.171280 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.171265    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vsnnc\""
Sep 17 19:06:58.171348 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.171292    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 19:06:58.186093 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.186071    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g429k"]
Sep 17 19:06:58.256385 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.256315    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-data-volume\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:06:58.256385 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.256357    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:06:58.256385 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.256373    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:06:58.256553 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.256388    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znmgz\" (UniqueName: \"kubernetes.io/projected/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-kube-api-access-znmgz\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:06:58.256553 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.256485    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-crio-socket\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:06:58.357697 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.357649    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-data-volume\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:06:58.357697 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.357707    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:06:58.357957 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.357723    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:06:58.357957 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.357740    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znmgz\" (UniqueName: \"kubernetes.io/projected/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-kube-api-access-znmgz\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:06:58.357957 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:58.357806    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 19:06:58.357957 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:58.357856    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 19:06:58.357957 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:58.357875    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-kube-rbac-proxy-cm podName:cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d nodeName:}" failed. No retries permitted until 2026-09-17 19:06:58.85785944 +0000 UTC m=+44.797216338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g429k" (UID: "cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d") : configmap "kube-rbac-proxy" not found
Sep 17 19:06:58.357957 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:58.357937    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-insights-runtime-extractor-tls podName:cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d nodeName:}" failed. No retries permitted until 2026-09-17 19:06:58.857917909 +0000 UTC m=+44.797274813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g429k" (UID: "cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d") : secret "insights-runtime-extractor-tls" not found
Sep 17 19:06:58.358223 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.357978    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-crio-socket\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:06:58.358223 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.358088    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-data-volume\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:06:58.358223 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.358130    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-crio-socket\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:06:58.368280 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.368257    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znmgz\" (UniqueName: \"kubernetes.io/projected/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-kube-api-access-znmgz\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:06:58.531284 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.531193    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-w58tj" event={"ID":"1cbf7088-792c-472e-b3a2-cf096e8cdbd3","Type":"ContainerStarted","Data":"875cead21be319b92f9c09363e3250f499cb53175fa6aaeab3032038250608bb"}
Sep 17 19:06:58.559128 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.559078    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-w58tj" podStartSLOduration=1.622656202 podStartE2EDuration="2.559063586s" totalImagesPullingTime="936.407384ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:06:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:06:58.55783715 +0000 UTC m=+44.497194071" watchObservedRunningTime="2026-09-17 19:06:58.559063586 +0000 UTC m=+44.498420509"
Sep 17 19:06:58.861713 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.861620    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:06:58.862109 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:58.861742    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:06:58.862109 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:58.861767    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 19:06:58.862109 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:58.861802    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 19:06:58.862109 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:58.861835    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-insights-runtime-extractor-tls podName:cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d nodeName:}" failed. No retries permitted until 2026-09-17 19:06:59.861817749 +0000 UTC m=+45.801174649 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g429k" (UID: "cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d") : secret "insights-runtime-extractor-tls" not found
Sep 17 19:06:58.862109 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:58.861899    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-kube-rbac-proxy-cm podName:cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d nodeName:}" failed. No retries permitted until 2026-09-17 19:06:59.861872162 +0000 UTC m=+45.801229089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g429k" (UID: "cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d") : configmap "kube-rbac-proxy" not found
Sep 17 19:06:59.477728 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:59.477698    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6cnk9_c4cc155d-43c9-4590-964c-a6564c0ca4e2/dns-node-resolver/0.log"
Sep 17 19:06:59.871243 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:59.871156    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:06:59.871243 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:59.871191    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:06:59.871728 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:59.871279    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 19:06:59.871728 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:59.871329    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 19:06:59.871728 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:59.871354    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-kube-rbac-proxy-cm podName:cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d nodeName:}" failed. No retries permitted until 2026-09-17 19:07:01.871331902 +0000 UTC m=+47.810688802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g429k" (UID: "cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d") : configmap "kube-rbac-proxy" not found
Sep 17 19:06:59.871728 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:59.871373    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-insights-runtime-extractor-tls podName:cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d nodeName:}" failed. No retries permitted until 2026-09-17 19:07:01.871362051 +0000 UTC m=+47.810718949 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g429k" (UID: "cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d") : secret "insights-runtime-extractor-tls" not found
Sep 17 19:06:59.972342 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:06:59.972308    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/021a38a2-56b2-4037-b526-6a9a9794eb02-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-rqk5q\" (UID: \"021a38a2-56b2-4037-b526-6a9a9794eb02\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-rqk5q"
Sep 17 19:06:59.972474 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:59.972441    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 19:06:59.972513 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:06:59.972489    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/021a38a2-56b2-4037-b526-6a9a9794eb02-samples-operator-tls podName:021a38a2-56b2-4037-b526-6a9a9794eb02 nodeName:}" failed. No retries permitted until 2026-09-17 19:07:03.972475522 +0000 UTC m=+49.911832422 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/021a38a2-56b2-4037-b526-6a9a9794eb02-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-rqk5q" (UID: "021a38a2-56b2-4037-b526-6a9a9794eb02") : secret "samples-operator-tls" not found
Sep 17 19:07:00.681206 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:00.681178    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h5vqv_c545dfa9-0c6e-4493-8f12-cd63c012cb53/node-ca/0.log"
Sep 17 19:07:01.077625 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:01.077599    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7jdjw_3fb9b16c-03f2-4f40-abc6-c4ce643dbf1c/serve-healthcheck-canary/0.log"
Sep 17 19:07:01.889476 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:01.889423    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:07:01.889476 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:01.889475    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:07:01.889700 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:01.889555    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 19:07:01.889700 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:01.889570    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 19:07:01.889700 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:01.889617    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-insights-runtime-extractor-tls podName:cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d nodeName:}" failed. No retries permitted until 2026-09-17 19:07:05.889603115 +0000 UTC m=+51.828960014 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g429k" (UID: "cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d") : secret "insights-runtime-extractor-tls" not found
Sep 17 19:07:01.889700 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:01.889629    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-kube-rbac-proxy-cm podName:cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d nodeName:}" failed. No retries permitted until 2026-09-17 19:07:05.889623566 +0000 UTC m=+51.828980465 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g429k" (UID: "cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d") : configmap "kube-rbac-proxy" not found
Sep 17 19:07:04.005461 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:04.005424    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/021a38a2-56b2-4037-b526-6a9a9794eb02-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-rqk5q\" (UID: \"021a38a2-56b2-4037-b526-6a9a9794eb02\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-rqk5q"
Sep 17 19:07:04.005835 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:04.005584    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 19:07:04.005835 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:04.005653    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/021a38a2-56b2-4037-b526-6a9a9794eb02-samples-operator-tls podName:021a38a2-56b2-4037-b526-6a9a9794eb02 nodeName:}" failed. No retries permitted until 2026-09-17 19:07:12.005637263 +0000 UTC m=+57.944994166 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/021a38a2-56b2-4037-b526-6a9a9794eb02-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-rqk5q" (UID: "021a38a2-56b2-4037-b526-6a9a9794eb02") : secret "samples-operator-tls" not found
Sep 17 19:07:05.822526 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:05.822490    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:07:05.822526 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:05.822532    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a637dc8-de44-4812-b512-b17407738093-metrics-tls\") pod \"dns-default-x6b8k\" (UID: \"0a637dc8-de44-4812-b512-b17407738093\") " pod="openshift-dns/dns-default-x6b8k"
Sep 17 19:07:05.823002 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:05.822650    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 19:07:05.823002 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:05.822719    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a637dc8-de44-4812-b512-b17407738093-metrics-tls podName:0a637dc8-de44-4812-b512-b17407738093 nodeName:}" failed. No retries permitted until 2026-09-17 19:07:21.822700271 +0000 UTC m=+67.762057173 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a637dc8-de44-4812-b512-b17407738093-metrics-tls") pod "dns-default-x6b8k" (UID: "0a637dc8-de44-4812-b512-b17407738093") : secret "dns-default-metrics-tls" not found
Sep 17 19:07:05.823002 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:05.822729    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 19:07:05.823002 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:05.822745    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dc6c7b94f-shpbb: secret "image-registry-tls" not found
Sep 17 19:07:05.823002 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:05.822780    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls podName:d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0 nodeName:}" failed. No retries permitted until 2026-09-17 19:07:21.822769929 +0000 UTC m=+67.762126829 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls") pod "image-registry-7dc6c7b94f-shpbb" (UID: "d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0") : secret "image-registry-tls" not found
Sep 17 19:07:05.923825 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:05.923787    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:07:05.923825 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:05.923823    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:07:05.924034 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:05.923947    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 19:07:05.924034 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:05.923983    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 19:07:05.924034 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:05.924026    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-kube-rbac-proxy-cm podName:cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d nodeName:}" failed. No retries permitted until 2026-09-17 19:07:13.924009416 +0000 UTC m=+59.863366319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g429k" (UID: "cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d") : configmap "kube-rbac-proxy" not found
Sep 17 19:07:05.924133 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:05.924041    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-insights-runtime-extractor-tls podName:cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d nodeName:}" failed. No retries permitted until 2026-09-17 19:07:13.924034968 +0000 UTC m=+59.863391867 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g429k" (UID: "cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d") : secret "insights-runtime-extractor-tls" not found
Sep 17 19:07:12.071184 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:12.071138    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/021a38a2-56b2-4037-b526-6a9a9794eb02-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-rqk5q\" (UID: \"021a38a2-56b2-4037-b526-6a9a9794eb02\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-rqk5q"
Sep 17 19:07:12.071578 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:12.071296    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 19:07:12.071578 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:12.071355    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/021a38a2-56b2-4037-b526-6a9a9794eb02-samples-operator-tls podName:021a38a2-56b2-4037-b526-6a9a9794eb02 nodeName:}" failed. No retries permitted until 2026-09-17 19:07:28.071340555 +0000 UTC m=+74.010697455 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/021a38a2-56b2-4037-b526-6a9a9794eb02-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-rqk5q" (UID: "021a38a2-56b2-4037-b526-6a9a9794eb02") : secret "samples-operator-tls" not found
Sep 17 19:07:13.986517 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:13.986473    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:07:13.986517 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:13.986514    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:07:13.987060 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:13.986635    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 19:07:13.987060 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:13.986687    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-insights-runtime-extractor-tls podName:cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d nodeName:}" failed. No retries permitted until 2026-09-17 19:07:29.986673436 +0000 UTC m=+75.926030335 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g429k" (UID: "cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d") : secret "insights-runtime-extractor-tls" not found
Sep 17 19:07:13.987134 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:13.987057    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:07:16.500727 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:16.500699    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbxgv"
Sep 17 19:07:21.845581 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:21.845521    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:07:21.845581 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:21.845582    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a637dc8-de44-4812-b512-b17407738093-metrics-tls\") pod \"dns-default-x6b8k\" (UID: \"0a637dc8-de44-4812-b512-b17407738093\") " pod="openshift-dns/dns-default-x6b8k"
Sep 17 19:07:21.848095 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:21.848072    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a637dc8-de44-4812-b512-b17407738093-metrics-tls\") pod \"dns-default-x6b8k\" (UID: \"0a637dc8-de44-4812-b512-b17407738093\") " pod="openshift-dns/dns-default-x6b8k"
Sep 17 19:07:21.848203 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:21.848141    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls\") pod \"image-registry-7dc6c7b94f-shpbb\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") " pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:07:21.946436 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:21.946393    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs\") pod \"network-metrics-daemon-fxwkw\" (UID: \"b7c8049f-7c97-4d5f-8279-ea12aba931cc\") " pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:07:21.949428 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:21.949409    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 19:07:21.959148 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:21.959118    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7c8049f-7c97-4d5f-8279-ea12aba931cc-metrics-certs\") pod \"network-metrics-daemon-fxwkw\" (UID: \"b7c8049f-7c97-4d5f-8279-ea12aba931cc\") " pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:07:22.041852 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.041822    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lsqsv\""
Sep 17 19:07:22.047610 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.047589    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret\") pod \"global-pull-secret-syncer-6sp4v\" (UID: \"273ee390-dd66-4cfa-b503-c9d1983d5e0a\") " pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:07:22.048867 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.048845    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxwkw"
Sep 17 19:07:22.050601 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.050585    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 19:07:22.060718 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.060697    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/273ee390-dd66-4cfa-b503-c9d1983d5e0a-original-pull-secret\") pod \"global-pull-secret-syncer-6sp4v\" (UID: \"273ee390-dd66-4cfa-b503-c9d1983d5e0a\") " pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:07:22.110941 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.110866    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4tjxz\""
Sep 17 19:07:22.113237 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.113217    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rj77f\""
Sep 17 19:07:22.116570 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.116550    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:07:22.120788 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.120771    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x6b8k"
Sep 17 19:07:22.148938 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.148903    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7js7j\" (UniqueName: \"kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j\") pod \"network-check-target-nw2xp\" (UID: \"deeaf161-dbf1-4057-b88c-9881a12733d0\") " pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:07:22.153048 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.153026    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 19:07:22.162132 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.162107    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 19:07:22.176463 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.176440    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7js7j\" (UniqueName: \"kubernetes.io/projected/deeaf161-dbf1-4057-b88c-9881a12733d0-kube-api-access-7js7j\") pod \"network-check-target-nw2xp\" (UID: \"deeaf161-dbf1-4057-b88c-9881a12733d0\") " pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:07:22.319851 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.319821    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fxwkw"]
Sep 17 19:07:22.322613 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:07:22.322583    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7c8049f_7c97_4d5f_8279_ea12aba931cc.slice/crio-0544f445767c420abf3f3d464da93dcea7a4b1d8c8c6c277a3b511261ff68ea1 WatchSource:0}: Error finding container 0544f445767c420abf3f3d464da93dcea7a4b1d8c8c6c277a3b511261ff68ea1: Status 404 returned error can't find the container with id 0544f445767c420abf3f3d464da93dcea7a4b1d8c8c6c277a3b511261ff68ea1
Sep 17 19:07:22.333202 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.333183    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-72wlh\""
Sep 17 19:07:22.340945 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.340927    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:07:22.342115 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.342098    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6sp4v"
Sep 17 19:07:22.414049 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:07:22.414020    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a637dc8_de44_4812_b512_b17407738093.slice/crio-5f657a2bd7ef3332dc0a223c9f4e0490a664ce6e7b7b70779a0265b1c19fe7f1 WatchSource:0}: Error finding container 5f657a2bd7ef3332dc0a223c9f4e0490a664ce6e7b7b70779a0265b1c19fe7f1: Status 404 returned error can't find the container with id 5f657a2bd7ef3332dc0a223c9f4e0490a664ce6e7b7b70779a0265b1c19fe7f1
Sep 17 19:07:22.421481 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:07:22.421434    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6583ae7_e0ec_41c2_96c3_ecd04d5e33b0.slice/crio-d4e33783be4315635e861e26b453003eb4a78e1cf38d61bef44161d109d1ac1a WatchSource:0}: Error finding container d4e33783be4315635e861e26b453003eb4a78e1cf38d61bef44161d109d1ac1a: Status 404 returned error can't find the container with id d4e33783be4315635e861e26b453003eb4a78e1cf38d61bef44161d109d1ac1a
Sep 17 19:07:22.422846 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.422685    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x6b8k"]
Sep 17 19:07:22.424379 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.424148    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dc6c7b94f-shpbb"]
Sep 17 19:07:22.589395 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.589361    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x6b8k" event={"ID":"0a637dc8-de44-4812-b512-b17407738093","Type":"ContainerStarted","Data":"5f657a2bd7ef3332dc0a223c9f4e0490a664ce6e7b7b70779a0265b1c19fe7f1"}
Sep 17 19:07:22.590654 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.590633    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fxwkw" event={"ID":"b7c8049f-7c97-4d5f-8279-ea12aba931cc","Type":"ContainerStarted","Data":"0544f445767c420abf3f3d464da93dcea7a4b1d8c8c6c277a3b511261ff68ea1"}
Sep 17 19:07:22.592149 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.592127    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb" event={"ID":"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0","Type":"ContainerStarted","Data":"41410fead169ef235a2783bb5d95c2acc9199bfe92e3917dab45276806c62358"}
Sep 17 19:07:22.592259 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.592169    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb" event={"ID":"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0","Type":"ContainerStarted","Data":"d4e33783be4315635e861e26b453003eb4a78e1cf38d61bef44161d109d1ac1a"}
Sep 17 19:07:22.592259 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.592210    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:07:22.620497 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.620411    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6sp4v"]
Sep 17 19:07:22.624095 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.624041    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb" podStartSLOduration=66.624020958 podStartE2EDuration="1m6.624020958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:06:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:22.623254613 +0000 UTC m=+68.562611526" watchObservedRunningTime="2026-09-17 19:07:22.624020958 +0000 UTC m=+68.563377880"
Sep 17 19:07:22.624325 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:22.624112    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nw2xp"]
Sep 17 19:07:22.624489 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:07:22.624466    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod273ee390_dd66_4cfa_b503_c9d1983d5e0a.slice/crio-88cccbac13ed28623dbef8396c0874f8f71198b7e967761045c2e87d66db0b11 WatchSource:0}: Error finding container 88cccbac13ed28623dbef8396c0874f8f71198b7e967761045c2e87d66db0b11: Status 404 returned error can't find the container with id 88cccbac13ed28623dbef8396c0874f8f71198b7e967761045c2e87d66db0b11
Sep 17 19:07:22.627669 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:07:22.627639    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeeaf161_dbf1_4057_b88c_9881a12733d0.slice/crio-73d6f79c34674ddf3f3ad91429461764d257575b658e9a3fb9f203a71ad98a72 WatchSource:0}: Error finding container 73d6f79c34674ddf3f3ad91429461764d257575b658e9a3fb9f203a71ad98a72: Status 404 returned error can't find the container with id 73d6f79c34674ddf3f3ad91429461764d257575b658e9a3fb9f203a71ad98a72
Sep 17 19:07:23.598390 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:23.598247    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fxwkw" event={"ID":"b7c8049f-7c97-4d5f-8279-ea12aba931cc","Type":"ContainerStarted","Data":"0efc020131a7a5dba479ed7a555a50a2cb9211bc0f1dd9c231284f7f72e4b46f"}
Sep 17 19:07:23.604306 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:23.604115    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6sp4v" event={"ID":"273ee390-dd66-4cfa-b503-c9d1983d5e0a","Type":"ContainerStarted","Data":"88cccbac13ed28623dbef8396c0874f8f71198b7e967761045c2e87d66db0b11"}
Sep 17 19:07:23.606823 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:23.606733    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nw2xp" event={"ID":"deeaf161-dbf1-4057-b88c-9881a12733d0","Type":"ContainerStarted","Data":"73d6f79c34674ddf3f3ad91429461764d257575b658e9a3fb9f203a71ad98a72"}
Sep 17 19:07:24.611711 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:24.611679    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fxwkw" event={"ID":"b7c8049f-7c97-4d5f-8279-ea12aba931cc","Type":"ContainerStarted","Data":"ea2bc2504b34d0accee2dab72326c949f4f608174347b18bb8d3ba180f25a0c9"}
Sep 17 19:07:24.638906 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:24.637092    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fxwkw" podStartSLOduration=67.567967275 podStartE2EDuration="1m8.637068681s" totalImagesPullingTime="1.069101406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:06:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:24.63486672 +0000 UTC m=+70.574223641" watchObservedRunningTime="2026-09-17 19:07:24.637068681 +0000 UTC m=+70.576425605"
Sep 17 19:07:25.617854 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:25.617816    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x6b8k" event={"ID":"0a637dc8-de44-4812-b512-b17407738093","Type":"ContainerStarted","Data":"c550b0e4c6824f398501c9fbcd1cfa9c32ad4e881914649647a210803544748d"}
Sep 17 19:07:25.618319 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:25.617893    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x6b8k" event={"ID":"0a637dc8-de44-4812-b512-b17407738093","Type":"ContainerStarted","Data":"a06c70276b78a985d5d236b5f656e8f7da44196f6f7120d06ff8c1d7a675dcdd"}
Sep 17 19:07:25.618319 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:25.618309    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x6b8k"
Sep 17 19:07:25.640473 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:25.640426    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x6b8k" podStartSLOduration=34.552160715 podStartE2EDuration="36.640406632s" totalImagesPullingTime="2.088245917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:25.638977963 +0000 UTC m=+71.578334885" watchObservedRunningTime="2026-09-17 19:07:25.640406632 +0000 UTC m=+71.579763554"
Sep 17 19:07:27.625611 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:27.625568    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6sp4v" event={"ID":"273ee390-dd66-4cfa-b503-c9d1983d5e0a","Type":"ContainerStarted","Data":"42c6887654d26e47cdfba503452a50dfb07ee5e03bc734cf720ccd14072d1d8d"}
Sep 17 19:07:27.627220 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:27.627190    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nw2xp" event={"ID":"deeaf161-dbf1-4057-b88c-9881a12733d0","Type":"ContainerStarted","Data":"71cad4bca73e40d41eae5721505b334ea72825e17bda48708f5a12caffd622ac"}
Sep 17 19:07:27.627548 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:27.627535    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:07:27.647899 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:27.647821    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6sp4v" podStartSLOduration=66.824243954 podStartE2EDuration="1m11.647806055s" totalImagesPullingTime="4.823562101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:06:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:27.647284325 +0000 UTC m=+73.586641247" watchObservedRunningTime="2026-09-17 19:07:27.647806055 +0000 UTC m=+73.587162976"
Sep 17 19:07:27.668656 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:27.668595    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nw2xp" podStartSLOduration=66.852276718 podStartE2EDuration="1m11.66857516s" totalImagesPullingTime="4.816298442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:06:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:27.668037661 +0000 UTC m=+73.607394582" watchObservedRunningTime="2026-09-17 19:07:27.66857516 +0000 UTC m=+73.607932083"
Sep 17 19:07:28.102045 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:28.102002    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/021a38a2-56b2-4037-b526-6a9a9794eb02-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-rqk5q\" (UID: \"021a38a2-56b2-4037-b526-6a9a9794eb02\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-rqk5q"
Sep 17 19:07:28.104594 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:28.104572    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/021a38a2-56b2-4037-b526-6a9a9794eb02-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-rqk5q\" (UID: \"021a38a2-56b2-4037-b526-6a9a9794eb02\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-rqk5q"
Sep 17 19:07:28.317523 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:28.317488    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2q8zd\""
Sep 17 19:07:28.324815 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:28.324794    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-rqk5q"
Sep 17 19:07:28.593851 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:28.593815    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-rqk5q"]
Sep 17 19:07:29.634843 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:29.634803    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-rqk5q" event={"ID":"021a38a2-56b2-4037-b526-6a9a9794eb02","Type":"ContainerStarted","Data":"e9620b294d385880ef087bb1f6a187f5f6eec8a3bc09903481e047073f3eacd5"}
Sep 17 19:07:30.017112 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:30.017073    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:07:30.019899 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:30.019856    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g429k\" (UID: \"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d\") " pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:07:30.276700 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:30.276623    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vsnnc\""
Sep 17 19:07:30.284661 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:30.284637    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g429k"
Sep 17 19:07:30.577309 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:30.577242    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g429k"]
Sep 17 19:07:30.580304 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:07:30.580278    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcec7d6f3_d29d_401f_b6c8_162ce5dd2c2d.slice/crio-24a3a4bce7043e6e934ccfc81e0dbfcdc82467450fc9da8c37302cb1fd3e8127 WatchSource:0}: Error finding container 24a3a4bce7043e6e934ccfc81e0dbfcdc82467450fc9da8c37302cb1fd3e8127: Status 404 returned error can't find the container with id 24a3a4bce7043e6e934ccfc81e0dbfcdc82467450fc9da8c37302cb1fd3e8127
Sep 17 19:07:30.640090 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:30.640052    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g429k" event={"ID":"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d","Type":"ContainerStarted","Data":"592d0d27493d26da755ec95b2a271ead8dab3d98733c23da5c952484abdfad6a"}
Sep 17 19:07:30.640429 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:30.640167    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g429k" event={"ID":"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d","Type":"ContainerStarted","Data":"24a3a4bce7043e6e934ccfc81e0dbfcdc82467450fc9da8c37302cb1fd3e8127"}
Sep 17 19:07:30.642234 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:30.642204    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-rqk5q" event={"ID":"021a38a2-56b2-4037-b526-6a9a9794eb02","Type":"ContainerStarted","Data":"dfd64dbfcd0f5e4379434a85fef959376387a580a127da4060e24fb95428d2fc"}
Sep 17 19:07:30.642333 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:30.642251    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-rqk5q" event={"ID":"021a38a2-56b2-4037-b526-6a9a9794eb02","Type":"ContainerStarted","Data":"72c321cc4401413a667534c68f2415fcd401f9c17c6a67af01e8504401e2c04b"}
Sep 17 19:07:30.672243 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:30.672196    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-rqk5q" podStartSLOduration=33.165768146 podStartE2EDuration="34.672181282s" totalImagesPullingTime="1.506413136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:06:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:30.671766692 +0000 UTC m=+76.611123612" watchObservedRunningTime="2026-09-17 19:07:30.672181282 +0000 UTC m=+76.611538203"
Sep 17 19:07:31.646820 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:31.646726    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g429k" event={"ID":"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d","Type":"ContainerStarted","Data":"59f5d7d8af645905063d804bf6a87bcc453360275c2967d10c09b4ca6e4d63cd"}
Sep 17 19:07:33.395508 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.395475    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-657b7dd685-74msc"]
Sep 17 19:07:33.398360 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.398344    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657b7dd685-74msc"
Sep 17 19:07:33.400906 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.400864    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 17 19:07:33.402118 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.402096    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 17 19:07:33.402232 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.402097    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 17 19:07:33.402520 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.402503    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 17 19:07:33.414350 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.414324    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-ltlpr"]
Sep 17 19:07:33.417417 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.417399    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-657b7dd685-74msc"]
Sep 17 19:07:33.417497 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.417480    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-ltlpr"
Sep 17 19:07:33.427372 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.427354    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 17 19:07:33.427642 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.427625    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 17 19:07:33.428159 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.428143    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4996n\""
Sep 17 19:07:33.445661 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.445641    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-ltlpr"]
Sep 17 19:07:33.486446 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.486418    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-67jzf"]
Sep 17 19:07:33.489350 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.489335    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-67jzf"
Sep 17 19:07:33.492165 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.492145    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 17 19:07:33.492277 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.492144    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ssjs8\""
Sep 17 19:07:33.500715 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.500695    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-67jzf"]
Sep 17 19:07:33.538663 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.538632    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6dg9\" (UniqueName: \"kubernetes.io/projected/6cc32d66-cfc0-4e8d-b32a-7f3e076b6767-kube-api-access-f6dg9\") pod \"klusterlet-addon-workmgr-657b7dd685-74msc\" (UID: \"6cc32d66-cfc0-4e8d-b32a-7f3e076b6767\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657b7dd685-74msc"
Sep 17 19:07:33.538780 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.538679    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6cc32d66-cfc0-4e8d-b32a-7f3e076b6767-klusterlet-config\") pod \"klusterlet-addon-workmgr-657b7dd685-74msc\" (UID: \"6cc32d66-cfc0-4e8d-b32a-7f3e076b6767\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657b7dd685-74msc"
Sep 17 19:07:33.538780 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.538715    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4e54aa88-d09c-481b-b8c8-2f3edc3a2752-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-ltlpr\" (UID: \"4e54aa88-d09c-481b-b8c8-2f3edc3a2752\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-ltlpr"
Sep 17 19:07:33.538780 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.538760    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e54aa88-d09c-481b-b8c8-2f3edc3a2752-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-ltlpr\" (UID: \"4e54aa88-d09c-481b-b8c8-2f3edc3a2752\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-ltlpr"
Sep 17 19:07:33.538940 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.538796    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e519fed0-84a5-460c-8bc8-9400230c7a78-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-67jzf\" (UID: \"e519fed0-84a5-460c-8bc8-9400230c7a78\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-67jzf"
Sep 17 19:07:33.538940 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.538841    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cc32d66-cfc0-4e8d-b32a-7f3e076b6767-tmp\") pod \"klusterlet-addon-workmgr-657b7dd685-74msc\" (UID: \"6cc32d66-cfc0-4e8d-b32a-7f3e076b6767\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657b7dd685-74msc"
Sep 17 19:07:33.639764 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.639729    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e519fed0-84a5-460c-8bc8-9400230c7a78-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-67jzf\" (UID: \"e519fed0-84a5-460c-8bc8-9400230c7a78\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-67jzf"
Sep 17 19:07:33.639959 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.639773    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cc32d66-cfc0-4e8d-b32a-7f3e076b6767-tmp\") pod \"klusterlet-addon-workmgr-657b7dd685-74msc\" (UID: \"6cc32d66-cfc0-4e8d-b32a-7f3e076b6767\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657b7dd685-74msc"
Sep 17 19:07:33.639959 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.639803    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6dg9\" (UniqueName: \"kubernetes.io/projected/6cc32d66-cfc0-4e8d-b32a-7f3e076b6767-kube-api-access-f6dg9\") pod \"klusterlet-addon-workmgr-657b7dd685-74msc\" (UID: \"6cc32d66-cfc0-4e8d-b32a-7f3e076b6767\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657b7dd685-74msc"
Sep 17 19:07:33.639959 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.639836    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6cc32d66-cfc0-4e8d-b32a-7f3e076b6767-klusterlet-config\") pod \"klusterlet-addon-workmgr-657b7dd685-74msc\" (UID: \"6cc32d66-cfc0-4e8d-b32a-7f3e076b6767\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657b7dd685-74msc"
Sep 17 19:07:33.639959 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.639862    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4e54aa88-d09c-481b-b8c8-2f3edc3a2752-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-ltlpr\" (UID: \"4e54aa88-d09c-481b-b8c8-2f3edc3a2752\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-ltlpr"
Sep 17 19:07:33.639959 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.639909    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e54aa88-d09c-481b-b8c8-2f3edc3a2752-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-ltlpr\" (UID: \"4e54aa88-d09c-481b-b8c8-2f3edc3a2752\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-ltlpr"
Sep 17 19:07:33.640297 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.640265    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cc32d66-cfc0-4e8d-b32a-7f3e076b6767-tmp\") pod \"klusterlet-addon-workmgr-657b7dd685-74msc\" (UID: \"6cc32d66-cfc0-4e8d-b32a-7f3e076b6767\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657b7dd685-74msc"
Sep 17 19:07:33.640609 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.640574    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4e54aa88-d09c-481b-b8c8-2f3edc3a2752-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-ltlpr\" (UID: \"4e54aa88-d09c-481b-b8c8-2f3edc3a2752\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-ltlpr"
Sep 17 19:07:33.646210 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.642819    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6cc32d66-cfc0-4e8d-b32a-7f3e076b6767-klusterlet-config\") pod \"klusterlet-addon-workmgr-657b7dd685-74msc\" (UID: \"6cc32d66-cfc0-4e8d-b32a-7f3e076b6767\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657b7dd685-74msc"
Sep 17 19:07:33.646210 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.642850    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e54aa88-d09c-481b-b8c8-2f3edc3a2752-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-ltlpr\" (UID: \"4e54aa88-d09c-481b-b8c8-2f3edc3a2752\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-ltlpr"
Sep 17 19:07:33.646210 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.642853    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e519fed0-84a5-460c-8bc8-9400230c7a78-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-67jzf\" (UID: \"e519fed0-84a5-460c-8bc8-9400230c7a78\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-67jzf"
Sep 17 19:07:33.650837 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.650817    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6dg9\" (UniqueName: \"kubernetes.io/projected/6cc32d66-cfc0-4e8d-b32a-7f3e076b6767-kube-api-access-f6dg9\") pod \"klusterlet-addon-workmgr-657b7dd685-74msc\" (UID: \"6cc32d66-cfc0-4e8d-b32a-7f3e076b6767\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657b7dd685-74msc"
Sep 17 19:07:33.655802 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.655770    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g429k" event={"ID":"cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d","Type":"ContainerStarted","Data":"9be35735519010dd6c62c181dfa009bead9b3569d55ce4fbc3b859921b3423d5"}
Sep 17 19:07:33.693604 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.693565    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-g429k" podStartSLOduration=33.703141345 podStartE2EDuration="35.693551542s" totalImagesPullingTime="1.990410197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:06:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:33.692704913 +0000 UTC m=+79.632061834" watchObservedRunningTime="2026-09-17 19:07:33.693551542 +0000 UTC m=+79.632908465"
Sep 17 19:07:33.707298 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.707277    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657b7dd685-74msc"
Sep 17 19:07:33.727054 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.727024    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-ltlpr"
Sep 17 19:07:33.798195 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.798157    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-67jzf"
Sep 17 19:07:33.992129 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:33.992097    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-657b7dd685-74msc"]
Sep 17 19:07:33.995936 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:07:33.995910    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc32d66_cfc0_4e8d_b32a_7f3e076b6767.slice/crio-70aa3190256854021775d0abc2a44e197e35e682fcf20fd26eb3bb3bd09a2070 WatchSource:0}: Error finding container 70aa3190256854021775d0abc2a44e197e35e682fcf20fd26eb3bb3bd09a2070: Status 404 returned error can't find the container with id 70aa3190256854021775d0abc2a44e197e35e682fcf20fd26eb3bb3bd09a2070
Sep 17 19:07:34.067424 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:34.067389    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-ltlpr"]
Sep 17 19:07:34.084799 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:07:34.084772    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e54aa88_d09c_481b_b8c8_2f3edc3a2752.slice/crio-069221936ab6213c89cbe9cd72d0b877d8137ad7a26c1c8354adecb9a80b05d9 WatchSource:0}: Error finding container 069221936ab6213c89cbe9cd72d0b877d8137ad7a26c1c8354adecb9a80b05d9: Status 404 returned error can't find the container with id 069221936ab6213c89cbe9cd72d0b877d8137ad7a26c1c8354adecb9a80b05d9
Sep 17 19:07:34.106589 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:34.106564    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-67jzf"]
Sep 17 19:07:34.109940 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:07:34.109916    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode519fed0_84a5_460c_8bc8_9400230c7a78.slice/crio-1e241f41b06657c9413a7fc79be2fbebe2f42ba8d8393033e5222a407f6d29a3 WatchSource:0}: Error finding container 1e241f41b06657c9413a7fc79be2fbebe2f42ba8d8393033e5222a407f6d29a3: Status 404 returned error can't find the container with id 1e241f41b06657c9413a7fc79be2fbebe2f42ba8d8393033e5222a407f6d29a3
Sep 17 19:07:34.661962 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:34.661910    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-ltlpr" event={"ID":"4e54aa88-d09c-481b-b8c8-2f3edc3a2752","Type":"ContainerStarted","Data":"069221936ab6213c89cbe9cd72d0b877d8137ad7a26c1c8354adecb9a80b05d9"}
Sep 17 19:07:34.663367 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:34.663337    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-67jzf" event={"ID":"e519fed0-84a5-460c-8bc8-9400230c7a78","Type":"ContainerStarted","Data":"1e241f41b06657c9413a7fc79be2fbebe2f42ba8d8393033e5222a407f6d29a3"}
Sep 17 19:07:34.665128 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:34.665098    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657b7dd685-74msc" event={"ID":"6cc32d66-cfc0-4e8d-b32a-7f3e076b6767","Type":"ContainerStarted","Data":"70aa3190256854021775d0abc2a44e197e35e682fcf20fd26eb3bb3bd09a2070"}
Sep 17 19:07:35.671904 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:35.671798    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-ltlpr" event={"ID":"4e54aa88-d09c-481b-b8c8-2f3edc3a2752","Type":"ContainerStarted","Data":"e2f2147f208536fe24a7051042f4adee2607135376e03c42abb09807af895ac2"}
Sep 17 19:07:35.674051 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:35.674022    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-67jzf" event={"ID":"e519fed0-84a5-460c-8bc8-9400230c7a78","Type":"ContainerStarted","Data":"a3ce969d9113a8ffa34ac6b522aa83344d303bf6dd03810059af234ad53b736c"}
Sep 17 19:07:35.674257 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:35.674234    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-67jzf"
Sep 17 19:07:35.681368 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:35.681343    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-67jzf"
Sep 17 19:07:35.692717 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:35.692192    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-ltlpr" podStartSLOduration=1.396739657 podStartE2EDuration="2.692171867s" totalImagesPullingTime="1.29543221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:35.690224844 +0000 UTC m=+81.629581765" watchObservedRunningTime="2026-09-17 19:07:35.692171867 +0000 UTC m=+81.631528788"
Sep 17 19:07:35.709072 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:35.709019    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-67jzf" podStartSLOduration=1.436398304 podStartE2EDuration="2.709000416s" totalImagesPullingTime="1.272602112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:35.70803318 +0000 UTC m=+81.647390106" watchObservedRunningTime="2026-09-17 19:07:35.709000416 +0000 UTC m=+81.648357336"
Sep 17 19:07:35.901794 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:35.901755    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-6kh6m"]
Sep 17 19:07:35.906892 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:35.906853    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6kh6m"
Sep 17 19:07:35.909672 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:35.909647    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 17 19:07:35.909830 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:35.909655    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 17 19:07:35.910111 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:35.910096    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 19:07:35.910190 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:35.910096    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-rm5n8\""
Sep 17 19:07:35.910502 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:35.910481    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 19:07:35.910749 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:35.910736    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 19:07:35.917298 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:35.917277    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-6kh6m"]
Sep 17 19:07:35.960692 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:35.960662    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-6kh6m\" (UID: \"23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6kh6m"
Sep 17 19:07:35.960827 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:35.960708    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-6kh6m\" (UID: \"23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6kh6m"
Sep 17 19:07:35.960827 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:35.960810    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-6kh6m\" (UID: \"23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6kh6m"
Sep 17 19:07:35.960939 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:35.960837    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2skpq\" (UniqueName: \"kubernetes.io/projected/23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250-kube-api-access-2skpq\") pod \"prometheus-operator-7bd5d56d6-6kh6m\" (UID: \"23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6kh6m"
Sep 17 19:07:36.062233 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:36.062187    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-6kh6m\" (UID: \"23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6kh6m"
Sep 17 19:07:36.062417 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:36.062245    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2skpq\" (UniqueName: \"kubernetes.io/projected/23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250-kube-api-access-2skpq\") pod \"prometheus-operator-7bd5d56d6-6kh6m\" (UID: \"23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6kh6m"
Sep 17 19:07:36.062417 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:36.062284    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-6kh6m\" (UID: \"23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6kh6m"
Sep 17 19:07:36.062417 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:36.062376    2573 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 17 19:07:36.062417 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:36.062403    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-6kh6m\" (UID: \"23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6kh6m"
Sep 17 19:07:36.062623 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:36.062444    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250-prometheus-operator-tls podName:23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250 nodeName:}" failed. No retries permitted until 2026-09-17 19:07:36.562424104 +0000 UTC m=+82.501781003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250-prometheus-operator-tls") pod "prometheus-operator-7bd5d56d6-6kh6m" (UID: "23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250") : secret "prometheus-operator-tls" not found
Sep 17 19:07:36.063056 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:36.063033    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-6kh6m\" (UID: \"23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6kh6m"
Sep 17 19:07:36.065072 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:36.065050    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-6kh6m\" (UID: \"23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6kh6m"
Sep 17 19:07:36.071649 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:36.071630    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2skpq\" (UniqueName: \"kubernetes.io/projected/23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250-kube-api-access-2skpq\") pod \"prometheus-operator-7bd5d56d6-6kh6m\" (UID: \"23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6kh6m"
Sep 17 19:07:36.566411 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:36.566375    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-6kh6m\" (UID: \"23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6kh6m"
Sep 17 19:07:36.568849 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:36.568824    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-6kh6m\" (UID: \"23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6kh6m"
Sep 17 19:07:36.629436 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:36.629410    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x6b8k"
Sep 17 19:07:36.817868 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:36.817783    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6kh6m"
Sep 17 19:07:37.089238 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:37.089170    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-6kh6m"]
Sep 17 19:07:37.092325 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:07:37.092299    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a9e4c7_5f3a_4cf5_937d_e4dc74cb5250.slice/crio-72700c3cc235c06eba516300b9d175a6c09a9e2bd10bc959940857537a557538 WatchSource:0}: Error finding container 72700c3cc235c06eba516300b9d175a6c09a9e2bd10bc959940857537a557538: Status 404 returned error can't find the container with id 72700c3cc235c06eba516300b9d175a6c09a9e2bd10bc959940857537a557538
Sep 17 19:07:37.684289 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:37.684237    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6kh6m" event={"ID":"23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250","Type":"ContainerStarted","Data":"72700c3cc235c06eba516300b9d175a6c09a9e2bd10bc959940857537a557538"}
Sep 17 19:07:38.689158 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:38.689124    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6kh6m" event={"ID":"23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250","Type":"ContainerStarted","Data":"3b20ac816f02aa78fb84b6aa154eca866284fbc2951d29e021b9112779ed1f95"}
Sep 17 19:07:38.689529 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:38.689196    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6kh6m" event={"ID":"23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250","Type":"ContainerStarted","Data":"23e1c6450fc79a1d469c2b826769c90cc8fdb328063282c3d9c2d9a3c68ec19c"}
Sep 17 19:07:38.712370 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:38.712301    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-6kh6m" podStartSLOduration=2.573743704 podStartE2EDuration="3.712253864s" totalImagesPullingTime="1.13851016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:07:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:38.707562951 +0000 UTC m=+84.646919873" watchObservedRunningTime="2026-09-17 19:07:38.712253864 +0000 UTC m=+84.651610786"
Sep 17 19:07:40.376356 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.376318    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp"]
Sep 17 19:07:40.382149 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.382122    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp"
Sep 17 19:07:40.385603 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.385579    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"]
Sep 17 19:07:40.388137 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.388116    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 17 19:07:40.388280 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.388263    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-llnhp\""
Sep 17 19:07:40.389016 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.388999    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"
Sep 17 19:07:40.389501 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.389481    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 17 19:07:40.394102 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.394079    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 17 19:07:40.395457 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.395406    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 17 19:07:40.395457 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.395406    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 17 19:07:40.395570 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.395416    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-5c5q8\""
Sep 17 19:07:40.406578 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.406556    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp"]
Sep 17 19:07:40.421071 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.421050    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"]
Sep 17 19:07:40.482692 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.482661    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s4fnj"]
Sep 17 19:07:40.485809 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.485795    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.488485 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.488466    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 19:07:40.488710 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.488698    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 19:07:40.488977 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.488959    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-x7nzw\""
Sep 17 19:07:40.489252 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.489239    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 19:07:40.495308 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.495289    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-mvsxr\" (UID: \"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"
Sep 17 19:07:40.495389 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.495328    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fa7d1b2-3da3-4d27-8170-5f86beef62cb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-m4rfp\" (UID: \"4fa7d1b2-3da3-4d27-8170-5f86beef62cb\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp"
Sep 17 19:07:40.495389 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.495361    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-mvsxr\" (UID: \"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"
Sep 17 19:07:40.495499 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.495442    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fa7d1b2-3da3-4d27-8170-5f86beef62cb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-m4rfp\" (UID: \"4fa7d1b2-3da3-4d27-8170-5f86beef62cb\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp"
Sep 17 19:07:40.495499 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.495483    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fa7d1b2-3da3-4d27-8170-5f86beef62cb-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-m4rfp\" (UID: \"4fa7d1b2-3da3-4d27-8170-5f86beef62cb\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp"
Sep 17 19:07:40.495595 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.495540    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8tzn\" (UniqueName: \"kubernetes.io/projected/4fa7d1b2-3da3-4d27-8170-5f86beef62cb-kube-api-access-l8tzn\") pod \"openshift-state-metrics-86c5bc79d6-m4rfp\" (UID: \"4fa7d1b2-3da3-4d27-8170-5f86beef62cb\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp"
Sep 17 19:07:40.495595 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.495573    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mq2h\" (UniqueName: \"kubernetes.io/projected/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-kube-api-access-5mq2h\") pod \"kube-state-metrics-84c885658c-mvsxr\" (UID: \"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"
Sep 17 19:07:40.495664 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.495611    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-mvsxr\" (UID: \"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"
Sep 17 19:07:40.495664 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.495634    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-mvsxr\" (UID: \"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"
Sep 17 19:07:40.495664 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.495649    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-mvsxr\" (UID: \"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"
Sep 17 19:07:40.597020 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.596982    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hndl\" (UniqueName: \"kubernetes.io/projected/3a694491-cfec-4880-99e2-48884ae3931d-kube-api-access-2hndl\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.597020 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.597020    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-mvsxr\" (UID: \"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"
Sep 17 19:07:40.597244 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.597036    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3a694491-cfec-4880-99e2-48884ae3931d-root\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.597244 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.597062    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-mvsxr\" (UID: \"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"
Sep 17 19:07:40.597244 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.597087    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-mvsxr\" (UID: \"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"
Sep 17 19:07:40.597244 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.597138    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-mvsxr\" (UID: \"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"
Sep 17 19:07:40.597244 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.597168    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3a694491-cfec-4880-99e2-48884ae3931d-node-exporter-wtmp\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.597244 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:40.597189    2573 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 17 19:07:40.597507 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:40.597260    2573 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 17 19:07:40.597507 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:40.597266    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-kube-state-metrics-tls podName:8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d nodeName:}" failed. No retries permitted until 2026-09-17 19:07:41.097243329 +0000 UTC m=+87.036600232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-kube-state-metrics-tls") pod "kube-state-metrics-84c885658c-mvsxr" (UID: "8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d") : secret "kube-state-metrics-tls" not found
Sep 17 19:07:40.597507 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.597199    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fa7d1b2-3da3-4d27-8170-5f86beef62cb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-m4rfp\" (UID: \"4fa7d1b2-3da3-4d27-8170-5f86beef62cb\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp"
Sep 17 19:07:40.597507 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:40.597303    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fa7d1b2-3da3-4d27-8170-5f86beef62cb-openshift-state-metrics-tls podName:4fa7d1b2-3da3-4d27-8170-5f86beef62cb nodeName:}" failed. No retries permitted until 2026-09-17 19:07:41.097286565 +0000 UTC m=+87.036643463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4fa7d1b2-3da3-4d27-8170-5f86beef62cb-openshift-state-metrics-tls") pod "openshift-state-metrics-86c5bc79d6-m4rfp" (UID: "4fa7d1b2-3da3-4d27-8170-5f86beef62cb") : secret "openshift-state-metrics-tls" not found
Sep 17 19:07:40.597507 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.597327    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a694491-cfec-4880-99e2-48884ae3931d-sys\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.597507 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.597347    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-mvsxr\" (UID: \"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"
Sep 17 19:07:40.597507 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.597364    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a694491-cfec-4880-99e2-48884ae3931d-metrics-client-ca\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.597507 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.597382    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a694491-cfec-4880-99e2-48884ae3931d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.597507 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.597414    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fa7d1b2-3da3-4d27-8170-5f86beef62cb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-m4rfp\" (UID: \"4fa7d1b2-3da3-4d27-8170-5f86beef62cb\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp"
Sep 17 19:07:40.597507 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.597456    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-mvsxr\" (UID: \"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"
Sep 17 19:07:40.597507 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.597461    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fa7d1b2-3da3-4d27-8170-5f86beef62cb-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-m4rfp\" (UID: \"4fa7d1b2-3da3-4d27-8170-5f86beef62cb\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp"
Sep 17 19:07:40.598043 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.597615    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3a694491-cfec-4880-99e2-48884ae3931d-node-exporter-tls\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.598043 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.597655    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3a694491-cfec-4880-99e2-48884ae3931d-node-exporter-textfile\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.598043 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.597682    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8tzn\" (UniqueName: \"kubernetes.io/projected/4fa7d1b2-3da3-4d27-8170-5f86beef62cb-kube-api-access-l8tzn\") pod \"openshift-state-metrics-86c5bc79d6-m4rfp\" (UID: \"4fa7d1b2-3da3-4d27-8170-5f86beef62cb\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp"
Sep 17 19:07:40.598043 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.597736    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3a694491-cfec-4880-99e2-48884ae3931d-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.598043 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.597776    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mq2h\" (UniqueName: \"kubernetes.io/projected/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-kube-api-access-5mq2h\") pod \"kube-state-metrics-84c885658c-mvsxr\" (UID: \"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"
Sep 17 19:07:40.598043 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.597916    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-mvsxr\" (UID: \"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"
Sep 17 19:07:40.598268 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.598084    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-mvsxr\" (UID: \"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"
Sep 17 19:07:40.598268 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.598181    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fa7d1b2-3da3-4d27-8170-5f86beef62cb-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-m4rfp\" (UID: \"4fa7d1b2-3da3-4d27-8170-5f86beef62cb\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp"
Sep 17 19:07:40.599764 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.599747    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-mvsxr\" (UID: \"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"
Sep 17 19:07:40.600105 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.600084    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fa7d1b2-3da3-4d27-8170-5f86beef62cb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-m4rfp\" (UID: \"4fa7d1b2-3da3-4d27-8170-5f86beef62cb\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp"
Sep 17 19:07:40.622930 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.622902    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mq2h\" (UniqueName: \"kubernetes.io/projected/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-kube-api-access-5mq2h\") pod \"kube-state-metrics-84c885658c-mvsxr\" (UID: \"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"
Sep 17 19:07:40.623690 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.623666    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8tzn\" (UniqueName: \"kubernetes.io/projected/4fa7d1b2-3da3-4d27-8170-5f86beef62cb-kube-api-access-l8tzn\") pod \"openshift-state-metrics-86c5bc79d6-m4rfp\" (UID: \"4fa7d1b2-3da3-4d27-8170-5f86beef62cb\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp"
Sep 17 19:07:40.698186 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.698157    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3a694491-cfec-4880-99e2-48884ae3931d-node-exporter-textfile\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.698361 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.698192    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3a694491-cfec-4880-99e2-48884ae3931d-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.698361 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.698230    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hndl\" (UniqueName: \"kubernetes.io/projected/3a694491-cfec-4880-99e2-48884ae3931d-kube-api-access-2hndl\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.698361 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.698186    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657b7dd685-74msc" event={"ID":"6cc32d66-cfc0-4e8d-b32a-7f3e076b6767","Type":"ContainerStarted","Data":"db787e09e9a4e4652b58c655ad2905307e6b1da1cc0bb3d416d564d32bfd917a"}
Sep 17 19:07:40.698361 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.698263    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3a694491-cfec-4880-99e2-48884ae3931d-root\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.698361 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.698300    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3a694491-cfec-4880-99e2-48884ae3931d-node-exporter-wtmp\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.698361 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.698335    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a694491-cfec-4880-99e2-48884ae3931d-sys\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.698361 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.698344    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3a694491-cfec-4880-99e2-48884ae3931d-root\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.698361 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.698362    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a694491-cfec-4880-99e2-48884ae3931d-metrics-client-ca\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.698672 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.698388    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a694491-cfec-4880-99e2-48884ae3931d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.698672 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.698401    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a694491-cfec-4880-99e2-48884ae3931d-sys\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.698672 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.698447    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3a694491-cfec-4880-99e2-48884ae3931d-node-exporter-tls\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.698672 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.698487    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3a694491-cfec-4880-99e2-48884ae3931d-node-exporter-wtmp\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.698820 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.698803    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657b7dd685-74msc"
Sep 17 19:07:40.698871 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.698841    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3a694491-cfec-4880-99e2-48884ae3931d-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.698961 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.698945    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a694491-cfec-4880-99e2-48884ae3931d-metrics-client-ca\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.699007 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.698966    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3a694491-cfec-4880-99e2-48884ae3931d-node-exporter-textfile\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.700534 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.700515    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657b7dd685-74msc"
Sep 17 19:07:40.700827 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.700812    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3a694491-cfec-4880-99e2-48884ae3931d-node-exporter-tls\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.701001 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.700983    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a694491-cfec-4880-99e2-48884ae3931d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.719532 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.719509    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hndl\" (UniqueName: \"kubernetes.io/projected/3a694491-cfec-4880-99e2-48884ae3931d-kube-api-access-2hndl\") pod \"node-exporter-s4fnj\" (UID: \"3a694491-cfec-4880-99e2-48884ae3931d\") " pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.729764 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.729716    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657b7dd685-74msc" podStartSLOduration=1.848442323 podStartE2EDuration="7.72969989s" totalImagesPullingTime="5.881257567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:40.72943296 +0000 UTC m=+86.668789881" watchObservedRunningTime="2026-09-17 19:07:40.72969989 +0000 UTC m=+86.669056812"
Sep 17 19:07:40.795380 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:40.795351    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s4fnj"
Sep 17 19:07:40.808742 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:07:40.808718    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a694491_cfec_4880_99e2_48884ae3931d.slice/crio-c87e6d70c8adc919e54170d4f9d5892e56f3ecc6a79be9e3f5af7ff78be875f2 WatchSource:0}: Error finding container c87e6d70c8adc919e54170d4f9d5892e56f3ecc6a79be9e3f5af7ff78be875f2: Status 404 returned error can't find the container with id c87e6d70c8adc919e54170d4f9d5892e56f3ecc6a79be9e3f5af7ff78be875f2
Sep 17 19:07:41.101277 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.101201    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-mvsxr\" (UID: \"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"
Sep 17 19:07:41.101277 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.101243    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fa7d1b2-3da3-4d27-8170-5f86beef62cb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-m4rfp\" (UID: \"4fa7d1b2-3da3-4d27-8170-5f86beef62cb\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp"
Sep 17 19:07:41.101445 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:41.101349    2573 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 17 19:07:41.101445 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:41.101350    2573 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 17 19:07:41.101445 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:41.101401    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fa7d1b2-3da3-4d27-8170-5f86beef62cb-openshift-state-metrics-tls podName:4fa7d1b2-3da3-4d27-8170-5f86beef62cb nodeName:}" failed. No retries permitted until 2026-09-17 19:07:42.101389117 +0000 UTC m=+88.040746015 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4fa7d1b2-3da3-4d27-8170-5f86beef62cb-openshift-state-metrics-tls") pod "openshift-state-metrics-86c5bc79d6-m4rfp" (UID: "4fa7d1b2-3da3-4d27-8170-5f86beef62cb") : secret "openshift-state-metrics-tls" not found
Sep 17 19:07:41.101445 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:41.101416    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-kube-state-metrics-tls podName:8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d nodeName:}" failed. No retries permitted until 2026-09-17 19:07:42.101410191 +0000 UTC m=+88.040767091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-kube-state-metrics-tls") pod "kube-state-metrics-84c885658c-mvsxr" (UID: "8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d") : secret "kube-state-metrics-tls" not found
Sep 17 19:07:41.485157 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.485118    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 19:07:41.490283 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.490256    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.494118 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.494038    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 17 19:07:41.494232 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.494159    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 17 19:07:41.494287 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.494256    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 17 19:07:41.494394 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.494377    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 17 19:07:41.494635 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.494615    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 17 19:07:41.494733 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.494707    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 17 19:07:41.494901 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.494858    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hd7gk\""
Sep 17 19:07:41.495073 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.495043    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 17 19:07:41.495156 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.495121    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 17 19:07:41.495383 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.495364    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 17 19:07:41.510723 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.510703    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 19:07:41.604871 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.604837    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.605094 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.604926    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a6aa495-7a48-4dad-a120-0094bbfa2812-config-out\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.605094 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.604955    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a6aa495-7a48-4dad-a120-0094bbfa2812-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.605094 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.604986    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.605094 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.605039    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-config-volume\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.605094 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.605063    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a6aa495-7a48-4dad-a120-0094bbfa2812-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.605261 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.605113    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-web-config\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.605261 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.605131    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a6aa495-7a48-4dad-a120-0094bbfa2812-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.605261 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.605145    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.605261 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.605159    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9a6aa495-7a48-4dad-a120-0094bbfa2812-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.605261 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.605179    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.605261 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.605193    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.605261 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.605210    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2djph\" (UniqueName: \"kubernetes.io/projected/9a6aa495-7a48-4dad-a120-0094bbfa2812-kube-api-access-2djph\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.702527 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.702498    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4fnj" event={"ID":"3a694491-cfec-4880-99e2-48884ae3931d","Type":"ContainerStarted","Data":"c87e6d70c8adc919e54170d4f9d5892e56f3ecc6a79be9e3f5af7ff78be875f2"}
Sep 17 19:07:41.706044 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.706025    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a6aa495-7a48-4dad-a120-0094bbfa2812-config-out\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.706087 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.706054    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a6aa495-7a48-4dad-a120-0094bbfa2812-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.706087 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.706072    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.706181 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.706097    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-config-volume\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.706250 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.706232    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a6aa495-7a48-4dad-a120-0094bbfa2812-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.706317 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.706301    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-web-config\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.706371 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.706335    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a6aa495-7a48-4dad-a120-0094bbfa2812-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.706371 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.706363    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.706473 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.706388    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9a6aa495-7a48-4dad-a120-0094bbfa2812-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.706473 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.706417    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.706473 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.706440    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.706473 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.706466    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2djph\" (UniqueName: \"kubernetes.io/projected/9a6aa495-7a48-4dad-a120-0094bbfa2812-kube-api-access-2djph\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.706670 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.706544    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.707606 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.707254    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a6aa495-7a48-4dad-a120-0094bbfa2812-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.709120 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.709089    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9a6aa495-7a48-4dad-a120-0094bbfa2812-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.709254 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.709231    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a6aa495-7a48-4dad-a120-0094bbfa2812-config-out\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.709506 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.709477    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.709591 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.709485    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-config-volume\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.709961 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.709942    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a6aa495-7a48-4dad-a120-0094bbfa2812-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.710324 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.710298    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.710862 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.710844    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a6aa495-7a48-4dad-a120-0094bbfa2812-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.710988 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.710966    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.711052 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.710974    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.711393 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.711371    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.711765 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.711749    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-web-config\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.718141 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.718121    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2djph\" (UniqueName: \"kubernetes.io/projected/9a6aa495-7a48-4dad-a120-0094bbfa2812-kube-api-access-2djph\") pod \"alertmanager-main-0\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:41.801590 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:41.801561    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:07:42.088332 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:42.088296    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 19:07:42.090645 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:07:42.090613    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a6aa495_7a48_4dad_a120_0094bbfa2812.slice/crio-459503ab367fb68c7f6c7f2669e15b45af0e66ad83d267aaa9e985fb3aa73ea6 WatchSource:0}: Error finding container 459503ab367fb68c7f6c7f2669e15b45af0e66ad83d267aaa9e985fb3aa73ea6: Status 404 returned error can't find the container with id 459503ab367fb68c7f6c7f2669e15b45af0e66ad83d267aaa9e985fb3aa73ea6
Sep 17 19:07:42.110271 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:42.110245    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-mvsxr\" (UID: \"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"
Sep 17 19:07:42.110359 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:42.110295    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fa7d1b2-3da3-4d27-8170-5f86beef62cb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-m4rfp\" (UID: \"4fa7d1b2-3da3-4d27-8170-5f86beef62cb\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp"
Sep 17 19:07:42.112800 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:42.112775    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fa7d1b2-3da3-4d27-8170-5f86beef62cb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-m4rfp\" (UID: \"4fa7d1b2-3da3-4d27-8170-5f86beef62cb\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp"
Sep 17 19:07:42.112916 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:42.112775    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-mvsxr\" (UID: \"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"
Sep 17 19:07:42.121789 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:42.121766    2573 patch_prober.go:28] interesting pod/image-registry-7dc6c7b94f-shpbb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 19:07:42.121896 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:42.121810    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb" podUID="d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 19:07:42.191926 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:42.191901    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp"
Sep 17 19:07:42.197992 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:42.197974    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"
Sep 17 19:07:42.488845 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:42.488818    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp"]
Sep 17 19:07:42.490535 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:07:42.490505    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fa7d1b2_3da3_4d27_8170_5f86beef62cb.slice/crio-9ccf5eed1b13a2befef4244be16ebc8a7b45c0f3b7921e353ad79af0926a9d77 WatchSource:0}: Error finding container 9ccf5eed1b13a2befef4244be16ebc8a7b45c0f3b7921e353ad79af0926a9d77: Status 404 returned error can't find the container with id 9ccf5eed1b13a2befef4244be16ebc8a7b45c0f3b7921e353ad79af0926a9d77
Sep 17 19:07:42.499864 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:42.499844    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-mvsxr"]
Sep 17 19:07:42.503270 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:07:42.503246    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ec5ed87_0c2c_4ec6_89ca_2785e3104f6d.slice/crio-5570fb9b7ea4d02669bb37414b8923e0c6722389d14e3a405f73c9fd8204272f WatchSource:0}: Error finding container 5570fb9b7ea4d02669bb37414b8923e0c6722389d14e3a405f73c9fd8204272f: Status 404 returned error can't find the container with id 5570fb9b7ea4d02669bb37414b8923e0c6722389d14e3a405f73c9fd8204272f
Sep 17 19:07:42.707149 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:42.707112    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a6aa495-7a48-4dad-a120-0094bbfa2812","Type":"ContainerStarted","Data":"459503ab367fb68c7f6c7f2669e15b45af0e66ad83d267aaa9e985fb3aa73ea6"}
Sep 17 19:07:42.708438 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:42.708410    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr" event={"ID":"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d","Type":"ContainerStarted","Data":"5570fb9b7ea4d02669bb37414b8923e0c6722389d14e3a405f73c9fd8204272f"}
Sep 17 19:07:42.710444 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:42.710418    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp" event={"ID":"4fa7d1b2-3da3-4d27-8170-5f86beef62cb","Type":"ContainerStarted","Data":"b908ef1ad324e34ddf6a7e6f9360c586b7d01cb38c20699a7868d31c2d5be9f4"}
Sep 17 19:07:42.710537 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:42.710465    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp" event={"ID":"4fa7d1b2-3da3-4d27-8170-5f86beef62cb","Type":"ContainerStarted","Data":"6a3accfb07058ee3c5e5ea7b375c621dacb862858fbc5c450b0e799627208e48"}
Sep 17 19:07:42.710537 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:42.710489    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp" event={"ID":"4fa7d1b2-3da3-4d27-8170-5f86beef62cb","Type":"ContainerStarted","Data":"9ccf5eed1b13a2befef4244be16ebc8a7b45c0f3b7921e353ad79af0926a9d77"}
Sep 17 19:07:42.711930 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:42.711903    2573 generic.go:356] "Generic (PLEG): container finished" podID="3a694491-cfec-4880-99e2-48884ae3931d" containerID="37e6de4c72401b78933333ef7dc1ec9c3f05e06a606f2aaaade2e75791c978eb" exitCode=0
Sep 17 19:07:42.712018 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:42.711979    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4fnj" event={"ID":"3a694491-cfec-4880-99e2-48884ae3931d","Type":"ContainerDied","Data":"37e6de4c72401b78933333ef7dc1ec9c3f05e06a606f2aaaade2e75791c978eb"}
Sep 17 19:07:43.612475 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:43.612448    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:07:43.719266 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:43.719231    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4fnj" event={"ID":"3a694491-cfec-4880-99e2-48884ae3931d","Type":"ContainerStarted","Data":"7936db10888d6c01744c2760a6f43a9d12a34af03bdc93c97a8dfff2fb5d9c99"}
Sep 17 19:07:43.719423 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:43.719292    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4fnj" event={"ID":"3a694491-cfec-4880-99e2-48884ae3931d","Type":"ContainerStarted","Data":"1765b182f186693a1c1b969039f391b3a804b1764919000ab25896b3157777ef"}
Sep 17 19:07:43.721199 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:43.721169    2573 generic.go:356] "Generic (PLEG): container finished" podID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerID="cfe3b723082172118f2dea421e2eb8b935e45354a1367b3e5c8f40719e76411d" exitCode=0
Sep 17 19:07:43.721312 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:43.721259    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a6aa495-7a48-4dad-a120-0094bbfa2812","Type":"ContainerDied","Data":"cfe3b723082172118f2dea421e2eb8b935e45354a1367b3e5c8f40719e76411d"}
Sep 17 19:07:43.743024 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:43.742970    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s4fnj" podStartSLOduration=2.779795827 podStartE2EDuration="3.742949268s" totalImagesPullingTime="887.20031ms" totalInitContainerRuntime="75.953131ms" isStatefulPod=true podCreationTimestamp="2026-09-17 19:07:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:43.741976745 +0000 UTC m=+89.681333676" watchObservedRunningTime="2026-09-17 19:07:43.742949268 +0000 UTC m=+89.682306188"
Sep 17 19:07:44.728198 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:44.728160    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr" event={"ID":"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d","Type":"ContainerStarted","Data":"8ca7b3d831b2042701b4ca33f093150ec3cdb87b8754f39945a6cef200dc10cb"}
Sep 17 19:07:44.728648 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:44.728229    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr" event={"ID":"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d","Type":"ContainerStarted","Data":"a241a26f30ac5cc908e04b5a4945af92b3f14948f51e0080bd9a2e3e31f4eeac"}
Sep 17 19:07:44.728648 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:44.728254    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr" event={"ID":"8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d","Type":"ContainerStarted","Data":"9794bf6f27a595f01955a3cc19efb8424aba18911f4055c88b6522a9049f2cea"}
Sep 17 19:07:44.730837 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:44.730808    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp" event={"ID":"4fa7d1b2-3da3-4d27-8170-5f86beef62cb","Type":"ContainerStarted","Data":"405438b50b3de453b3fc06381493ee05f9f5df49452277ae9071b4b8bfb6bca7"}
Sep 17 19:07:44.751784 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:44.751725    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-mvsxr" podStartSLOduration=3.3562099 podStartE2EDuration="4.751701269s" totalImagesPullingTime="1.395491369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:07:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:44.750042322 +0000 UTC m=+90.689399246" watchObservedRunningTime="2026-09-17 19:07:44.751701269 +0000 UTC m=+90.691058193"
Sep 17 19:07:44.768765 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:44.768708    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-m4rfp" podStartSLOduration=3.486647731 podStartE2EDuration="4.768685874s" totalImagesPullingTime="1.282038143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:07:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:44.767433173 +0000 UTC m=+90.706790095" watchObservedRunningTime="2026-09-17 19:07:44.768685874 +0000 UTC m=+90.708042796"
Sep 17 19:07:45.059901 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:45.059807    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-rwb54"]
Sep 17 19:07:45.064409 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:45.064367    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-rwb54"
Sep 17 19:07:45.070114 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:45.070088    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-dnzvm\""
Sep 17 19:07:45.070395 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:45.070375    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 17 19:07:45.079925 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:45.079826    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-rwb54"]
Sep 17 19:07:45.143116 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:45.143076    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nqgv\" (UniqueName: \"kubernetes.io/projected/dcc12a90-74bc-431f-ae89-32e0e3f5aceb-kube-api-access-5nqgv\") pod \"monitoring-plugin-5984459ff8-rwb54\" (UID: \"dcc12a90-74bc-431f-ae89-32e0e3f5aceb\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-rwb54"
Sep 17 19:07:45.143299 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:45.143139    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dcc12a90-74bc-431f-ae89-32e0e3f5aceb-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-rwb54\" (UID: \"dcc12a90-74bc-431f-ae89-32e0e3f5aceb\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-rwb54"
Sep 17 19:07:45.243845 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:45.243816    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nqgv\" (UniqueName: \"kubernetes.io/projected/dcc12a90-74bc-431f-ae89-32e0e3f5aceb-kube-api-access-5nqgv\") pod \"monitoring-plugin-5984459ff8-rwb54\" (UID: \"dcc12a90-74bc-431f-ae89-32e0e3f5aceb\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-rwb54"
Sep 17 19:07:45.243976 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:45.243867    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dcc12a90-74bc-431f-ae89-32e0e3f5aceb-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-rwb54\" (UID: \"dcc12a90-74bc-431f-ae89-32e0e3f5aceb\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-rwb54"
Sep 17 19:07:45.244026 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:45.244000    2573 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 17 19:07:45.244076 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:45.244065    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc12a90-74bc-431f-ae89-32e0e3f5aceb-monitoring-plugin-cert podName:dcc12a90-74bc-431f-ae89-32e0e3f5aceb nodeName:}" failed. No retries permitted until 2026-09-17 19:07:45.74404403 +0000 UTC m=+91.683400932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/dcc12a90-74bc-431f-ae89-32e0e3f5aceb-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-rwb54" (UID: "dcc12a90-74bc-431f-ae89-32e0e3f5aceb") : secret "monitoring-plugin-cert" not found
Sep 17 19:07:45.263127 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:45.263090    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nqgv\" (UniqueName: \"kubernetes.io/projected/dcc12a90-74bc-431f-ae89-32e0e3f5aceb-kube-api-access-5nqgv\") pod \"monitoring-plugin-5984459ff8-rwb54\" (UID: \"dcc12a90-74bc-431f-ae89-32e0e3f5aceb\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-rwb54"
Sep 17 19:07:45.737721 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:45.737687    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a6aa495-7a48-4dad-a120-0094bbfa2812","Type":"ContainerStarted","Data":"11b724f299d1a3d3c0dd58d7417eb9baa4a7e48a3f63f8a0a04b1b753a058659"}
Sep 17 19:07:45.738104 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:45.737753    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a6aa495-7a48-4dad-a120-0094bbfa2812","Type":"ContainerStarted","Data":"c023bc6725205d5ae6955971cc209d502fb6ffceac8ebd0c4bb9d8cea7951604"}
Sep 17 19:07:45.738104 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:45.737777    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a6aa495-7a48-4dad-a120-0094bbfa2812","Type":"ContainerStarted","Data":"703f2c14d92f00316975bb25fb422ff72e4090ffd24b942030514472fb216455"}
Sep 17 19:07:45.738104 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:45.737800    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a6aa495-7a48-4dad-a120-0094bbfa2812","Type":"ContainerStarted","Data":"65ee490ca29b1568445c66ba0ef6b989e726913fb1607d55997bff13906bb59a"}
Sep 17 19:07:45.738104 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:45.737824    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a6aa495-7a48-4dad-a120-0094bbfa2812","Type":"ContainerStarted","Data":"5931de90a2d1d6bca4fc34ad9c425f30f081fbf49c6ad01bb2aa448a7f7b8797"}
Sep 17 19:07:45.748410 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:45.748384    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dcc12a90-74bc-431f-ae89-32e0e3f5aceb-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-rwb54\" (UID: \"dcc12a90-74bc-431f-ae89-32e0e3f5aceb\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-rwb54"
Sep 17 19:07:45.748523 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:45.748486    2573 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 17 19:07:45.748561 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:07:45.748532    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc12a90-74bc-431f-ae89-32e0e3f5aceb-monitoring-plugin-cert podName:dcc12a90-74bc-431f-ae89-32e0e3f5aceb nodeName:}" failed. No retries permitted until 2026-09-17 19:07:46.748519197 +0000 UTC m=+92.687876110 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/dcc12a90-74bc-431f-ae89-32e0e3f5aceb-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-rwb54" (UID: "dcc12a90-74bc-431f-ae89-32e0e3f5aceb") : secret "monitoring-plugin-cert" not found
Sep 17 19:07:46.747093 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.747049    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a6aa495-7a48-4dad-a120-0094bbfa2812","Type":"ContainerStarted","Data":"ca92616afa11e7c3f3c2dc88bfa525c7c9d5f639388894aa073689fae9649385"}
Sep 17 19:07:46.755125 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.755081    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dcc12a90-74bc-431f-ae89-32e0e3f5aceb-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-rwb54\" (UID: \"dcc12a90-74bc-431f-ae89-32e0e3f5aceb\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-rwb54"
Sep 17 19:07:46.757786 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.757755    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 19:07:46.759091 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.759065    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dcc12a90-74bc-431f-ae89-32e0e3f5aceb-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-rwb54\" (UID: \"dcc12a90-74bc-431f-ae89-32e0e3f5aceb\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-rwb54"
Sep 17 19:07:46.762292 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.762266    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.768359 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.768324    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 17 19:07:46.768359 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.768349    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 17 19:07:46.768547 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.768418    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 17 19:07:46.768547 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.768471    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 17 19:07:46.768547 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.768495    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 17 19:07:46.769058 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.769032    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 17 19:07:46.769156 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.769047    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 17 19:07:46.769523 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.769495    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 17 19:07:46.769682 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.769530    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 17 19:07:46.769845 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.769572    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-94i4p6479prfd\""
Sep 17 19:07:46.770031 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.769572    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 17 19:07:46.770173 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.769620    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 17 19:07:46.772668 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.772645    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 17 19:07:46.772783 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.772764    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sf496\""
Sep 17 19:07:46.774169 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.774150    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 17 19:07:46.774483 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.774389    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 17 19:07:46.775975 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.775954    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 17 19:07:46.786351 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.786294    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.617143216 podStartE2EDuration="5.786274167s" totalImagesPullingTime="3.149966832s" totalInitContainerRuntime="19.164119ms" isStatefulPod=false podCreationTimestamp="2026-09-17 19:07:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:46.7848948 +0000 UTC m=+92.724251716" watchObservedRunningTime="2026-09-17 19:07:46.786274167 +0000 UTC m=+92.725631089"
Sep 17 19:07:46.791787 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.791168    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 19:07:46.856205 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.856160    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.856405 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.856212    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.856405 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.856269    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.856405 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.856314    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.856405 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.856341    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.856405 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.856367    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-web-config\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.856405 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.856405    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-config\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.856707 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.856585    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.856707 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.856632    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sqw7\" (UniqueName: \"kubernetes.io/projected/07b7f939-d25b-4d41-afbe-dd869d80145b-kube-api-access-4sqw7\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.856707 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.856655    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.856707 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.856700    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.856927 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.856724    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.857012 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.856984    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.857074 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.857053    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.857128 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.857076    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.857128 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.857122    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07b7f939-d25b-4d41-afbe-dd869d80145b-config-out\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.857233 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.857137    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.857233 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.857156    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07b7f939-d25b-4d41-afbe-dd869d80145b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.857233 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.857200    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.857377 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.857229    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.874505 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.874480    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-rwb54"
Sep 17 19:07:46.959170 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.959126    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.959339 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.959179    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.959339 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.959208    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.959339 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.959243    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07b7f939-d25b-4d41-afbe-dd869d80145b-config-out\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.959339 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.959262    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.959339 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.959287    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07b7f939-d25b-4d41-afbe-dd869d80145b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.959339 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.959311    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.959339 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.959334    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.959705 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.959371    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.959705 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.959398    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.959705 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.959427    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.959705 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.959451    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.959705 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.959477    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.959705 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.959499    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-web-config\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.959705 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.959534    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-config\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.959705 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.959571    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.959705 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.959604    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sqw7\" (UniqueName: \"kubernetes.io/projected/07b7f939-d25b-4d41-afbe-dd869d80145b-kube-api-access-4sqw7\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.959705 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.959631    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.960233 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.960050    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.960290 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.960249    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.960344 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.960305    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.960394 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.960354    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.960455 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.960388    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.960593 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.960570    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.961717 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.961472    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.962355 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.962008    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.962860 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.962686    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.963145 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.963048    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07b7f939-d25b-4d41-afbe-dd869d80145b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.964487 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.964462    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.965342 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.964923    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-web-config\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.965342 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.965291    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.965571 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.965506    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.965571 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.965527    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.965706 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.965633    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07b7f939-d25b-4d41-afbe-dd869d80145b-config-out\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.966227 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.966182    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.966368 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.966324    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.966681 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.966657    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.966754 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.966737    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-config\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.967125 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.967087    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:46.978436 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:46.978415    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sqw7\" (UniqueName: \"kubernetes.io/projected/07b7f939-d25b-4d41-afbe-dd869d80145b-kube-api-access-4sqw7\") pod \"prometheus-k8s-0\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:47.077592 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:47.077180    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:47.157567 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:47.156368    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-rwb54"]
Sep 17 19:07:47.372486 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:47.372456    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 19:07:47.374172 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:07:47.374146    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07b7f939_d25b_4d41_afbe_dd869d80145b.slice/crio-be30f922574e94ef76f21b6056c84b57f34738fb71966e6715bc23a372edc376 WatchSource:0}: Error finding container be30f922574e94ef76f21b6056c84b57f34738fb71966e6715bc23a372edc376: Status 404 returned error can't find the container with id be30f922574e94ef76f21b6056c84b57f34738fb71966e6715bc23a372edc376
Sep 17 19:07:47.754441 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:47.754395    2573 generic.go:356] "Generic (PLEG): container finished" podID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerID="713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293" exitCode=0
Sep 17 19:07:47.754919 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:47.754488    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"07b7f939-d25b-4d41-afbe-dd869d80145b","Type":"ContainerDied","Data":"713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293"}
Sep 17 19:07:47.754919 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:47.754579    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"07b7f939-d25b-4d41-afbe-dd869d80145b","Type":"ContainerStarted","Data":"be30f922574e94ef76f21b6056c84b57f34738fb71966e6715bc23a372edc376"}
Sep 17 19:07:47.756312 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:47.756263    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-rwb54" event={"ID":"dcc12a90-74bc-431f-ae89-32e0e3f5aceb","Type":"ContainerStarted","Data":"0282c2c8cdfe41afe3ecf5c5ce18894d915e4f83956641aadfb1cbd582037c08"}
Sep 17 19:07:48.763261 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:48.763227    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-rwb54" event={"ID":"dcc12a90-74bc-431f-ae89-32e0e3f5aceb","Type":"ContainerStarted","Data":"e08d14260ca89170789ed2ed2279e8829bc24c82fac4567c014e8dc75a01df35"}
Sep 17 19:07:48.763716 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:48.763419    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-rwb54"
Sep 17 19:07:48.769356 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:48.769329    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-rwb54"
Sep 17 19:07:48.782344 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:48.782294    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-rwb54" podStartSLOduration=2.530634949 podStartE2EDuration="3.782273606s" totalImagesPullingTime="1.251638657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:48.780930093 +0000 UTC m=+94.720287016" watchObservedRunningTime="2026-09-17 19:07:48.782273606 +0000 UTC m=+94.721630532"
Sep 17 19:07:51.782318 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:51.782280    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"07b7f939-d25b-4d41-afbe-dd869d80145b","Type":"ContainerStarted","Data":"1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f"}
Sep 17 19:07:51.782743 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:51.782366    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"07b7f939-d25b-4d41-afbe-dd869d80145b","Type":"ContainerStarted","Data":"519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28"}
Sep 17 19:07:53.796096 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:53.796058    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"07b7f939-d25b-4d41-afbe-dd869d80145b","Type":"ContainerStarted","Data":"46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc"}
Sep 17 19:07:53.796548 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:53.796130    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"07b7f939-d25b-4d41-afbe-dd869d80145b","Type":"ContainerStarted","Data":"02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6"}
Sep 17 19:07:53.796548 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:53.796158    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"07b7f939-d25b-4d41-afbe-dd869d80145b","Type":"ContainerStarted","Data":"5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06"}
Sep 17 19:07:53.796548 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:53.796188    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"07b7f939-d25b-4d41-afbe-dd869d80145b","Type":"ContainerStarted","Data":"4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae"}
Sep 17 19:07:53.833903 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:53.833732    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.720940359 podStartE2EDuration="7.833710212s" totalImagesPullingTime="5.093848217s" totalInitContainerRuntime="18.921636ms" isStatefulPod=false podCreationTimestamp="2026-09-17 19:07:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:53.831244421 +0000 UTC m=+99.770601340" watchObservedRunningTime="2026-09-17 19:07:53.833710212 +0000 UTC m=+99.773067143"
Sep 17 19:07:55.605829 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:55.605791    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dc6c7b94f-shpbb"]
Sep 17 19:07:57.077738 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:57.077699    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:07:59.637697 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:07:59.637660    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nw2xp"
Sep 17 19:08:18.473282 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:18.473248    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a6aa495-7a48-4dad-a120-0094bbfa2812/init-config-reloader/0.log"
Sep 17 19:08:18.482260 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:18.482236    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a6aa495-7a48-4dad-a120-0094bbfa2812/alertmanager/0.log"
Sep 17 19:08:18.577685 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:18.577658    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a6aa495-7a48-4dad-a120-0094bbfa2812/config-reloader/0.log"
Sep 17 19:08:18.777163 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:18.777088    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a6aa495-7a48-4dad-a120-0094bbfa2812/kube-rbac-proxy-web/0.log"
Sep 17 19:08:18.977561 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:18.977524    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a6aa495-7a48-4dad-a120-0094bbfa2812/kube-rbac-proxy/0.log"
Sep 17 19:08:19.177738 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:19.177657    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a6aa495-7a48-4dad-a120-0094bbfa2812/kube-rbac-proxy-metric/0.log"
Sep 17 19:08:19.377144 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:19.377121    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a6aa495-7a48-4dad-a120-0094bbfa2812/prom-label-proxy/0.log"
Sep 17 19:08:19.778906 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:19.778852    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-mvsxr_8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d/kube-state-metrics/0.log"
Sep 17 19:08:19.977393 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:19.977367    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-mvsxr_8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d/kube-rbac-proxy-main/0.log"
Sep 17 19:08:20.177569 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.177476    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-mvsxr_8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d/kube-rbac-proxy-self/0.log"
Sep 17 19:08:20.578087 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.578049    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-rwb54_dcc12a90-74bc-431f-ae89-32e0e3f5aceb/monitoring-plugin/0.log"
Sep 17 19:08:20.628328 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.628286    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb" podUID="d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0" containerName="registry" containerID="cri-o://41410fead169ef235a2783bb5d95c2acc9199bfe92e3917dab45276806c62358" gracePeriod=30
Sep 17 19:08:20.870496 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.870468    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:08:20.907000 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.906970    2573 generic.go:356] "Generic (PLEG): container finished" podID="d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0" containerID="41410fead169ef235a2783bb5d95c2acc9199bfe92e3917dab45276806c62358" exitCode=0
Sep 17 19:08:20.907151 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.907014    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb"
Sep 17 19:08:20.907151 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.907051    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb" event={"ID":"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0","Type":"ContainerDied","Data":"41410fead169ef235a2783bb5d95c2acc9199bfe92e3917dab45276806c62358"}
Sep 17 19:08:20.907151 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.907118    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dc6c7b94f-shpbb" event={"ID":"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0","Type":"ContainerDied","Data":"d4e33783be4315635e861e26b453003eb4a78e1cf38d61bef44161d109d1ac1a"}
Sep 17 19:08:20.907253 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.907155    2573 scope.go:117] "RemoveContainer" containerID="41410fead169ef235a2783bb5d95c2acc9199bfe92e3917dab45276806c62358"
Sep 17 19:08:20.917116 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.917098    2573 scope.go:117] "RemoveContainer" containerID="41410fead169ef235a2783bb5d95c2acc9199bfe92e3917dab45276806c62358"
Sep 17 19:08:20.917438 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:08:20.917411    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41410fead169ef235a2783bb5d95c2acc9199bfe92e3917dab45276806c62358\": container with ID starting with 41410fead169ef235a2783bb5d95c2acc9199bfe92e3917dab45276806c62358 not found: ID does not exist" containerID="41410fead169ef235a2783bb5d95c2acc9199bfe92e3917dab45276806c62358"
Sep 17 19:08:20.917507 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.917451    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41410fead169ef235a2783bb5d95c2acc9199bfe92e3917dab45276806c62358"} err="failed to get container status \"41410fead169ef235a2783bb5d95c2acc9199bfe92e3917dab45276806c62358\": rpc error: code = NotFound desc = could not find container \"41410fead169ef235a2783bb5d95c2acc9199bfe92e3917dab45276806c62358\": container with ID starting with 41410fead169ef235a2783bb5d95c2acc9199bfe92e3917dab45276806c62358 not found: ID does not exist"
Sep 17 19:08:20.964874 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.964846    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wf6qs\" (UniqueName: \"kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-kube-api-access-wf6qs\") pod \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") "
Sep 17 19:08:20.965005 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.964900    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-image-registry-private-configuration\") pod \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") "
Sep 17 19:08:20.965005 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.964924    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls\") pod \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") "
Sep 17 19:08:20.965005 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.964952    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-ca-trust-extracted\") pod \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") "
Sep 17 19:08:20.965005 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.964992    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-installation-pull-secrets\") pod \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") "
Sep 17 19:08:20.965201 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.965058    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-certificates\") pod \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") "
Sep 17 19:08:20.965201 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.965105    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-bound-sa-token\") pod \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") "
Sep 17 19:08:20.965201 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.965142    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-trusted-ca\") pod \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\" (UID: \"d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0\") "
Sep 17 19:08:20.965804 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.965776    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0" (UID: "d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:08:20.965926 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.965526    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0" (UID: "d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:08:20.967610 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.967581    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-kube-api-access-wf6qs" (OuterVolumeSpecName: "kube-api-access-wf6qs") pod "d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0" (UID: "d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0"). InnerVolumeSpecName "kube-api-access-wf6qs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:08:20.967713 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.967676    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0" (UID: "d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:08:20.967793 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.967775    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0" (UID: "d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:08:20.967919 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.967892    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0" (UID: "d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:08:20.968034 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.967973    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0" (UID: "d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:08:20.973452 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:20.973424    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0" (UID: "d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 19:08:21.066528 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:21.066496    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-trusted-ca\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:08:21.066528 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:21.066521    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wf6qs\" (UniqueName: \"kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-kube-api-access-wf6qs\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:08:21.066685 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:21.066533    2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-image-registry-private-configuration\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:08:21.066685 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:21.066544    2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-tls\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:08:21.066685 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:21.066552    2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-ca-trust-extracted\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:08:21.066685 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:21.066559    2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-installation-pull-secrets\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:08:21.066685 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:21.066567    2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-registry-certificates\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:08:21.066685 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:21.066575    2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0-bound-sa-token\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:08:21.229558 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:21.229511    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dc6c7b94f-shpbb"]
Sep 17 19:08:21.235449 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:21.235427    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7dc6c7b94f-shpbb"]
Sep 17 19:08:21.977578 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:21.977547    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4fnj_3a694491-cfec-4880-99e2-48884ae3931d/init-textfile/0.log"
Sep 17 19:08:22.178068 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:22.178030    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4fnj_3a694491-cfec-4880-99e2-48884ae3931d/node-exporter/0.log"
Sep 17 19:08:22.225388 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:22.225354    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0" path="/var/lib/kubelet/pods/d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0/volumes"
Sep 17 19:08:22.382700 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:22.382616    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4fnj_3a694491-cfec-4880-99e2-48884ae3931d/kube-rbac-proxy/0.log"
Sep 17 19:08:22.577947 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:22.577921    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-m4rfp_4fa7d1b2-3da3-4d27-8170-5f86beef62cb/kube-rbac-proxy-main/0.log"
Sep 17 19:08:22.777748 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:22.777717    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-m4rfp_4fa7d1b2-3da3-4d27-8170-5f86beef62cb/kube-rbac-proxy-self/0.log"
Sep 17 19:08:22.977830 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:22.977803    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-m4rfp_4fa7d1b2-3da3-4d27-8170-5f86beef62cb/openshift-state-metrics/0.log"
Sep 17 19:08:23.177433 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:23.177354    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_07b7f939-d25b-4d41-afbe-dd869d80145b/init-config-reloader/0.log"
Sep 17 19:08:23.382252 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:23.382225    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_07b7f939-d25b-4d41-afbe-dd869d80145b/prometheus/0.log"
Sep 17 19:08:23.577494 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:23.577467    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_07b7f939-d25b-4d41-afbe-dd869d80145b/config-reloader/0.log"
Sep 17 19:08:23.778103 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:23.778074    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_07b7f939-d25b-4d41-afbe-dd869d80145b/thanos-sidecar/0.log"
Sep 17 19:08:23.978584 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:23.978562    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_07b7f939-d25b-4d41-afbe-dd869d80145b/kube-rbac-proxy-web/0.log"
Sep 17 19:08:24.178190 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:24.178159    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_07b7f939-d25b-4d41-afbe-dd869d80145b/kube-rbac-proxy/0.log"
Sep 17 19:08:24.377729 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:24.377642    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_07b7f939-d25b-4d41-afbe-dd869d80145b/kube-rbac-proxy-thanos/0.log"
Sep 17 19:08:24.585742 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:24.585717    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-6kh6m_23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250/prometheus-operator/0.log"
Sep 17 19:08:24.778032 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:24.777991    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-6kh6m_23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250/kube-rbac-proxy/0.log"
Sep 17 19:08:24.977085 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:24.977053    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-67jzf_e519fed0-84a5-460c-8bc8-9400230c7a78/prometheus-operator-admission-webhook/0.log"
Sep 17 19:08:26.977128 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:26.977087    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-ltlpr_4e54aa88-d09c-481b-b8c8-2f3edc3a2752/networking-console-plugin/0.log"
Sep 17 19:08:47.078142 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:47.078102    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:08:47.099227 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:47.099200    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:08:48.037485 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:08:48.037452    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:00.895799 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:00.895701    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 19:09:00.896301 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:00.896079    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="alertmanager" containerID="cri-o://5931de90a2d1d6bca4fc34ad9c425f30f081fbf49c6ad01bb2aa448a7f7b8797" gracePeriod=120
Sep 17 19:09:00.896301 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:00.896124    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="kube-rbac-proxy-metric" containerID="cri-o://11b724f299d1a3d3c0dd58d7417eb9baa4a7e48a3f63f8a0a04b1b753a058659" gracePeriod=120
Sep 17 19:09:00.896301 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:00.896158    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="kube-rbac-proxy-web" containerID="cri-o://703f2c14d92f00316975bb25fb422ff72e4090ffd24b942030514472fb216455" gracePeriod=120
Sep 17 19:09:00.896301 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:00.896153    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="prom-label-proxy" containerID="cri-o://ca92616afa11e7c3f3c2dc88bfa525c7c9d5f639388894aa073689fae9649385" gracePeriod=120
Sep 17 19:09:00.896301 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:00.896232    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="config-reloader" containerID="cri-o://65ee490ca29b1568445c66ba0ef6b989e726913fb1607d55997bff13906bb59a" gracePeriod=120
Sep 17 19:09:00.896734 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:00.896422    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="kube-rbac-proxy" containerID="cri-o://c023bc6725205d5ae6955971cc209d502fb6ffceac8ebd0c4bb9d8cea7951604" gracePeriod=120
Sep 17 19:09:01.076480 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:01.076445    2573 generic.go:356] "Generic (PLEG): container finished" podID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerID="ca92616afa11e7c3f3c2dc88bfa525c7c9d5f639388894aa073689fae9649385" exitCode=0
Sep 17 19:09:01.076480 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:01.076470    2573 generic.go:356] "Generic (PLEG): container finished" podID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerID="11b724f299d1a3d3c0dd58d7417eb9baa4a7e48a3f63f8a0a04b1b753a058659" exitCode=0
Sep 17 19:09:01.076480 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:01.076476    2573 generic.go:356] "Generic (PLEG): container finished" podID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerID="c023bc6725205d5ae6955971cc209d502fb6ffceac8ebd0c4bb9d8cea7951604" exitCode=0
Sep 17 19:09:01.076480 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:01.076482    2573 generic.go:356] "Generic (PLEG): container finished" podID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerID="65ee490ca29b1568445c66ba0ef6b989e726913fb1607d55997bff13906bb59a" exitCode=0
Sep 17 19:09:01.076480 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:01.076487    2573 generic.go:356] "Generic (PLEG): container finished" podID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerID="5931de90a2d1d6bca4fc34ad9c425f30f081fbf49c6ad01bb2aa448a7f7b8797" exitCode=0
Sep 17 19:09:01.076814 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:01.076523    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a6aa495-7a48-4dad-a120-0094bbfa2812","Type":"ContainerDied","Data":"ca92616afa11e7c3f3c2dc88bfa525c7c9d5f639388894aa073689fae9649385"}
Sep 17 19:09:01.076814 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:01.076605    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a6aa495-7a48-4dad-a120-0094bbfa2812","Type":"ContainerDied","Data":"11b724f299d1a3d3c0dd58d7417eb9baa4a7e48a3f63f8a0a04b1b753a058659"}
Sep 17 19:09:01.076814 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:01.076648    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a6aa495-7a48-4dad-a120-0094bbfa2812","Type":"ContainerDied","Data":"c023bc6725205d5ae6955971cc209d502fb6ffceac8ebd0c4bb9d8cea7951604"}
Sep 17 19:09:01.076814 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:01.076691    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a6aa495-7a48-4dad-a120-0094bbfa2812","Type":"ContainerDied","Data":"65ee490ca29b1568445c66ba0ef6b989e726913fb1607d55997bff13906bb59a"}
Sep 17 19:09:01.076814 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:01.076734    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a6aa495-7a48-4dad-a120-0094bbfa2812","Type":"ContainerDied","Data":"5931de90a2d1d6bca4fc34ad9c425f30f081fbf49c6ad01bb2aa448a7f7b8797"}
Sep 17 19:09:02.086533 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.086484    2573 generic.go:356] "Generic (PLEG): container finished" podID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerID="703f2c14d92f00316975bb25fb422ff72e4090ffd24b942030514472fb216455" exitCode=0
Sep 17 19:09:02.086985 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.086536    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a6aa495-7a48-4dad-a120-0094bbfa2812","Type":"ContainerDied","Data":"703f2c14d92f00316975bb25fb422ff72e4090ffd24b942030514472fb216455"}
Sep 17 19:09:02.140214 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.140186    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:02.234452 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.234368    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a6aa495-7a48-4dad-a120-0094bbfa2812-config-out\") pod \"9a6aa495-7a48-4dad-a120-0094bbfa2812\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") "
Sep 17 19:09:02.234452 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.234424    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a6aa495-7a48-4dad-a120-0094bbfa2812-alertmanager-trusted-ca-bundle\") pod \"9a6aa495-7a48-4dad-a120-0094bbfa2812\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") "
Sep 17 19:09:02.234670 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.234454    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a6aa495-7a48-4dad-a120-0094bbfa2812-metrics-client-ca\") pod \"9a6aa495-7a48-4dad-a120-0094bbfa2812\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") "
Sep 17 19:09:02.234670 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.234480    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9a6aa495-7a48-4dad-a120-0094bbfa2812-alertmanager-main-db\") pod \"9a6aa495-7a48-4dad-a120-0094bbfa2812\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") "
Sep 17 19:09:02.234670 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.234515    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-main-tls\") pod \"9a6aa495-7a48-4dad-a120-0094bbfa2812\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") "
Sep 17 19:09:02.234670 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.234557    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-cluster-tls-config\") pod \"9a6aa495-7a48-4dad-a120-0094bbfa2812\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") "
Sep 17 19:09:02.234670 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.234592    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a6aa495-7a48-4dad-a120-0094bbfa2812-tls-assets\") pod \"9a6aa495-7a48-4dad-a120-0094bbfa2812\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") "
Sep 17 19:09:02.234670 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.234618    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-kube-rbac-proxy\") pod \"9a6aa495-7a48-4dad-a120-0094bbfa2812\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") "
Sep 17 19:09:02.234670 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.234651    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-config-volume\") pod \"9a6aa495-7a48-4dad-a120-0094bbfa2812\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") "
Sep 17 19:09:02.235036 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.234689    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9a6aa495-7a48-4dad-a120-0094bbfa2812\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") "
Sep 17 19:09:02.235036 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.234719    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-kube-rbac-proxy-web\") pod \"9a6aa495-7a48-4dad-a120-0094bbfa2812\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") "
Sep 17 19:09:02.235036 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.234750    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2djph\" (UniqueName: \"kubernetes.io/projected/9a6aa495-7a48-4dad-a120-0094bbfa2812-kube-api-access-2djph\") pod \"9a6aa495-7a48-4dad-a120-0094bbfa2812\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") "
Sep 17 19:09:02.235036 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.234815    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-web-config\") pod \"9a6aa495-7a48-4dad-a120-0094bbfa2812\" (UID: \"9a6aa495-7a48-4dad-a120-0094bbfa2812\") "
Sep 17 19:09:02.235036 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.234808    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a6aa495-7a48-4dad-a120-0094bbfa2812-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9a6aa495-7a48-4dad-a120-0094bbfa2812" (UID: "9a6aa495-7a48-4dad-a120-0094bbfa2812"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 19:09:02.235036 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.234829    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a6aa495-7a48-4dad-a120-0094bbfa2812-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9a6aa495-7a48-4dad-a120-0094bbfa2812" (UID: "9a6aa495-7a48-4dad-a120-0094bbfa2812"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:09:02.235036 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.234873    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a6aa495-7a48-4dad-a120-0094bbfa2812-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9a6aa495-7a48-4dad-a120-0094bbfa2812" (UID: "9a6aa495-7a48-4dad-a120-0094bbfa2812"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:09:02.235551 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.235186    2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a6aa495-7a48-4dad-a120-0094bbfa2812-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:02.235551 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.235207    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a6aa495-7a48-4dad-a120-0094bbfa2812-metrics-client-ca\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:02.235551 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.235222    2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9a6aa495-7a48-4dad-a120-0094bbfa2812-alertmanager-main-db\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:02.238323 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.238279    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9a6aa495-7a48-4dad-a120-0094bbfa2812" (UID: "9a6aa495-7a48-4dad-a120-0094bbfa2812"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:09:02.238571 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.238540    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9a6aa495-7a48-4dad-a120-0094bbfa2812" (UID: "9a6aa495-7a48-4dad-a120-0094bbfa2812"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:09:02.238571 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.238555    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a6aa495-7a48-4dad-a120-0094bbfa2812-config-out" (OuterVolumeSpecName: "config-out") pod "9a6aa495-7a48-4dad-a120-0094bbfa2812" (UID: "9a6aa495-7a48-4dad-a120-0094bbfa2812"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 19:09:02.239309 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.239256    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a6aa495-7a48-4dad-a120-0094bbfa2812-kube-api-access-2djph" (OuterVolumeSpecName: "kube-api-access-2djph") pod "9a6aa495-7a48-4dad-a120-0094bbfa2812" (UID: "9a6aa495-7a48-4dad-a120-0094bbfa2812"). InnerVolumeSpecName "kube-api-access-2djph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:09:02.239410 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.239359    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a6aa495-7a48-4dad-a120-0094bbfa2812-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9a6aa495-7a48-4dad-a120-0094bbfa2812" (UID: "9a6aa495-7a48-4dad-a120-0094bbfa2812"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:09:02.239568 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.239540    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9a6aa495-7a48-4dad-a120-0094bbfa2812" (UID: "9a6aa495-7a48-4dad-a120-0094bbfa2812"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:09:02.240400 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.240365    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9a6aa495-7a48-4dad-a120-0094bbfa2812" (UID: "9a6aa495-7a48-4dad-a120-0094bbfa2812"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:09:02.240627 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.240602    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-config-volume" (OuterVolumeSpecName: "config-volume") pod "9a6aa495-7a48-4dad-a120-0094bbfa2812" (UID: "9a6aa495-7a48-4dad-a120-0094bbfa2812"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:09:02.243635 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.243615    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9a6aa495-7a48-4dad-a120-0094bbfa2812" (UID: "9a6aa495-7a48-4dad-a120-0094bbfa2812"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:09:02.250928 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.250894    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-web-config" (OuterVolumeSpecName: "web-config") pod "9a6aa495-7a48-4dad-a120-0094bbfa2812" (UID: "9a6aa495-7a48-4dad-a120-0094bbfa2812"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:09:02.335635 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.335599    2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-web-config\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:02.335635 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.335629    2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a6aa495-7a48-4dad-a120-0094bbfa2812-config-out\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:02.335635 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.335643    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-main-tls\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:02.335867 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.335655    2573 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-cluster-tls-config\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:02.335867 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.335666    2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a6aa495-7a48-4dad-a120-0094bbfa2812-tls-assets\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:02.335867 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.335675    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:02.335867 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.335684    2573 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-config-volume\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:02.335867 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.335692    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:02.335867 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.335702    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a6aa495-7a48-4dad-a120-0094bbfa2812-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:02.335867 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:02.335711    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2djph\" (UniqueName: \"kubernetes.io/projected/9a6aa495-7a48-4dad-a120-0094bbfa2812-kube-api-access-2djph\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:03.093307 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.093274    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a6aa495-7a48-4dad-a120-0094bbfa2812","Type":"ContainerDied","Data":"459503ab367fb68c7f6c7f2669e15b45af0e66ad83d267aaa9e985fb3aa73ea6"}
Sep 17 19:09:03.093762 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.093356    2573 scope.go:117] "RemoveContainer" containerID="ca92616afa11e7c3f3c2dc88bfa525c7c9d5f639388894aa073689fae9649385"
Sep 17 19:09:03.093762 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.093285    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.102222 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.102201    2573 scope.go:117] "RemoveContainer" containerID="11b724f299d1a3d3c0dd58d7417eb9baa4a7e48a3f63f8a0a04b1b753a058659"
Sep 17 19:09:03.109584 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.109567    2573 scope.go:117] "RemoveContainer" containerID="c023bc6725205d5ae6955971cc209d502fb6ffceac8ebd0c4bb9d8cea7951604"
Sep 17 19:09:03.117645 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.117625    2573 scope.go:117] "RemoveContainer" containerID="703f2c14d92f00316975bb25fb422ff72e4090ffd24b942030514472fb216455"
Sep 17 19:09:03.118305 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.118282    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 19:09:03.124055 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.124024    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 19:09:03.128935 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.128911    2573 scope.go:117] "RemoveContainer" containerID="65ee490ca29b1568445c66ba0ef6b989e726913fb1607d55997bff13906bb59a"
Sep 17 19:09:03.136395 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.136377    2573 scope.go:117] "RemoveContainer" containerID="5931de90a2d1d6bca4fc34ad9c425f30f081fbf49c6ad01bb2aa448a7f7b8797"
Sep 17 19:09:03.144205 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.144188    2573 scope.go:117] "RemoveContainer" containerID="cfe3b723082172118f2dea421e2eb8b935e45354a1367b3e5c8f40719e76411d"
Sep 17 19:09:03.149640 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.149619    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 19:09:03.149961 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.149947    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="kube-rbac-proxy-metric"
Sep 17 19:09:03.150015 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.149962    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="kube-rbac-proxy-metric"
Sep 17 19:09:03.150015 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.149976    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="init-config-reloader"
Sep 17 19:09:03.150015 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.149981    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="init-config-reloader"
Sep 17 19:09:03.150015 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.149988    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="kube-rbac-proxy-web"
Sep 17 19:09:03.150015 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.149993    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="kube-rbac-proxy-web"
Sep 17 19:09:03.150015 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.150002    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="kube-rbac-proxy"
Sep 17 19:09:03.150015 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.150007    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="kube-rbac-proxy"
Sep 17 19:09:03.150015 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.150015    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0" containerName="registry"
Sep 17 19:09:03.150308 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.150020    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0" containerName="registry"
Sep 17 19:09:03.150308 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.150032    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="prom-label-proxy"
Sep 17 19:09:03.150308 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.150037    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="prom-label-proxy"
Sep 17 19:09:03.150308 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.150044    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="alertmanager"
Sep 17 19:09:03.150308 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.150050    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="alertmanager"
Sep 17 19:09:03.150308 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.150056    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="config-reloader"
Sep 17 19:09:03.150308 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.150061    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="config-reloader"
Sep 17 19:09:03.150308 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.150108    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="config-reloader"
Sep 17 19:09:03.150308 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.150119    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="kube-rbac-proxy-metric"
Sep 17 19:09:03.150308 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.150125    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6583ae7-e0ec-41c2-96c3-ecd04d5e33b0" containerName="registry"
Sep 17 19:09:03.150308 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.150129    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="alertmanager"
Sep 17 19:09:03.150308 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.150134    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="kube-rbac-proxy"
Sep 17 19:09:03.150308 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.150140    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="kube-rbac-proxy-web"
Sep 17 19:09:03.150308 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.150145    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" containerName="prom-label-proxy"
Sep 17 19:09:03.154832 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.154817    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.157987 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.157559    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 17 19:09:03.157987 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.157838    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 17 19:09:03.158177 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.158158    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 17 19:09:03.158288 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.158254    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hd7gk\""
Sep 17 19:09:03.158366 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.158350    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 17 19:09:03.158456 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.158354    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 17 19:09:03.158560 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.158437    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 17 19:09:03.158560 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.158512    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 17 19:09:03.158839 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.158823    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 17 19:09:03.162273 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.162254    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 17 19:09:03.169940 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.169869    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 19:09:03.242532 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.242436    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.242532 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.242477    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.242532 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.242519    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.242750 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.242601    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-config-volume\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.242750 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.242638    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.242750 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.242659    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.242750 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.242703    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.242750 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.242737    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx6fq\" (UniqueName: \"kubernetes.io/projected/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-kube-api-access-vx6fq\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.242952 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.242767    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-config-out\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.242952 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.242786    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-web-config\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.242952 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.242805    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.242952 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.242823    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.242952 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.242843    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.343751 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.343702    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.343751 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.343752    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-config-volume\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.343967 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.343781    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.343967 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.343808    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.343967 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.343924    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.344115 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.343981    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx6fq\" (UniqueName: \"kubernetes.io/projected/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-kube-api-access-vx6fq\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.344115 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.344009    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-config-out\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.344115 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.344033    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-web-config\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.344115 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.344055    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.344115 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.344086    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.344308 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.344118    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.344308 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.344165    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.344308 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.344187    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.344548 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.344514    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.344911 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.344817    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.347395 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.347222    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-config-out\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.347395 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.347260    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-config-volume\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.347395 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.347335    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-web-config\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.347614 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.347470    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.347614 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.347511    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.347614 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.347521    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.347614 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.347574    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.347955 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.347935    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.348057 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.348042    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.349306 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.349288    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.352354 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.352333    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx6fq\" (UniqueName: \"kubernetes.io/projected/235e15f4-3dfa-40fe-9c9e-155a50fcc3ad-kube-api-access-vx6fq\") pod \"alertmanager-main-0\" (UID: \"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.465626 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.465574    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 19:09:03.749242 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:03.749135    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 19:09:03.751909 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:09:03.751864    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod235e15f4_3dfa_40fe_9c9e_155a50fcc3ad.slice/crio-8f58be9bb7f35813972e4e5af0c823e937c7397a986222533d50392f0e93a6b6 WatchSource:0}: Error finding container 8f58be9bb7f35813972e4e5af0c823e937c7397a986222533d50392f0e93a6b6: Status 404 returned error can't find the container with id 8f58be9bb7f35813972e4e5af0c823e937c7397a986222533d50392f0e93a6b6
Sep 17 19:09:04.099539 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:04.099449    2573 generic.go:356] "Generic (PLEG): container finished" podID="235e15f4-3dfa-40fe-9c9e-155a50fcc3ad" containerID="1f426abdadce6608b26b6c20cfc2219a678f220d1c0ec682a367b78c01126595" exitCode=0
Sep 17 19:09:04.099539 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:04.099494    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad","Type":"ContainerDied","Data":"1f426abdadce6608b26b6c20cfc2219a678f220d1c0ec682a367b78c01126595"}
Sep 17 19:09:04.099987 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:04.099548    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad","Type":"ContainerStarted","Data":"8f58be9bb7f35813972e4e5af0c823e937c7397a986222533d50392f0e93a6b6"}
Sep 17 19:09:04.225050 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:04.225021    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a6aa495-7a48-4dad-a120-0094bbfa2812" path="/var/lib/kubelet/pods/9a6aa495-7a48-4dad-a120-0094bbfa2812/volumes"
Sep 17 19:09:05.107826 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.107790    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad","Type":"ContainerStarted","Data":"4bdb024dbdcd9418948f09717c41c4a41169941205dc47d07a24ba2cb283bae6"}
Sep 17 19:09:05.108221 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.107852    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad","Type":"ContainerStarted","Data":"46629cfc154aed4e7f40455ad49d5629946bb46936926f255016693f63c32333"}
Sep 17 19:09:05.108221 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.107892    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad","Type":"ContainerStarted","Data":"bb0f2a84795030568d86549d61065c660733fa709775f0a34898f639b7b01aff"}
Sep 17 19:09:05.108221 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.107918    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad","Type":"ContainerStarted","Data":"a7d8a5f00edc455c8f193cc1b90e586e99d3b38123dc867e401aa96ee6018ac4"}
Sep 17 19:09:05.108221 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.107940    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad","Type":"ContainerStarted","Data":"7b6c40c548bdcb9c6e9c67160cc9132a8a6d982f687afb786dc35e5fda732b68"}
Sep 17 19:09:05.108221 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.107963    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"235e15f4-3dfa-40fe-9c9e-155a50fcc3ad","Type":"ContainerStarted","Data":"35b461137240f9a5f272188ca9dae6a924c42ed56f000e6a06c1b0cdac0b101b"}
Sep 17 19:09:05.146867 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.146802    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.128032591 podStartE2EDuration="2.14678022s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.747629ms" isStatefulPod=false podCreationTimestamp="2026-09-17 19:09:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:09:05.143752819 +0000 UTC m=+171.083109777" watchObservedRunningTime="2026-09-17 19:09:05.14678022 +0000 UTC m=+171.086137142"
Sep 17 19:09:05.193770 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.193732    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 19:09:05.194356 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.194148    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="prometheus" containerID="cri-o://519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28" gracePeriod=600
Sep 17 19:09:05.194356 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.194177    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="thanos-sidecar" containerID="cri-o://4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae" gracePeriod=600
Sep 17 19:09:05.194356 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.194201    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="kube-rbac-proxy-web" containerID="cri-o://5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06" gracePeriod=600
Sep 17 19:09:05.194356 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.194192    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="config-reloader" containerID="cri-o://1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f" gracePeriod=600
Sep 17 19:09:05.194356 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.194223    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc" gracePeriod=600
Sep 17 19:09:05.194356 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.194164    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="kube-rbac-proxy" containerID="cri-o://02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6" gracePeriod=600
Sep 17 19:09:05.447140 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.447112    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:05.567166 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.567133    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-metrics-client-certs\") pod \"07b7f939-d25b-4d41-afbe-dd869d80145b\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") "
Sep 17 19:09:05.567304 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.567174    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-rulefiles-2\") pod \"07b7f939-d25b-4d41-afbe-dd869d80145b\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") "
Sep 17 19:09:05.567304 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.567203    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-rulefiles-0\") pod \"07b7f939-d25b-4d41-afbe-dd869d80145b\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") "
Sep 17 19:09:05.567304 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.567242    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-thanos-prometheus-http-client-file\") pod \"07b7f939-d25b-4d41-afbe-dd869d80145b\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") "
Sep 17 19:09:05.567304 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.567281    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sqw7\" (UniqueName: \"kubernetes.io/projected/07b7f939-d25b-4d41-afbe-dd869d80145b-kube-api-access-4sqw7\") pod \"07b7f939-d25b-4d41-afbe-dd869d80145b\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") "
Sep 17 19:09:05.567492 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.567319    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-configmap-serving-certs-ca-bundle\") pod \"07b7f939-d25b-4d41-afbe-dd869d80145b\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") "
Sep 17 19:09:05.567492 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.567344    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-db\") pod \"07b7f939-d25b-4d41-afbe-dd869d80145b\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") "
Sep 17 19:09:05.567492 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.567370    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-configmap-metrics-client-ca\") pod \"07b7f939-d25b-4d41-afbe-dd869d80145b\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") "
Sep 17 19:09:05.567492 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.567399    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"07b7f939-d25b-4d41-afbe-dd869d80145b\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") "
Sep 17 19:09:05.567492 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.567432    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07b7f939-d25b-4d41-afbe-dd869d80145b-config-out\") pod \"07b7f939-d25b-4d41-afbe-dd869d80145b\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") "
Sep 17 19:09:05.567492 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.567483    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-web-config\") pod \"07b7f939-d25b-4d41-afbe-dd869d80145b\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") "
Sep 17 19:09:05.567770 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.567511    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-grpc-tls\") pod \"07b7f939-d25b-4d41-afbe-dd869d80145b\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") "
Sep 17 19:09:05.567770 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.567534    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07b7f939-d25b-4d41-afbe-dd869d80145b-tls-assets\") pod \"07b7f939-d25b-4d41-afbe-dd869d80145b\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") "
Sep 17 19:09:05.567770 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.567536    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "07b7f939-d25b-4d41-afbe-dd869d80145b" (UID: "07b7f939-d25b-4d41-afbe-dd869d80145b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:09:05.567770 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.567565    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-kube-rbac-proxy\") pod \"07b7f939-d25b-4d41-afbe-dd869d80145b\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") "
Sep 17 19:09:05.567770 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.567602    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-config\") pod \"07b7f939-d25b-4d41-afbe-dd869d80145b\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") "
Sep 17 19:09:05.567770 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.567623    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-rulefiles-1\") pod \"07b7f939-d25b-4d41-afbe-dd869d80145b\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") "
Sep 17 19:09:05.567770 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.567652    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-trusted-ca-bundle\") pod \"07b7f939-d25b-4d41-afbe-dd869d80145b\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") "
Sep 17 19:09:05.567770 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.567676    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-configmap-kubelet-serving-ca-bundle\") pod \"07b7f939-d25b-4d41-afbe-dd869d80145b\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") "
Sep 17 19:09:05.567770 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.567700    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"07b7f939-d25b-4d41-afbe-dd869d80145b\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") "
Sep 17 19:09:05.567770 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.567742    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-prometheus-k8s-tls\") pod \"07b7f939-d25b-4d41-afbe-dd869d80145b\" (UID: \"07b7f939-d25b-4d41-afbe-dd869d80145b\") "
Sep 17 19:09:05.568266 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.568208    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:05.568474 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.568442    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "07b7f939-d25b-4d41-afbe-dd869d80145b" (UID: "07b7f939-d25b-4d41-afbe-dd869d80145b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 19:09:05.568676 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.568596    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "07b7f939-d25b-4d41-afbe-dd869d80145b" (UID: "07b7f939-d25b-4d41-afbe-dd869d80145b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:09:05.569529 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.568972    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "07b7f939-d25b-4d41-afbe-dd869d80145b" (UID: "07b7f939-d25b-4d41-afbe-dd869d80145b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:09:05.569529 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.568983    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "07b7f939-d25b-4d41-afbe-dd869d80145b" (UID: "07b7f939-d25b-4d41-afbe-dd869d80145b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:09:05.569529 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.569225    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "07b7f939-d25b-4d41-afbe-dd869d80145b" (UID: "07b7f939-d25b-4d41-afbe-dd869d80145b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:09:05.569529 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.569235    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "07b7f939-d25b-4d41-afbe-dd869d80145b" (UID: "07b7f939-d25b-4d41-afbe-dd869d80145b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:09:05.569529 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.569267    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "07b7f939-d25b-4d41-afbe-dd869d80145b" (UID: "07b7f939-d25b-4d41-afbe-dd869d80145b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:09:05.571778 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.571748    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "07b7f939-d25b-4d41-afbe-dd869d80145b" (UID: "07b7f939-d25b-4d41-afbe-dd869d80145b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:09:05.571778 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.571767    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07b7f939-d25b-4d41-afbe-dd869d80145b-config-out" (OuterVolumeSpecName: "config-out") pod "07b7f939-d25b-4d41-afbe-dd869d80145b" (UID: "07b7f939-d25b-4d41-afbe-dd869d80145b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 19:09:05.572311 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.571869    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "07b7f939-d25b-4d41-afbe-dd869d80145b" (UID: "07b7f939-d25b-4d41-afbe-dd869d80145b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:09:05.572311 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.572014    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07b7f939-d25b-4d41-afbe-dd869d80145b-kube-api-access-4sqw7" (OuterVolumeSpecName: "kube-api-access-4sqw7") pod "07b7f939-d25b-4d41-afbe-dd869d80145b" (UID: "07b7f939-d25b-4d41-afbe-dd869d80145b"). InnerVolumeSpecName "kube-api-access-4sqw7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:09:05.572311 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.572143    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "07b7f939-d25b-4d41-afbe-dd869d80145b" (UID: "07b7f939-d25b-4d41-afbe-dd869d80145b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:09:05.572311 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.572198    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "07b7f939-d25b-4d41-afbe-dd869d80145b" (UID: "07b7f939-d25b-4d41-afbe-dd869d80145b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:09:05.572311 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.572258    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-config" (OuterVolumeSpecName: "config") pod "07b7f939-d25b-4d41-afbe-dd869d80145b" (UID: "07b7f939-d25b-4d41-afbe-dd869d80145b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:09:05.572594 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.572341    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "07b7f939-d25b-4d41-afbe-dd869d80145b" (UID: "07b7f939-d25b-4d41-afbe-dd869d80145b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:09:05.572594 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.572478    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "07b7f939-d25b-4d41-afbe-dd869d80145b" (UID: "07b7f939-d25b-4d41-afbe-dd869d80145b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:09:05.572594 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.572557    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "07b7f939-d25b-4d41-afbe-dd869d80145b" (UID: "07b7f939-d25b-4d41-afbe-dd869d80145b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:09:05.572996 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.572975    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07b7f939-d25b-4d41-afbe-dd869d80145b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "07b7f939-d25b-4d41-afbe-dd869d80145b" (UID: "07b7f939-d25b-4d41-afbe-dd869d80145b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:09:05.582898 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.582859    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-web-config" (OuterVolumeSpecName: "web-config") pod "07b7f939-d25b-4d41-afbe-dd869d80145b" (UID: "07b7f939-d25b-4d41-afbe-dd869d80145b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:09:05.668612 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.668543    2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-web-config\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:05.668612 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.668568    2573 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-grpc-tls\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:05.668612 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.668576    2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07b7f939-d25b-4d41-afbe-dd869d80145b-tls-assets\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:05.668612 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.668585    2573 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-kube-rbac-proxy\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:05.668612 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.668595    2573 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-config\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:05.668612 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.668603    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:05.668612 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.668612    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:05.668926 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.668621    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:05.668926 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.668630    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:05.668926 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.668639    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:05.668926 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.668647    2573 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-metrics-client-certs\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:05.668926 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.668656    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:05.668926 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.668664    2573 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:05.668926 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.668672    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sqw7\" (UniqueName: \"kubernetes.io/projected/07b7f939-d25b-4d41-afbe-dd869d80145b-kube-api-access-4sqw7\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:05.668926 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.668681    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:05.668926 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.668689    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/07b7f939-d25b-4d41-afbe-dd869d80145b-prometheus-k8s-db\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:05.668926 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.668697    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07b7f939-d25b-4d41-afbe-dd869d80145b-configmap-metrics-client-ca\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:05.668926 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.668705    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07b7f939-d25b-4d41-afbe-dd869d80145b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:05.668926 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:05.668713    2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07b7f939-d25b-4d41-afbe-dd869d80145b-config-out\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:09:06.115665 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.115627    2573 generic.go:356] "Generic (PLEG): container finished" podID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerID="46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc" exitCode=0
Sep 17 19:09:06.115665 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.115659    2573 generic.go:356] "Generic (PLEG): container finished" podID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerID="02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6" exitCode=0
Sep 17 19:09:06.115665 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.115668    2573 generic.go:356] "Generic (PLEG): container finished" podID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerID="5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06" exitCode=0
Sep 17 19:09:06.116128 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.115676    2573 generic.go:356] "Generic (PLEG): container finished" podID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerID="4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae" exitCode=0
Sep 17 19:09:06.116128 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.115686    2573 generic.go:356] "Generic (PLEG): container finished" podID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerID="1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f" exitCode=0
Sep 17 19:09:06.116128 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.115694    2573 generic.go:356] "Generic (PLEG): container finished" podID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerID="519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28" exitCode=0
Sep 17 19:09:06.116128 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.115696    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"07b7f939-d25b-4d41-afbe-dd869d80145b","Type":"ContainerDied","Data":"46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc"}
Sep 17 19:09:06.116128 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.115721    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.116128 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.115787    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"07b7f939-d25b-4d41-afbe-dd869d80145b","Type":"ContainerDied","Data":"02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6"}
Sep 17 19:09:06.116128 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.115816    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"07b7f939-d25b-4d41-afbe-dd869d80145b","Type":"ContainerDied","Data":"5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06"}
Sep 17 19:09:06.116128 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.115841    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"07b7f939-d25b-4d41-afbe-dd869d80145b","Type":"ContainerDied","Data":"4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae"}
Sep 17 19:09:06.116128 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.115860    2573 scope.go:117] "RemoveContainer" containerID="46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc"
Sep 17 19:09:06.116128 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.115867    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"07b7f939-d25b-4d41-afbe-dd869d80145b","Type":"ContainerDied","Data":"1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f"}
Sep 17 19:09:06.116128 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.115908    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"07b7f939-d25b-4d41-afbe-dd869d80145b","Type":"ContainerDied","Data":"519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28"}
Sep 17 19:09:06.116128 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.115935    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"07b7f939-d25b-4d41-afbe-dd869d80145b","Type":"ContainerDied","Data":"be30f922574e94ef76f21b6056c84b57f34738fb71966e6715bc23a372edc376"}
Sep 17 19:09:06.123945 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.123776    2573 scope.go:117] "RemoveContainer" containerID="02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6"
Sep 17 19:09:06.131165 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.131142    2573 scope.go:117] "RemoveContainer" containerID="5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06"
Sep 17 19:09:06.137868 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.137842    2573 scope.go:117] "RemoveContainer" containerID="4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae"
Sep 17 19:09:06.140950 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.140927    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 19:09:06.144558 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.144529    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 19:09:06.145590 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.145573    2573 scope.go:117] "RemoveContainer" containerID="1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f"
Sep 17 19:09:06.152297 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.152279    2573 scope.go:117] "RemoveContainer" containerID="519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28"
Sep 17 19:09:06.159391 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.159374    2573 scope.go:117] "RemoveContainer" containerID="713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293"
Sep 17 19:09:06.166217 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.166203    2573 scope.go:117] "RemoveContainer" containerID="46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc"
Sep 17 19:09:06.166470 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:09:06.166454    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc\": container with ID starting with 46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc not found: ID does not exist" containerID="46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc"
Sep 17 19:09:06.166514 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.166478    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc"} err="failed to get container status \"46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc\": rpc error: code = NotFound desc = could not find container \"46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc\": container with ID starting with 46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc not found: ID does not exist"
Sep 17 19:09:06.166514 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.166495    2573 scope.go:117] "RemoveContainer" containerID="02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6"
Sep 17 19:09:06.166736 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:09:06.166717    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6\": container with ID starting with 02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6 not found: ID does not exist" containerID="02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6"
Sep 17 19:09:06.166772 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.166743    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6"} err="failed to get container status \"02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6\": rpc error: code = NotFound desc = could not find container \"02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6\": container with ID starting with 02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6 not found: ID does not exist"
Sep 17 19:09:06.166772 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.166759    2573 scope.go:117] "RemoveContainer" containerID="5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06"
Sep 17 19:09:06.167014 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:09:06.166996    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06\": container with ID starting with 5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06 not found: ID does not exist" containerID="5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06"
Sep 17 19:09:06.167054 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.167020    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06"} err="failed to get container status \"5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06\": rpc error: code = NotFound desc = could not find container \"5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06\": container with ID starting with 5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06 not found: ID does not exist"
Sep 17 19:09:06.167054 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.167036    2573 scope.go:117] "RemoveContainer" containerID="4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae"
Sep 17 19:09:06.167257 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:09:06.167242    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae\": container with ID starting with 4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae not found: ID does not exist" containerID="4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae"
Sep 17 19:09:06.167302 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.167261    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae"} err="failed to get container status \"4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae\": rpc error: code = NotFound desc = could not find container \"4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae\": container with ID starting with 4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae not found: ID does not exist"
Sep 17 19:09:06.167302 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.167275    2573 scope.go:117] "RemoveContainer" containerID="1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f"
Sep 17 19:09:06.167522 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:09:06.167506    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f\": container with ID starting with 1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f not found: ID does not exist" containerID="1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f"
Sep 17 19:09:06.167570 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.167525    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f"} err="failed to get container status \"1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f\": rpc error: code = NotFound desc = could not find container \"1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f\": container with ID starting with 1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f not found: ID does not exist"
Sep 17 19:09:06.167570 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.167543    2573 scope.go:117] "RemoveContainer" containerID="519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28"
Sep 17 19:09:06.168169 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:09:06.167857    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28\": container with ID starting with 519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28 not found: ID does not exist" containerID="519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28"
Sep 17 19:09:06.168169 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.168062    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28"} err="failed to get container status \"519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28\": rpc error: code = NotFound desc = could not find container \"519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28\": container with ID starting with 519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28 not found: ID does not exist"
Sep 17 19:09:06.168169 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.168099    2573 scope.go:117] "RemoveContainer" containerID="713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293"
Sep 17 19:09:06.168822 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:09:06.168802    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293\": container with ID starting with 713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293 not found: ID does not exist" containerID="713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293"
Sep 17 19:09:06.169030 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.168824    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293"} err="failed to get container status \"713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293\": rpc error: code = NotFound desc = could not find container \"713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293\": container with ID starting with 713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293 not found: ID does not exist"
Sep 17 19:09:06.169030 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.168838    2573 scope.go:117] "RemoveContainer" containerID="46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc"
Sep 17 19:09:06.169176 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.169131    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc"} err="failed to get container status \"46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc\": rpc error: code = NotFound desc = could not find container \"46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc\": container with ID starting with 46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc not found: ID does not exist"
Sep 17 19:09:06.169176 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.169149    2573 scope.go:117] "RemoveContainer" containerID="02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6"
Sep 17 19:09:06.169436 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.169420    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6"} err="failed to get container status \"02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6\": rpc error: code = NotFound desc = could not find container \"02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6\": container with ID starting with 02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6 not found: ID does not exist"
Sep 17 19:09:06.169487 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.169437    2573 scope.go:117] "RemoveContainer" containerID="5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06"
Sep 17 19:09:06.169659 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.169641    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06"} err="failed to get container status \"5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06\": rpc error: code = NotFound desc = could not find container \"5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06\": container with ID starting with 5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06 not found: ID does not exist"
Sep 17 19:09:06.169719 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.169660    2573 scope.go:117] "RemoveContainer" containerID="4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae"
Sep 17 19:09:06.169719 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.169689    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 19:09:06.169924 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.169909    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae"} err="failed to get container status \"4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae\": rpc error: code = NotFound desc = could not find container \"4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae\": container with ID starting with 4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae not found: ID does not exist"
Sep 17 19:09:06.169979 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.169924    2573 scope.go:117] "RemoveContainer" containerID="1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f"
Sep 17 19:09:06.170074 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170056    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="init-config-reloader"
Sep 17 19:09:06.170116 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170078    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="init-config-reloader"
Sep 17 19:09:06.170116 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170096    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="thanos-sidecar"
Sep 17 19:09:06.170116 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170102    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="thanos-sidecar"
Sep 17 19:09:06.170116 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170112    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="config-reloader"
Sep 17 19:09:06.170231 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170118    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="config-reloader"
Sep 17 19:09:06.170231 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170129    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="kube-rbac-proxy-web"
Sep 17 19:09:06.170231 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170134    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="kube-rbac-proxy-web"
Sep 17 19:09:06.170231 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170141    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="kube-rbac-proxy"
Sep 17 19:09:06.170231 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170154    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="kube-rbac-proxy"
Sep 17 19:09:06.170231 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170163    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="prometheus"
Sep 17 19:09:06.170231 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170168    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="prometheus"
Sep 17 19:09:06.170231 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170182    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="kube-rbac-proxy-thanos"
Sep 17 19:09:06.170231 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170186    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="kube-rbac-proxy-thanos"
Sep 17 19:09:06.170231 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170138    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f"} err="failed to get container status \"1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f\": rpc error: code = NotFound desc = could not find container \"1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f\": container with ID starting with 1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f not found: ID does not exist"
Sep 17 19:09:06.170231 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170217    2573 scope.go:117] "RemoveContainer" containerID="519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28"
Sep 17 19:09:06.170231 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170235    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="thanos-sidecar"
Sep 17 19:09:06.170558 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170243    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="kube-rbac-proxy"
Sep 17 19:09:06.170558 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170250    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="kube-rbac-proxy-web"
Sep 17 19:09:06.170558 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170255    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="kube-rbac-proxy-thanos"
Sep 17 19:09:06.170558 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170260    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="prometheus"
Sep 17 19:09:06.170558 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170268    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" containerName="config-reloader"
Sep 17 19:09:06.170558 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170466    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28"} err="failed to get container status \"519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28\": rpc error: code = NotFound desc = could not find container \"519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28\": container with ID starting with 519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28 not found: ID does not exist"
Sep 17 19:09:06.170558 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170490    2573 scope.go:117] "RemoveContainer" containerID="713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293"
Sep 17 19:09:06.170747 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170731    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293"} err="failed to get container status \"713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293\": rpc error: code = NotFound desc = could not find container \"713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293\": container with ID starting with 713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293 not found: ID does not exist"
Sep 17 19:09:06.170789 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.170748    2573 scope.go:117] "RemoveContainer" containerID="46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc"
Sep 17 19:09:06.171023 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.171002    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc"} err="failed to get container status \"46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc\": rpc error: code = NotFound desc = could not find container \"46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc\": container with ID starting with 46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc not found: ID does not exist"
Sep 17 19:09:06.171138 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.171025    2573 scope.go:117] "RemoveContainer" containerID="02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6"
Sep 17 19:09:06.171294 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.171270    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6"} err="failed to get container status \"02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6\": rpc error: code = NotFound desc = could not find container \"02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6\": container with ID starting with 02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6 not found: ID does not exist"
Sep 17 19:09:06.171333 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.171297    2573 scope.go:117] "RemoveContainer" containerID="5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06"
Sep 17 19:09:06.171552 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.171534    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06"} err="failed to get container status \"5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06\": rpc error: code = NotFound desc = could not find container \"5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06\": container with ID starting with 5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06 not found: ID does not exist"
Sep 17 19:09:06.171595 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.171553    2573 scope.go:117] "RemoveContainer" containerID="4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae"
Sep 17 19:09:06.171812 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.171788    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae"} err="failed to get container status \"4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae\": rpc error: code = NotFound desc = could not find container \"4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae\": container with ID starting with 4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae not found: ID does not exist"
Sep 17 19:09:06.171812 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.171811    2573 scope.go:117] "RemoveContainer" containerID="1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f"
Sep 17 19:09:06.172050 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.172032    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f"} err="failed to get container status \"1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f\": rpc error: code = NotFound desc = could not find container \"1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f\": container with ID starting with 1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f not found: ID does not exist"
Sep 17 19:09:06.172118 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.172052    2573 scope.go:117] "RemoveContainer" containerID="519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28"
Sep 17 19:09:06.172281 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.172265    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28"} err="failed to get container status \"519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28\": rpc error: code = NotFound desc = could not find container \"519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28\": container with ID starting with 519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28 not found: ID does not exist"
Sep 17 19:09:06.172333 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.172281    2573 scope.go:117] "RemoveContainer" containerID="713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293"
Sep 17 19:09:06.172523 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.172507    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293"} err="failed to get container status \"713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293\": rpc error: code = NotFound desc = could not find container \"713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293\": container with ID starting with 713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293 not found: ID does not exist"
Sep 17 19:09:06.172567 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.172523    2573 scope.go:117] "RemoveContainer" containerID="46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc"
Sep 17 19:09:06.172789 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.172772    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc"} err="failed to get container status \"46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc\": rpc error: code = NotFound desc = could not find container \"46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc\": container with ID starting with 46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc not found: ID does not exist"
Sep 17 19:09:06.172864 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.172791    2573 scope.go:117] "RemoveContainer" containerID="02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6"
Sep 17 19:09:06.173062 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.173045    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6"} err="failed to get container status \"02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6\": rpc error: code = NotFound desc = could not find container \"02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6\": container with ID starting with 02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6 not found: ID does not exist"
Sep 17 19:09:06.173131 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.173063    2573 scope.go:117] "RemoveContainer" containerID="5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06"
Sep 17 19:09:06.173280 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.173265    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06"} err="failed to get container status \"5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06\": rpc error: code = NotFound desc = could not find container \"5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06\": container with ID starting with 5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06 not found: ID does not exist"
Sep 17 19:09:06.173333 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.173283    2573 scope.go:117] "RemoveContainer" containerID="4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae"
Sep 17 19:09:06.173515 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.173500    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae"} err="failed to get container status \"4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae\": rpc error: code = NotFound desc = could not find container \"4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae\": container with ID starting with 4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae not found: ID does not exist"
Sep 17 19:09:06.173515 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.173515    2573 scope.go:117] "RemoveContainer" containerID="1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f"
Sep 17 19:09:06.173705 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.173690    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f"} err="failed to get container status \"1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f\": rpc error: code = NotFound desc = could not find container \"1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f\": container with ID starting with 1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f not found: ID does not exist"
Sep 17 19:09:06.173753 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.173705    2573 scope.go:117] "RemoveContainer" containerID="519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28"
Sep 17 19:09:06.173922 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.173902    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28"} err="failed to get container status \"519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28\": rpc error: code = NotFound desc = could not find container \"519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28\": container with ID starting with 519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28 not found: ID does not exist"
Sep 17 19:09:06.173988 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.173923    2573 scope.go:117] "RemoveContainer" containerID="713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293"
Sep 17 19:09:06.174157 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.174135    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293"} err="failed to get container status \"713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293\": rpc error: code = NotFound desc = could not find container \"713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293\": container with ID starting with 713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293 not found: ID does not exist"
Sep 17 19:09:06.174203 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.174157    2573 scope.go:117] "RemoveContainer" containerID="46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc"
Sep 17 19:09:06.174411 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.174388    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc"} err="failed to get container status \"46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc\": rpc error: code = NotFound desc = could not find container \"46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc\": container with ID starting with 46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc not found: ID does not exist"
Sep 17 19:09:06.174411 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.174410    2573 scope.go:117] "RemoveContainer" containerID="02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6"
Sep 17 19:09:06.174692 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.174669    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6"} err="failed to get container status \"02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6\": rpc error: code = NotFound desc = could not find container \"02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6\": container with ID starting with 02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6 not found: ID does not exist"
Sep 17 19:09:06.174787 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.174697    2573 scope.go:117] "RemoveContainer" containerID="5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06"
Sep 17 19:09:06.174973 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.174952    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06"} err="failed to get container status \"5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06\": rpc error: code = NotFound desc = could not find container \"5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06\": container with ID starting with 5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06 not found: ID does not exist"
Sep 17 19:09:06.175025 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.174975    2573 scope.go:117] "RemoveContainer" containerID="4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae"
Sep 17 19:09:06.175214 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.175195    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae"} err="failed to get container status \"4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae\": rpc error: code = NotFound desc = could not find container \"4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae\": container with ID starting with 4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae not found: ID does not exist"
Sep 17 19:09:06.175286 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.175216    2573 scope.go:117] "RemoveContainer" containerID="1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f"
Sep 17 19:09:06.175567 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.175542    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f"} err="failed to get container status \"1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f\": rpc error: code = NotFound desc = could not find container \"1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f\": container with ID starting with 1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f not found: ID does not exist"
Sep 17 19:09:06.175567 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.175567    2573 scope.go:117] "RemoveContainer" containerID="519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28"
Sep 17 19:09:06.175686 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.175616    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.175860 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.175835    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28"} err="failed to get container status \"519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28\": rpc error: code = NotFound desc = could not find container \"519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28\": container with ID starting with 519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28 not found: ID does not exist"
Sep 17 19:09:06.175991 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.175861    2573 scope.go:117] "RemoveContainer" containerID="713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293"
Sep 17 19:09:06.176164 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.176134    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293"} err="failed to get container status \"713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293\": rpc error: code = NotFound desc = could not find container \"713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293\": container with ID starting with 713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293 not found: ID does not exist"
Sep 17 19:09:06.176251 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.176164    2573 scope.go:117] "RemoveContainer" containerID="46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc"
Sep 17 19:09:06.176483 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.176461    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc"} err="failed to get container status \"46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc\": rpc error: code = NotFound desc = could not find container \"46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc\": container with ID starting with 46706b474ab62316381e21214419598f766112cbd4720ef63c56a774442cd0cc not found: ID does not exist"
Sep 17 19:09:06.176570 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.176484    2573 scope.go:117] "RemoveContainer" containerID="02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6"
Sep 17 19:09:06.176763 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.176744    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6"} err="failed to get container status \"02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6\": rpc error: code = NotFound desc = could not find container \"02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6\": container with ID starting with 02807e60302c66dfde1d35503a8f50b805a3d5ada77cf5a0dc34661abcbf24b6 not found: ID does not exist"
Sep 17 19:09:06.176838 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.176765    2573 scope.go:117] "RemoveContainer" containerID="5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06"
Sep 17 19:09:06.177062 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.177042    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06"} err="failed to get container status \"5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06\": rpc error: code = NotFound desc = could not find container \"5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06\": container with ID starting with 5fe9f3c6dc07a4197728b3a33ad3d88442409834ffc5296b1d3af4aca3e89c06 not found: ID does not exist"
Sep 17 19:09:06.177121 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.177067    2573 scope.go:117] "RemoveContainer" containerID="4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae"
Sep 17 19:09:06.177331 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.177311    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae"} err="failed to get container status \"4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae\": rpc error: code = NotFound desc = could not find container \"4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae\": container with ID starting with 4dd30fb4bfa2aa5bf21c81e9c5a56882a7e73cd25aa1ca32c3446531049779ae not found: ID does not exist"
Sep 17 19:09:06.177331 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.177333    2573 scope.go:117] "RemoveContainer" containerID="1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f"
Sep 17 19:09:06.177609 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.177590    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f"} err="failed to get container status \"1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f\": rpc error: code = NotFound desc = could not find container \"1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f\": container with ID starting with 1be313e56446fc1c0d0ad5edadfe17eae86d0469125746fc03aab5efe307d71f not found: ID does not exist"
Sep 17 19:09:06.177660 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.177610    2573 scope.go:117] "RemoveContainer" containerID="519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28"
Sep 17 19:09:06.177914 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.177873    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28"} err="failed to get container status \"519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28\": rpc error: code = NotFound desc = could not find container \"519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28\": container with ID starting with 519fcc5e0dbc301f9f4bb191d96fb0ef7e3610d9e86eec6f3bea24086da6fc28 not found: ID does not exist"
Sep 17 19:09:06.177914 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.177914    2573 scope.go:117] "RemoveContainer" containerID="713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293"
Sep 17 19:09:06.178196 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.178171    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293"} err="failed to get container status \"713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293\": rpc error: code = NotFound desc = could not find container \"713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293\": container with ID starting with 713e5c0e8441533e0c8b02a76f946331cfac2cd881d233fea6634eccf7589293 not found: ID does not exist"
Sep 17 19:09:06.178348 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.178334    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 17 19:09:06.178409 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.178334    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 17 19:09:06.178458 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.178421    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 17 19:09:06.178832 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.178813    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 17 19:09:06.179018 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.178987    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 17 19:09:06.179018 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.178987    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 17 19:09:06.179214 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.179199    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 17 19:09:06.179309 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.179294    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 17 19:09:06.179515 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.179499    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 17 19:09:06.179714 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.179526    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-94i4p6479prfd\""
Sep 17 19:09:06.179714 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.179605    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 17 19:09:06.179714 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.179671    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 17 19:09:06.180006 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.179985    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sf496\""
Sep 17 19:09:06.180099 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.180028    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 17 19:09:06.180099 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.180078    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 17 19:09:06.181059 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.181040    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 17 19:09:06.184938 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.184919    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 17 19:09:06.192278 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.192253    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 19:09:06.226536 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.226462    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07b7f939-d25b-4d41-afbe-dd869d80145b" path="/var/lib/kubelet/pods/07b7f939-d25b-4d41-afbe-dd869d80145b/volumes"
Sep 17 19:09:06.272943 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.272913    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxdj6\" (UniqueName: \"kubernetes.io/projected/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-kube-api-access-cxdj6\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.273081 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.272956    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.273081 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.273049    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.273081 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.273076    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.273263 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.273173    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.273263 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.273203    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-web-config\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.273365 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.273307    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.273365 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.273344    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.273470 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.273380    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-config-out\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.273588 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.273570    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.273647 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.273630    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-config\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.273696 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.273662    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.273696 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.273686    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.273799 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.273721    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.273799 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.273767    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.273926 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.273795    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.273926 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.273834    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.273926 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.273867    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.273926 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.273921    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.274083 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.273945    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.374548 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.374524    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.374695 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.374553    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.374695 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.374572    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.374695 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.374589    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-web-config\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.374695 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.374605    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.374695 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.374635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.374695 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.374662    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-config-out\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.374695 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.374687    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.375078 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.374711    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-config\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.375078 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.374738    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.375078 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.374757    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.375078 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.374782    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.375078 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.374806    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.375078 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.374829    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.375078 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.374849    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.375078 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.374869    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.375078 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.374920    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.375078 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.374948    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.375078 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.374990    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxdj6\" (UniqueName: \"kubernetes.io/projected/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-kube-api-access-cxdj6\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.375078 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.375016    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.375643 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.375230    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.375643 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.375408    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.375750 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.375714    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.376054 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.376030    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.376651 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.376622    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.377118 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.377096    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.378171 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.377915    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-web-config\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.378171 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.378039    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.378171 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.378062    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.378171 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.378135    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-config-out\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.379590 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.378556    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.379590 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.378955    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.379590 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.379354    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.380531 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.380499    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.380531 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.380513    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.380691 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.380675    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.380778 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.380759    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-config\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.381072 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.381055    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.381641 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.381624    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.386307 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.386284    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxdj6\" (UniqueName: \"kubernetes.io/projected/06f8c1fb-a990-4775-b5e4-6f7efeb20eeb-kube-api-access-cxdj6\") pod \"prometheus-k8s-0\" (UID: \"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.486927 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.486829    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:09:06.773548 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:06.773519    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 19:09:06.773640 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:09:06.773580    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f8c1fb_a990_4775_b5e4_6f7efeb20eeb.slice/crio-45f046464326134e97ff88e45939970ace71051afae742d26255afc766cb2aa2 WatchSource:0}: Error finding container 45f046464326134e97ff88e45939970ace71051afae742d26255afc766cb2aa2: Status 404 returned error can't find the container with id 45f046464326134e97ff88e45939970ace71051afae742d26255afc766cb2aa2
Sep 17 19:09:07.122270 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:07.122176    2573 generic.go:356] "Generic (PLEG): container finished" podID="06f8c1fb-a990-4775-b5e4-6f7efeb20eeb" containerID="96bf314e69eea427c14efa9bcdbda15e304522e0b07e6de490cf9814d54f564a" exitCode=0
Sep 17 19:09:07.122698 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:07.122270    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb","Type":"ContainerDied","Data":"96bf314e69eea427c14efa9bcdbda15e304522e0b07e6de490cf9814d54f564a"}
Sep 17 19:09:07.122698 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:07.122361    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb","Type":"ContainerStarted","Data":"45f046464326134e97ff88e45939970ace71051afae742d26255afc766cb2aa2"}
Sep 17 19:09:08.130839 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:08.130797    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb","Type":"ContainerStarted","Data":"039ccf52f6b0783461b684fec8ccbd92b5131671a561727375fc227cd54630db"}
Sep 17 19:09:08.131256 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:08.130907    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb","Type":"ContainerStarted","Data":"edf5ce024a1c6d03c956333624b25d6159563e2ec7f8e22e0f27f55f7594b5a8"}
Sep 17 19:09:08.131256 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:08.130961    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb","Type":"ContainerStarted","Data":"378511d7817782b2587778e7dc5f4cd2f804ea77ce132c65dfa427faf17aa411"}
Sep 17 19:09:08.131256 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:08.130996    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb","Type":"ContainerStarted","Data":"5f654540f190e6bc887d4046d43f966276241c534f069b66ff684519846c3a26"}
Sep 17 19:09:08.131256 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:08.131031    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb","Type":"ContainerStarted","Data":"a198332de61b44e259df66a67e39f8807bb914393e3f0cc6ec3ad03be4e339dd"}
Sep 17 19:09:08.131256 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:08.131067    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06f8c1fb-a990-4775-b5e4-6f7efeb20eeb","Type":"ContainerStarted","Data":"48aa4dd8d39208a41057a9a7f61d0b7358671326a5f344a69491c84d0c574e99"}
Sep 17 19:09:08.162619 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:08.162562    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.145570356 podStartE2EDuration="2.162541621s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.971265ms" isStatefulPod=false podCreationTimestamp="2026-09-17 19:09:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:09:08.160558296 +0000 UTC m=+174.099915219" watchObservedRunningTime="2026-09-17 19:09:08.162541621 +0000 UTC m=+174.101898543"
Sep 17 19:09:11.487246 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:09:11.487208    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:10:06.488121 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:10:06.488068    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:10:06.504778 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:10:06.504750    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:10:07.371303 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:10:07.371276    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 19:11:16.142583 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:11:16.142544    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbxgv_93bb0a24-3334-4d1f-a905-6f50ccd815ce/ovn-acl-logging/0.log"
Sep 17 19:11:16.146554 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:11:16.146524    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbxgv_93bb0a24-3334-4d1f-a905-6f50ccd815ce/ovn-acl-logging/0.log"
Sep 17 19:11:16.150357 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:11:16.150326    2573 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 19:13:32.434053 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:13:32.433975    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-b52z2"]
Sep 17 19:13:32.437358 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:13:32.437342    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-b52z2"
Sep 17 19:13:32.440281 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:13:32.440255    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Sep 17 19:13:32.440281 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:13:32.440255    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Sep 17 19:13:32.440466 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:13:32.440296    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Sep 17 19:13:32.441133 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:13:32.441117    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"hf-token\""
Sep 17 19:13:32.441224 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:13:32.441149    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-jwhxb\""
Sep 17 19:13:32.446257 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:13:32.446231    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-b52z2"]
Sep 17 19:13:32.560278 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:13:32.560239    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1bbfa72-ec62-4b43-8315-caebd3dc5b9f-model-cache\") pod \"s3-init-b52z2\" (UID: \"f1bbfa72-ec62-4b43-8315-caebd3dc5b9f\") " pod="kserve/s3-init-b52z2"
Sep 17 19:13:32.560477 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:13:32.560339    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdfqt\" (UniqueName: \"kubernetes.io/projected/f1bbfa72-ec62-4b43-8315-caebd3dc5b9f-kube-api-access-vdfqt\") pod \"s3-init-b52z2\" (UID: \"f1bbfa72-ec62-4b43-8315-caebd3dc5b9f\") " pod="kserve/s3-init-b52z2"
Sep 17 19:13:32.661226 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:13:32.661179    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1bbfa72-ec62-4b43-8315-caebd3dc5b9f-model-cache\") pod \"s3-init-b52z2\" (UID: \"f1bbfa72-ec62-4b43-8315-caebd3dc5b9f\") " pod="kserve/s3-init-b52z2"
Sep 17 19:13:32.661402 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:13:32.661307    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdfqt\" (UniqueName: \"kubernetes.io/projected/f1bbfa72-ec62-4b43-8315-caebd3dc5b9f-kube-api-access-vdfqt\") pod \"s3-init-b52z2\" (UID: \"f1bbfa72-ec62-4b43-8315-caebd3dc5b9f\") " pod="kserve/s3-init-b52z2"
Sep 17 19:13:32.661559 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:13:32.661540    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1bbfa72-ec62-4b43-8315-caebd3dc5b9f-model-cache\") pod \"s3-init-b52z2\" (UID: \"f1bbfa72-ec62-4b43-8315-caebd3dc5b9f\") " pod="kserve/s3-init-b52z2"
Sep 17 19:13:32.674913 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:13:32.674856    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdfqt\" (UniqueName: \"kubernetes.io/projected/f1bbfa72-ec62-4b43-8315-caebd3dc5b9f-kube-api-access-vdfqt\") pod \"s3-init-b52z2\" (UID: \"f1bbfa72-ec62-4b43-8315-caebd3dc5b9f\") " pod="kserve/s3-init-b52z2"
Sep 17 19:13:32.764029 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:13:32.763953    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-b52z2"
Sep 17 19:13:33.035798 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:13:33.035768    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-b52z2"]
Sep 17 19:13:33.038272 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:13:33.038243    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1bbfa72_ec62_4b43_8315_caebd3dc5b9f.slice/crio-79c5f0313d249794591a8b96c9d4a6f6aaafacaef69ba1d779cd1315083c77af WatchSource:0}: Error finding container 79c5f0313d249794591a8b96c9d4a6f6aaafacaef69ba1d779cd1315083c77af: Status 404 returned error can't find the container with id 79c5f0313d249794591a8b96c9d4a6f6aaafacaef69ba1d779cd1315083c77af
Sep 17 19:13:33.040225 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:13:33.040207    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 19:13:33.159381 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:13:33.159342    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-b52z2" event={"ID":"f1bbfa72-ec62-4b43-8315-caebd3dc5b9f","Type":"ContainerStarted","Data":"79c5f0313d249794591a8b96c9d4a6f6aaafacaef69ba1d779cd1315083c77af"}
Sep 17 19:13:37.178409 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:13:37.178372    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-b52z2" event={"ID":"f1bbfa72-ec62-4b43-8315-caebd3dc5b9f","Type":"ContainerStarted","Data":"b358dc42aa9b9a433056872fb865a2883398e13d1a7af9740e5b14be60b3be49"}
Sep 17 19:13:39.189064 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:13:39.189028    2573 generic.go:356] "Generic (PLEG): container finished" podID="f1bbfa72-ec62-4b43-8315-caebd3dc5b9f" containerID="b358dc42aa9b9a433056872fb865a2883398e13d1a7af9740e5b14be60b3be49" exitCode=0
Sep 17 19:13:39.189401 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:13:39.189069    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-b52z2" event={"ID":"f1bbfa72-ec62-4b43-8315-caebd3dc5b9f","Type":"ContainerDied","Data":"b358dc42aa9b9a433056872fb865a2883398e13d1a7af9740e5b14be60b3be49"}
Sep 17 19:13:44.213807 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:13:44.213769    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-b52z2" event={"ID":"f1bbfa72-ec62-4b43-8315-caebd3dc5b9f","Type":"ContainerStarted","Data":"3da831f3802f5179c5481c78368f6646671d65894aed2656c26a98706ba3eda1"}
Sep 17 19:13:44.250311 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:13:44.250265    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-b52z2" podStartSLOduration=1.826327045 podStartE2EDuration="12.250249958s" totalImagesPullingTime="8.464631696s" totalInitContainerRuntime="1.959291217s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:13:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:13:44.24971825 +0000 UTC m=+450.189075172" watchObservedRunningTime="2026-09-17 19:13:44.250249958 +0000 UTC m=+450.189606878"
Sep 17 19:14:49.464731 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:14:49.464694    2573 generic.go:356] "Generic (PLEG): container finished" podID="f1bbfa72-ec62-4b43-8315-caebd3dc5b9f" containerID="3da831f3802f5179c5481c78368f6646671d65894aed2656c26a98706ba3eda1" exitCode=0
Sep 17 19:14:49.465168 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:14:49.464753    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-b52z2" event={"ID":"f1bbfa72-ec62-4b43-8315-caebd3dc5b9f","Type":"ContainerDied","Data":"3da831f3802f5179c5481c78368f6646671d65894aed2656c26a98706ba3eda1"}
Sep 17 19:14:50.590382 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:14:50.590358    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-b52z2"
Sep 17 19:14:50.723968 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:14:50.723857    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdfqt\" (UniqueName: \"kubernetes.io/projected/f1bbfa72-ec62-4b43-8315-caebd3dc5b9f-kube-api-access-vdfqt\") pod \"f1bbfa72-ec62-4b43-8315-caebd3dc5b9f\" (UID: \"f1bbfa72-ec62-4b43-8315-caebd3dc5b9f\") "
Sep 17 19:14:50.724140 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:14:50.723986    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1bbfa72-ec62-4b43-8315-caebd3dc5b9f-model-cache\") pod \"f1bbfa72-ec62-4b43-8315-caebd3dc5b9f\" (UID: \"f1bbfa72-ec62-4b43-8315-caebd3dc5b9f\") "
Sep 17 19:14:50.726271 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:14:50.726232    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1bbfa72-ec62-4b43-8315-caebd3dc5b9f-kube-api-access-vdfqt" (OuterVolumeSpecName: "kube-api-access-vdfqt") pod "f1bbfa72-ec62-4b43-8315-caebd3dc5b9f" (UID: "f1bbfa72-ec62-4b43-8315-caebd3dc5b9f"). InnerVolumeSpecName "kube-api-access-vdfqt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:14:50.746313 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:14:50.746285    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1bbfa72-ec62-4b43-8315-caebd3dc5b9f-model-cache" (OuterVolumeSpecName: "model-cache") pod "f1bbfa72-ec62-4b43-8315-caebd3dc5b9f" (UID: "f1bbfa72-ec62-4b43-8315-caebd3dc5b9f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 19:14:50.824847 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:14:50.824815    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1bbfa72-ec62-4b43-8315-caebd3dc5b9f-model-cache\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:14:50.824847 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:14:50.824842    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdfqt\" (UniqueName: \"kubernetes.io/projected/f1bbfa72-ec62-4b43-8315-caebd3dc5b9f-kube-api-access-vdfqt\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:14:51.474012 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:14:51.473970    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-b52z2" event={"ID":"f1bbfa72-ec62-4b43-8315-caebd3dc5b9f","Type":"ContainerDied","Data":"79c5f0313d249794591a8b96c9d4a6f6aaafacaef69ba1d779cd1315083c77af"}
Sep 17 19:14:51.474012 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:14:51.474010    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79c5f0313d249794591a8b96c9d4a6f6aaafacaef69ba1d779cd1315083c77af"
Sep 17 19:14:51.474212 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:14:51.474016    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-b52z2"
Sep 17 19:15:05.454621 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.454585    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"]
Sep 17 19:15:05.455135 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.454943    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1bbfa72-ec62-4b43-8315-caebd3dc5b9f" containerName="download-hf-model"
Sep 17 19:15:05.455135 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.454957    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1bbfa72-ec62-4b43-8315-caebd3dc5b9f" containerName="download-hf-model"
Sep 17 19:15:05.455135 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.454993    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1bbfa72-ec62-4b43-8315-caebd3dc5b9f" containerName="s3-init"
Sep 17 19:15:05.455135 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.454999    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1bbfa72-ec62-4b43-8315-caebd3dc5b9f" containerName="s3-init"
Sep 17 19:15:05.455135 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.455058    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1bbfa72-ec62-4b43-8315-caebd3dc5b9f" containerName="s3-init"
Sep 17 19:15:05.458129 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.458112    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"
Sep 17 19:15:05.462118 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.462095    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Sep 17 19:15:05.463172 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.463155    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 17 19:15:05.463281 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.463241    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 17 19:15:05.463281 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.463266    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-kube-rbac-proxy-sar-config\""
Sep 17 19:15:05.463393 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.463321    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vpx7x\""
Sep 17 19:15:05.467906 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.467868    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 17 19:15:05.468010 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.467959    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-v2-predictor-serving-cert\""
Sep 17 19:15:05.472948 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.472924    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"]
Sep 17 19:15:05.536397 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.536362    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf\" (UID: \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"
Sep 17 19:15:05.536397 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.536397    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-kserve-provision-location\") pod \"isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf\" (UID: \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"
Sep 17 19:15:05.536615 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.536428    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-cabundle-cert\") pod \"isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf\" (UID: \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"
Sep 17 19:15:05.536615 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.536478    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-proxy-tls\") pod \"isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf\" (UID: \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"
Sep 17 19:15:05.536615 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.536501    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2ctw\" (UniqueName: \"kubernetes.io/projected/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-kube-api-access-n2ctw\") pod \"isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf\" (UID: \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"
Sep 17 19:15:05.636931 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.636892    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2ctw\" (UniqueName: \"kubernetes.io/projected/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-kube-api-access-n2ctw\") pod \"isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf\" (UID: \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"
Sep 17 19:15:05.637121 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.636942    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf\" (UID: \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"
Sep 17 19:15:05.637121 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.636970    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-kserve-provision-location\") pod \"isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf\" (UID: \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"
Sep 17 19:15:05.637121 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.637022    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-cabundle-cert\") pod \"isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf\" (UID: \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"
Sep 17 19:15:05.637121 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.637061    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-proxy-tls\") pod \"isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf\" (UID: \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"
Sep 17 19:15:05.637471 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.637451    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-kserve-provision-location\") pod \"isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf\" (UID: \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"
Sep 17 19:15:05.637727 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.637668    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf\" (UID: \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"
Sep 17 19:15:05.637727 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.637683    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-cabundle-cert\") pod \"isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf\" (UID: \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"
Sep 17 19:15:05.639734 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.639708    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-proxy-tls\") pod \"isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf\" (UID: \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"
Sep 17 19:15:05.653102 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.653071    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2ctw\" (UniqueName: \"kubernetes.io/projected/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-kube-api-access-n2ctw\") pod \"isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf\" (UID: \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"
Sep 17 19:15:05.690225 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.690191    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"]
Sep 17 19:15:05.693928 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.693908    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"
Sep 17 19:15:05.696687 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.696667    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-predictor-serving-cert\""
Sep 17 19:15:05.706428 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.706372    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"]
Sep 17 19:15:05.737999 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.737961    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/87c2b26f-a1bf-48ca-b628-d6addf25c390-cabundle-cert\") pod \"isvc-canary-rollback-predictor-97977b6b5-6g26f\" (UID: \"87c2b26f-a1bf-48ca-b628-d6addf25c390\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"
Sep 17 19:15:05.737999 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.738005    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/87c2b26f-a1bf-48ca-b628-d6addf25c390-proxy-tls\") pod \"isvc-canary-rollback-predictor-97977b6b5-6g26f\" (UID: \"87c2b26f-a1bf-48ca-b628-d6addf25c390\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"
Sep 17 19:15:05.738223 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.738034    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhr4z\" (UniqueName: \"kubernetes.io/projected/87c2b26f-a1bf-48ca-b628-d6addf25c390-kube-api-access-fhr4z\") pod \"isvc-canary-rollback-predictor-97977b6b5-6g26f\" (UID: \"87c2b26f-a1bf-48ca-b628-d6addf25c390\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"
Sep 17 19:15:05.738223 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.738085    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87c2b26f-a1bf-48ca-b628-d6addf25c390-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-97977b6b5-6g26f\" (UID: \"87c2b26f-a1bf-48ca-b628-d6addf25c390\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"
Sep 17 19:15:05.738223 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.738121    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/87c2b26f-a1bf-48ca-b628-d6addf25c390-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-97977b6b5-6g26f\" (UID: \"87c2b26f-a1bf-48ca-b628-d6addf25c390\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"
Sep 17 19:15:05.768078 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.768018    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"
Sep 17 19:15:05.839039 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.839006    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/87c2b26f-a1bf-48ca-b628-d6addf25c390-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-97977b6b5-6g26f\" (UID: \"87c2b26f-a1bf-48ca-b628-d6addf25c390\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"
Sep 17 19:15:05.839207 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.839056    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/87c2b26f-a1bf-48ca-b628-d6addf25c390-cabundle-cert\") pod \"isvc-canary-rollback-predictor-97977b6b5-6g26f\" (UID: \"87c2b26f-a1bf-48ca-b628-d6addf25c390\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"
Sep 17 19:15:05.839207 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.839079    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/87c2b26f-a1bf-48ca-b628-d6addf25c390-proxy-tls\") pod \"isvc-canary-rollback-predictor-97977b6b5-6g26f\" (UID: \"87c2b26f-a1bf-48ca-b628-d6addf25c390\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"
Sep 17 19:15:05.839207 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.839102    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhr4z\" (UniqueName: \"kubernetes.io/projected/87c2b26f-a1bf-48ca-b628-d6addf25c390-kube-api-access-fhr4z\") pod \"isvc-canary-rollback-predictor-97977b6b5-6g26f\" (UID: \"87c2b26f-a1bf-48ca-b628-d6addf25c390\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"
Sep 17 19:15:05.839207 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.839129    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87c2b26f-a1bf-48ca-b628-d6addf25c390-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-97977b6b5-6g26f\" (UID: \"87c2b26f-a1bf-48ca-b628-d6addf25c390\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"
Sep 17 19:15:05.839604 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.839577    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87c2b26f-a1bf-48ca-b628-d6addf25c390-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-97977b6b5-6g26f\" (UID: \"87c2b26f-a1bf-48ca-b628-d6addf25c390\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"
Sep 17 19:15:05.839786 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.839766    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/87c2b26f-a1bf-48ca-b628-d6addf25c390-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-97977b6b5-6g26f\" (UID: \"87c2b26f-a1bf-48ca-b628-d6addf25c390\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"
Sep 17 19:15:05.839855 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.839774    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/87c2b26f-a1bf-48ca-b628-d6addf25c390-cabundle-cert\") pod \"isvc-canary-rollback-predictor-97977b6b5-6g26f\" (UID: \"87c2b26f-a1bf-48ca-b628-d6addf25c390\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"
Sep 17 19:15:05.842161 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.842141    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/87c2b26f-a1bf-48ca-b628-d6addf25c390-proxy-tls\") pod \"isvc-canary-rollback-predictor-97977b6b5-6g26f\" (UID: \"87c2b26f-a1bf-48ca-b628-d6addf25c390\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"
Sep 17 19:15:05.850902 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:05.850853    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhr4z\" (UniqueName: \"kubernetes.io/projected/87c2b26f-a1bf-48ca-b628-d6addf25c390-kube-api-access-fhr4z\") pod \"isvc-canary-rollback-predictor-97977b6b5-6g26f\" (UID: \"87c2b26f-a1bf-48ca-b628-d6addf25c390\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"
Sep 17 19:15:06.004625 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:06.004526    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"
Sep 17 19:15:06.051859 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:06.051832    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"]
Sep 17 19:15:06.054739 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:15:06.054704    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ded7f9_e7d2_48d0_b611_d8dc74f41218.slice/crio-f61049fbfebbd5889f38f94d359a4bc981ed0ed5041ae5dcc05e23eb33697051 WatchSource:0}: Error finding container f61049fbfebbd5889f38f94d359a4bc981ed0ed5041ae5dcc05e23eb33697051: Status 404 returned error can't find the container with id f61049fbfebbd5889f38f94d359a4bc981ed0ed5041ae5dcc05e23eb33697051
Sep 17 19:15:06.283009 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:06.282977    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"]
Sep 17 19:15:06.285151 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:15:06.285119    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87c2b26f_a1bf_48ca_b628_d6addf25c390.slice/crio-cc28eb85bb7a038a885b65bf23074f63113249271c7c6e4a2a7c94d64738d05b WatchSource:0}: Error finding container cc28eb85bb7a038a885b65bf23074f63113249271c7c6e4a2a7c94d64738d05b: Status 404 returned error can't find the container with id cc28eb85bb7a038a885b65bf23074f63113249271c7c6e4a2a7c94d64738d05b
Sep 17 19:15:06.533492 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:06.533377    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f" event={"ID":"87c2b26f-a1bf-48ca-b628-d6addf25c390","Type":"ContainerStarted","Data":"95bc0ce8bf6b6dfed0914c00915500136e3fa40e76b3f4fc72d03b77ed296e0e"}
Sep 17 19:15:06.533492 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:06.533459    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f" event={"ID":"87c2b26f-a1bf-48ca-b628-d6addf25c390","Type":"ContainerStarted","Data":"cc28eb85bb7a038a885b65bf23074f63113249271c7c6e4a2a7c94d64738d05b"}
Sep 17 19:15:06.535246 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:06.535218    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf" event={"ID":"b9ded7f9-e7d2-48d0-b611-d8dc74f41218","Type":"ContainerStarted","Data":"af68bc9071532e39cc7bfd4543d89815b82ac7bccc632031117532bdb179e768"}
Sep 17 19:15:06.535351 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:06.535273    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf" event={"ID":"b9ded7f9-e7d2-48d0-b611-d8dc74f41218","Type":"ContainerStarted","Data":"f61049fbfebbd5889f38f94d359a4bc981ed0ed5041ae5dcc05e23eb33697051"}
Sep 17 19:15:10.555827 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:10.555794    2573 generic.go:356] "Generic (PLEG): container finished" podID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerID="95bc0ce8bf6b6dfed0914c00915500136e3fa40e76b3f4fc72d03b77ed296e0e" exitCode=0
Sep 17 19:15:10.556304 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:10.555871    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f" event={"ID":"87c2b26f-a1bf-48ca-b628-d6addf25c390","Type":"ContainerDied","Data":"95bc0ce8bf6b6dfed0914c00915500136e3fa40e76b3f4fc72d03b77ed296e0e"}
Sep 17 19:15:10.557641 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:10.557559    2573 generic.go:356] "Generic (PLEG): container finished" podID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerID="af68bc9071532e39cc7bfd4543d89815b82ac7bccc632031117532bdb179e768" exitCode=0
Sep 17 19:15:10.557700 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:10.557635    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf" event={"ID":"b9ded7f9-e7d2-48d0-b611-d8dc74f41218","Type":"ContainerDied","Data":"af68bc9071532e39cc7bfd4543d89815b82ac7bccc632031117532bdb179e768"}
Sep 17 19:15:27.664745 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:27.664705    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f" event={"ID":"87c2b26f-a1bf-48ca-b628-d6addf25c390","Type":"ContainerStarted","Data":"54929331cc65b1661a9c69c15226587acd3d99033bcbef1c159e22304dc16605"}
Sep 17 19:15:27.667359 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:27.667327    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf" event={"ID":"b9ded7f9-e7d2-48d0-b611-d8dc74f41218","Type":"ContainerStarted","Data":"7db9d56a974921c94123302ab756a6811509f9e8d5e64180cca517bf6bd57fd1"}
Sep 17 19:15:29.680464 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:29.680373    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f" event={"ID":"87c2b26f-a1bf-48ca-b628-d6addf25c390","Type":"ContainerStarted","Data":"4fd208b3ce16efcec9c2f678db925a580df99f8e2efbb253dcc161522c53423f"}
Sep 17 19:15:29.680931 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:29.680589    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"
Sep 17 19:15:29.680931 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:29.680737    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"
Sep 17 19:15:29.681986 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:29.681957    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f" podUID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Sep 17 19:15:29.682683 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:29.682662    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf" event={"ID":"b9ded7f9-e7d2-48d0-b611-d8dc74f41218","Type":"ContainerStarted","Data":"08c018ce0e6aaa3ccb8f0f950b2a9610ad36bab789ffa3c474536c7b2e3c06d6"}
Sep 17 19:15:29.682754 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:29.682710    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"
Sep 17 19:15:29.682813 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:29.682771    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"
Sep 17 19:15:29.683625 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:29.683605    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf" podUID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 17 19:15:29.701563 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:29.701523    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f" podStartSLOduration=2.136864188 podStartE2EDuration="24.701509997s" totalImagesPullingTime="18.623048666s" totalInitContainerRuntime="3.941597143s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:15:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:15:29.699287134 +0000 UTC m=+555.638644051" watchObservedRunningTime="2026-09-17 19:15:29.701509997 +0000 UTC m=+555.640866916"
Sep 17 19:15:29.718869 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:29.718808    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf" podStartSLOduration=2.13408406 podStartE2EDuration="24.71878917s" totalImagesPullingTime="18.647686698s" totalInitContainerRuntime="3.937018412s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:15:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:15:29.717911766 +0000 UTC m=+555.657268700" watchObservedRunningTime="2026-09-17 19:15:29.71878917 +0000 UTC m=+555.658146090"
Sep 17 19:15:30.686765 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:30.686716    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf" podUID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 17 19:15:30.686765 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:30.686728    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f" podUID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Sep 17 19:15:35.690711 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:35.690678    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"
Sep 17 19:15:35.691256 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:35.691238    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"
Sep 17 19:15:35.691309 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:35.691277    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f" podUID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Sep 17 19:15:35.691791 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:35.691772    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf" podUID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 17 19:15:45.691937 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:45.691874    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf" podUID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 17 19:15:45.692553 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:45.691872    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f" podUID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Sep 17 19:15:55.691781 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:55.691732    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf" podUID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 17 19:15:55.691781 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:15:55.691750    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f" podUID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Sep 17 19:16:05.692168 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:16:05.692127    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf" podUID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 17 19:16:05.692556 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:16:05.692183    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f" podUID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Sep 17 19:16:15.691623 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:16:15.691583    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f" podUID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Sep 17 19:16:15.692115 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:16:15.691712    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf" podUID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 17 19:16:16.174446 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:16:16.174366    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbxgv_93bb0a24-3334-4d1f-a905-6f50ccd815ce/ovn-acl-logging/0.log"
Sep 17 19:16:16.176322 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:16:16.176301    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbxgv_93bb0a24-3334-4d1f-a905-6f50ccd815ce/ovn-acl-logging/0.log"
Sep 17 19:16:25.691393 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:16:25.691357    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f" podUID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Sep 17 19:16:25.691950 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:16:25.691830    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf" podUID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 17 19:16:35.692207 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:16:35.692161    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f" podUID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Sep 17 19:16:35.692639 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:16:35.692161    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf" podUID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 17 19:16:45.692297 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:16:45.692268    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"
Sep 17 19:16:45.692735 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:16:45.692723    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"
Sep 17 19:16:55.188952 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:16:55.188919    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"]
Sep 17 19:16:55.189405 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:16:55.189216    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf" podUID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerName="kserve-container" containerID="cri-o://7db9d56a974921c94123302ab756a6811509f9e8d5e64180cca517bf6bd57fd1" gracePeriod=30
Sep 17 19:16:55.189405 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:16:55.189252    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf" podUID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerName="kube-rbac-proxy" containerID="cri-o://08c018ce0e6aaa3ccb8f0f950b2a9610ad36bab789ffa3c474536c7b2e3c06d6" gracePeriod=30
Sep 17 19:16:55.687209 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:16:55.687166    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf" podUID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.24:8643/healthz\": dial tcp 10.132.0.24:8643: connect: connection refused"
Sep 17 19:16:55.692021 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:16:55.691987    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf" podUID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 17 19:16:56.050274 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:16:56.050190    2573 generic.go:356] "Generic (PLEG): container finished" podID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerID="08c018ce0e6aaa3ccb8f0f950b2a9610ad36bab789ffa3c474536c7b2e3c06d6" exitCode=2
Sep 17 19:16:56.050274 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:16:56.050258    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf" event={"ID":"b9ded7f9-e7d2-48d0-b611-d8dc74f41218","Type":"ContainerDied","Data":"08c018ce0e6aaa3ccb8f0f950b2a9610ad36bab789ffa3c474536c7b2e3c06d6"}
Sep 17 19:17:00.070165 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.070135    2573 generic.go:356] "Generic (PLEG): container finished" podID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerID="7db9d56a974921c94123302ab756a6811509f9e8d5e64180cca517bf6bd57fd1" exitCode=0
Sep 17 19:17:00.070560 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.070207    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf" event={"ID":"b9ded7f9-e7d2-48d0-b611-d8dc74f41218","Type":"ContainerDied","Data":"7db9d56a974921c94123302ab756a6811509f9e8d5e64180cca517bf6bd57fd1"}
Sep 17 19:17:00.124051 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.124027    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"
Sep 17 19:17:00.127911 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.127868    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-proxy-tls\") pod \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\" (UID: \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\") "
Sep 17 19:17:00.128030 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.127925    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-kube-rbac-proxy-sar-config\") pod \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\" (UID: \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\") "
Sep 17 19:17:00.128030 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.127981    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-kserve-provision-location\") pod \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\" (UID: \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\") "
Sep 17 19:17:00.128263 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.128241    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "b9ded7f9-e7d2-48d0-b611-d8dc74f41218" (UID: "b9ded7f9-e7d2-48d0-b611-d8dc74f41218"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:17:00.128324 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.128255    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "b9ded7f9-e7d2-48d0-b611-d8dc74f41218" (UID: "b9ded7f9-e7d2-48d0-b611-d8dc74f41218"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 19:17:00.130082 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.130062    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b9ded7f9-e7d2-48d0-b611-d8dc74f41218" (UID: "b9ded7f9-e7d2-48d0-b611-d8dc74f41218"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:17:00.228745 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.228719    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2ctw\" (UniqueName: \"kubernetes.io/projected/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-kube-api-access-n2ctw\") pod \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\" (UID: \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\") "
Sep 17 19:17:00.228911 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.228754    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-cabundle-cert\") pod \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\" (UID: \"b9ded7f9-e7d2-48d0-b611-d8dc74f41218\") "
Sep 17 19:17:00.228962 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.228952    2573 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-proxy-tls\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:17:00.228994 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.228972    2573 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:17:00.228994 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.228986    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-kserve-provision-location\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:17:00.229130 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.229104    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "b9ded7f9-e7d2-48d0-b611-d8dc74f41218" (UID: "b9ded7f9-e7d2-48d0-b611-d8dc74f41218"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:17:00.230859 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.230827    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-kube-api-access-n2ctw" (OuterVolumeSpecName: "kube-api-access-n2ctw") pod "b9ded7f9-e7d2-48d0-b611-d8dc74f41218" (UID: "b9ded7f9-e7d2-48d0-b611-d8dc74f41218"). InnerVolumeSpecName "kube-api-access-n2ctw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:17:00.330058 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.330031    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2ctw\" (UniqueName: \"kubernetes.io/projected/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-kube-api-access-n2ctw\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:17:00.330058 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.330055    2573 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b9ded7f9-e7d2-48d0-b611-d8dc74f41218-cabundle-cert\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:17:00.918265 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.918232    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"]
Sep 17 19:17:00.918596 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.918583    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerName="kube-rbac-proxy"
Sep 17 19:17:00.918647 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.918597    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerName="kube-rbac-proxy"
Sep 17 19:17:00.918647 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.918615    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerName="kserve-container"
Sep 17 19:17:00.918647 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.918620    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerName="kserve-container"
Sep 17 19:17:00.918647 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.918628    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerName="storage-initializer"
Sep 17 19:17:00.918647 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.918635    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerName="storage-initializer"
Sep 17 19:17:00.918810 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.918683    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerName="kube-rbac-proxy"
Sep 17 19:17:00.918810 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.918691    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" containerName="kserve-container"
Sep 17 19:17:00.920803 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.920785    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:17:00.923659 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.923630    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-raw-e3e91-predictor-serving-cert\""
Sep 17 19:17:00.923794 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.923778    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-raw-e3e91-kube-rbac-proxy-sar-config\""
Sep 17 19:17:00.934378 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.934063    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a81b71d6-f8f4-4920-a396-11b734d76843-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl\" (UID: \"a81b71d6-f8f4-4920-a396-11b734d76843\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:17:00.934537 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.934515    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a81b71d6-f8f4-4920-a396-11b734d76843-proxy-tls\") pod \"isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl\" (UID: \"a81b71d6-f8f4-4920-a396-11b734d76843\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:17:00.934608 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.934557    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a81b71d6-f8f4-4920-a396-11b734d76843-cabundle-cert\") pod \"isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl\" (UID: \"a81b71d6-f8f4-4920-a396-11b734d76843\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:17:00.934608 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.934593    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc2lq\" (UniqueName: \"kubernetes.io/projected/a81b71d6-f8f4-4920-a396-11b734d76843-kube-api-access-jc2lq\") pod \"isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl\" (UID: \"a81b71d6-f8f4-4920-a396-11b734d76843\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:17:00.934703 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.934623    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a81b71d6-f8f4-4920-a396-11b734d76843-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl\" (UID: \"a81b71d6-f8f4-4920-a396-11b734d76843\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:17:00.935736 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:00.935718    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"]
Sep 17 19:17:01.032000 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.031967    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"]
Sep 17 19:17:01.034390 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.034373    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"
Sep 17 19:17:01.035063 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.035044    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a81b71d6-f8f4-4920-a396-11b734d76843-proxy-tls\") pod \"isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl\" (UID: \"a81b71d6-f8f4-4920-a396-11b734d76843\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:17:01.035153 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.035076    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a81b71d6-f8f4-4920-a396-11b734d76843-cabundle-cert\") pod \"isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl\" (UID: \"a81b71d6-f8f4-4920-a396-11b734d76843\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:17:01.035153 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.035099    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc2lq\" (UniqueName: \"kubernetes.io/projected/a81b71d6-f8f4-4920-a396-11b734d76843-kube-api-access-jc2lq\") pod \"isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl\" (UID: \"a81b71d6-f8f4-4920-a396-11b734d76843\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:17:01.035237 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:17:01.035193    2573 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-serving-cert: secret "isvc-sklearn-graph-raw-e3e91-predictor-serving-cert" not found
Sep 17 19:17:01.035237 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.035217    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a81b71d6-f8f4-4920-a396-11b734d76843-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl\" (UID: \"a81b71d6-f8f4-4920-a396-11b734d76843\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:17:01.035312 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:17:01.035264    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a81b71d6-f8f4-4920-a396-11b734d76843-proxy-tls podName:a81b71d6-f8f4-4920-a396-11b734d76843 nodeName:}" failed. No retries permitted until 2026-09-17 19:17:01.535245863 +0000 UTC m=+647.474602780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/a81b71d6-f8f4-4920-a396-11b734d76843-proxy-tls") pod "isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl" (UID: "a81b71d6-f8f4-4920-a396-11b734d76843") : secret "isvc-sklearn-graph-raw-e3e91-predictor-serving-cert" not found
Sep 17 19:17:01.035312 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.035282    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a81b71d6-f8f4-4920-a396-11b734d76843-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl\" (UID: \"a81b71d6-f8f4-4920-a396-11b734d76843\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:17:01.035599 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.035574    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a81b71d6-f8f4-4920-a396-11b734d76843-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl\" (UID: \"a81b71d6-f8f4-4920-a396-11b734d76843\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:17:01.035739 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.035722    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a81b71d6-f8f4-4920-a396-11b734d76843-cabundle-cert\") pod \"isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl\" (UID: \"a81b71d6-f8f4-4920-a396-11b734d76843\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:17:01.035841 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.035824    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a81b71d6-f8f4-4920-a396-11b734d76843-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl\" (UID: \"a81b71d6-f8f4-4920-a396-11b734d76843\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:17:01.037836 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.037818    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-raw-e3e91-predictor-serving-cert\""
Sep 17 19:17:01.037951 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.037842    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-raw-e3e91-kube-rbac-proxy-sar-config\""
Sep 17 19:17:01.052004 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.051983    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"]
Sep 17 19:17:01.055184 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.055164    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc2lq\" (UniqueName: \"kubernetes.io/projected/a81b71d6-f8f4-4920-a396-11b734d76843-kube-api-access-jc2lq\") pod \"isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl\" (UID: \"a81b71d6-f8f4-4920-a396-11b734d76843\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:17:01.077102 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.077082    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"
Sep 17 19:17:01.077375 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.077092    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf" event={"ID":"b9ded7f9-e7d2-48d0-b611-d8dc74f41218","Type":"ContainerDied","Data":"f61049fbfebbd5889f38f94d359a4bc981ed0ed5041ae5dcc05e23eb33697051"}
Sep 17 19:17:01.077375 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.077156    2573 scope.go:117] "RemoveContainer" containerID="08c018ce0e6aaa3ccb8f0f950b2a9610ad36bab789ffa3c474536c7b2e3c06d6"
Sep 17 19:17:01.085713 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.085697    2573 scope.go:117] "RemoveContainer" containerID="7db9d56a974921c94123302ab756a6811509f9e8d5e64180cca517bf6bd57fd1"
Sep 17 19:17:01.093244 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.093228    2573 scope.go:117] "RemoveContainer" containerID="af68bc9071532e39cc7bfd4543d89815b82ac7bccc632031117532bdb179e768"
Sep 17 19:17:01.101207 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.101183    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"]
Sep 17 19:17:01.105531 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.105507    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-v2-predictor-5db5496f8d-pprmf"]
Sep 17 19:17:01.136120 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.136083    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-proxy-tls\") pod \"isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj\" (UID: \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"
Sep 17 19:17:01.136217 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.136131    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhvsz\" (UniqueName: \"kubernetes.io/projected/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-kube-api-access-vhvsz\") pod \"isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj\" (UID: \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"
Sep 17 19:17:01.136217 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.136160    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj\" (UID: \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"
Sep 17 19:17:01.136285 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.136246    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj\" (UID: \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"
Sep 17 19:17:01.136318 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.136282    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-cabundle-cert\") pod \"isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj\" (UID: \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"
Sep 17 19:17:01.237349 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.237319    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj\" (UID: \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"
Sep 17 19:17:01.237505 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.237364    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-cabundle-cert\") pod \"isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj\" (UID: \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"
Sep 17 19:17:01.237505 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.237469    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-proxy-tls\") pod \"isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj\" (UID: \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"
Sep 17 19:17:01.237505 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.237495    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhvsz\" (UniqueName: \"kubernetes.io/projected/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-kube-api-access-vhvsz\") pod \"isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj\" (UID: \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"
Sep 17 19:17:01.237653 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.237529    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj\" (UID: \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"
Sep 17 19:17:01.237900 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.237856    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj\" (UID: \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"
Sep 17 19:17:01.238063 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.238040    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-cabundle-cert\") pod \"isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj\" (UID: \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"
Sep 17 19:17:01.238163 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.238129    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj\" (UID: \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"
Sep 17 19:17:01.240193 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.240176    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-proxy-tls\") pod \"isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj\" (UID: \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"
Sep 17 19:17:01.247105 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.247086    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhvsz\" (UniqueName: \"kubernetes.io/projected/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-kube-api-access-vhvsz\") pod \"isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj\" (UID: \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"
Sep 17 19:17:01.344263 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.344227    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"
Sep 17 19:17:01.540665 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.540573    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a81b71d6-f8f4-4920-a396-11b734d76843-proxy-tls\") pod \"isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl\" (UID: \"a81b71d6-f8f4-4920-a396-11b734d76843\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:17:01.543066 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.543045    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a81b71d6-f8f4-4920-a396-11b734d76843-proxy-tls\") pod \"isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl\" (UID: \"a81b71d6-f8f4-4920-a396-11b734d76843\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:17:01.623635 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.623611    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"]
Sep 17 19:17:01.625999 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:17:01.625964    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1db3813d_cd81_4e39_a1f0_81a0d0e2d7d0.slice/crio-aa2348629bead77de14bbc8b0af717954f6ee114f5c513cd5c862bec276c6a70 WatchSource:0}: Error finding container aa2348629bead77de14bbc8b0af717954f6ee114f5c513cd5c862bec276c6a70: Status 404 returned error can't find the container with id aa2348629bead77de14bbc8b0af717954f6ee114f5c513cd5c862bec276c6a70
Sep 17 19:17:01.830723 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:01.830633    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:17:02.084468 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:02.084375    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj" event={"ID":"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0","Type":"ContainerStarted","Data":"dddde20fd9e3d4eb0dc63f4d09f2fd7049e02f2e211d62b8eaed5a723706aaba"}
Sep 17 19:17:02.084468 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:02.084448    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj" event={"ID":"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0","Type":"ContainerStarted","Data":"aa2348629bead77de14bbc8b0af717954f6ee114f5c513cd5c862bec276c6a70"}
Sep 17 19:17:02.106814 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:02.106763    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"]
Sep 17 19:17:02.108221 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:17:02.108191    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda81b71d6_f8f4_4920_a396_11b734d76843.slice/crio-4efcb2c7710b93f3ab079a690ddffadd11abbfda807a4377314baea0bea2721b WatchSource:0}: Error finding container 4efcb2c7710b93f3ab079a690ddffadd11abbfda807a4377314baea0bea2721b: Status 404 returned error can't find the container with id 4efcb2c7710b93f3ab079a690ddffadd11abbfda807a4377314baea0bea2721b
Sep 17 19:17:02.227799 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:02.227748    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9ded7f9-e7d2-48d0-b611-d8dc74f41218" path="/var/lib/kubelet/pods/b9ded7f9-e7d2-48d0-b611-d8dc74f41218/volumes"
Sep 17 19:17:03.091171 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:03.091126    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl" event={"ID":"a81b71d6-f8f4-4920-a396-11b734d76843","Type":"ContainerStarted","Data":"a72435b4b1fdead77454357fc639dfe6d4ece1ca363269f31dfbb2992915cad0"}
Sep 17 19:17:03.091647 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:03.091231    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl" event={"ID":"a81b71d6-f8f4-4920-a396-11b734d76843","Type":"ContainerStarted","Data":"4efcb2c7710b93f3ab079a690ddffadd11abbfda807a4377314baea0bea2721b"}
Sep 17 19:17:06.105748 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:06.105719    2573 generic.go:356] "Generic (PLEG): container finished" podID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerID="dddde20fd9e3d4eb0dc63f4d09f2fd7049e02f2e211d62b8eaed5a723706aaba" exitCode=0
Sep 17 19:17:06.106115 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:06.105793    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj" event={"ID":"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0","Type":"ContainerDied","Data":"dddde20fd9e3d4eb0dc63f4d09f2fd7049e02f2e211d62b8eaed5a723706aaba"}
Sep 17 19:17:06.107729 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:06.107646    2573 generic.go:356] "Generic (PLEG): container finished" podID="a81b71d6-f8f4-4920-a396-11b734d76843" containerID="a72435b4b1fdead77454357fc639dfe6d4ece1ca363269f31dfbb2992915cad0" exitCode=0
Sep 17 19:17:06.107729 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:06.107683    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl" event={"ID":"a81b71d6-f8f4-4920-a396-11b734d76843","Type":"ContainerDied","Data":"a72435b4b1fdead77454357fc639dfe6d4ece1ca363269f31dfbb2992915cad0"}
Sep 17 19:17:07.114847 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:07.114811    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl" event={"ID":"a81b71d6-f8f4-4920-a396-11b734d76843","Type":"ContainerStarted","Data":"265d5529acd447624d719e066aa5e2c2c7069ffc2809717bf62434078d03122c"}
Sep 17 19:17:07.115367 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:07.114913    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl" event={"ID":"a81b71d6-f8f4-4920-a396-11b734d76843","Type":"ContainerStarted","Data":"e1ac1c58bdf998835d0aefb451e045cea92c55552dd9918f5c70b1f9fcea94dc"}
Sep 17 19:17:07.115367 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:07.115280    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:17:07.115367 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:07.115343    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:17:07.117162 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:07.117134    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl" podUID="a81b71d6-f8f4-4920-a396-11b734d76843" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 19:17:07.140833 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:07.140781    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl" podStartSLOduration=3.255271079 podStartE2EDuration="7.140764493s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.885493414s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:17:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:17:07.139384236 +0000 UTC m=+653.078741151" watchObservedRunningTime="2026-09-17 19:17:07.140764493 +0000 UTC m=+653.080121412"
Sep 17 19:17:08.124495 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:08.124446    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl" podUID="a81b71d6-f8f4-4920-a396-11b734d76843" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 19:17:13.129553 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:13.129523    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:17:13.130266 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:13.130227    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl" podUID="a81b71d6-f8f4-4920-a396-11b734d76843" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 19:17:23.130697 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:23.130660    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl" podUID="a81b71d6-f8f4-4920-a396-11b734d76843" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 19:17:28.224812 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:28.224777    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj" event={"ID":"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0","Type":"ContainerStarted","Data":"846613dedfdcfe20235ae11a050d3f8a7566c8fb5726c6eac1baca0939b6b9a9"}
Sep 17 19:17:28.225201 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:28.224837    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj" event={"ID":"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0","Type":"ContainerStarted","Data":"4c93139ac16b2e93f047315325bfcad2cacdc260fedefcef37a2c169680fbd0b"}
Sep 17 19:17:28.225201 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:28.225185    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"
Sep 17 19:17:28.225332 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:28.225312    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"
Sep 17 19:17:28.226421 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:28.226393    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj" podUID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 19:17:28.246748 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:28.246708    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj" podStartSLOduration=2.428567096 podStartE2EDuration="27.246693996s" totalImagesPullingTime="21.0815284s" totalInitContainerRuntime="3.7365985s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:17:28.244593662 +0000 UTC m=+674.183950604" watchObservedRunningTime="2026-09-17 19:17:28.246693996 +0000 UTC m=+674.186050913"
Sep 17 19:17:29.227966 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:29.227926    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj" podUID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 19:17:30.232030 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:30.231994    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj" podUID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 19:17:33.130140 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:33.130090    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl" podUID="a81b71d6-f8f4-4920-a396-11b734d76843" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 19:17:35.236505 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:35.236475    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"
Sep 17 19:17:35.237051 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:35.237022    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj" podUID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 19:17:43.130105 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:43.130062    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl" podUID="a81b71d6-f8f4-4920-a396-11b734d76843" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 19:17:45.237957 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:45.237916    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj" podUID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 19:17:53.130475 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:53.130427    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl" podUID="a81b71d6-f8f4-4920-a396-11b734d76843" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 19:17:55.237708 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:17:55.237667    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj" podUID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 19:18:03.130738 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:03.130698    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl" podUID="a81b71d6-f8f4-4920-a396-11b734d76843" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 19:18:05.237817 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:05.237774    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj" podUID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 19:18:13.130819 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:13.130778    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl" podUID="a81b71d6-f8f4-4920-a396-11b734d76843" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 19:18:15.237961 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:15.237921    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj" podUID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 19:18:20.220591 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:20.220543    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl" podUID="a81b71d6-f8f4-4920-a396-11b734d76843" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 19:18:25.237759 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:25.237721    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj" podUID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 19:18:25.317318 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:25.317281    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"]
Sep 17 19:18:25.317622 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:25.317591    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f" podUID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerName="kserve-container" containerID="cri-o://54929331cc65b1661a9c69c15226587acd3d99033bcbef1c159e22304dc16605" gracePeriod=30
Sep 17 19:18:25.317749 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:25.317616    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f" podUID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerName="kube-rbac-proxy" containerID="cri-o://4fd208b3ce16efcec9c2f678db925a580df99f8e2efbb253dcc161522c53423f" gracePeriod=30
Sep 17 19:18:25.478810 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:25.478773    2573 generic.go:356] "Generic (PLEG): container finished" podID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerID="4fd208b3ce16efcec9c2f678db925a580df99f8e2efbb253dcc161522c53423f" exitCode=2
Sep 17 19:18:25.478987 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:25.478846    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f" event={"ID":"87c2b26f-a1bf-48ca-b628-d6addf25c390","Type":"ContainerDied","Data":"4fd208b3ce16efcec9c2f678db925a580df99f8e2efbb253dcc161522c53423f"}
Sep 17 19:18:25.687726 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:25.687695    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f" podUID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.25:8643/healthz\": dial tcp 10.132.0.25:8643: connect: connection refused"
Sep 17 19:18:25.692045 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:25.692015    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f" podUID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Sep 17 19:18:30.166731 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.166701    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"
Sep 17 19:18:30.227441 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.227414    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:18:30.314716 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.314636    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhr4z\" (UniqueName: \"kubernetes.io/projected/87c2b26f-a1bf-48ca-b628-d6addf25c390-kube-api-access-fhr4z\") pod \"87c2b26f-a1bf-48ca-b628-d6addf25c390\" (UID: \"87c2b26f-a1bf-48ca-b628-d6addf25c390\") "
Sep 17 19:18:30.314716 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.314688    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/87c2b26f-a1bf-48ca-b628-d6addf25c390-kube-rbac-proxy-sar-config\") pod \"87c2b26f-a1bf-48ca-b628-d6addf25c390\" (UID: \"87c2b26f-a1bf-48ca-b628-d6addf25c390\") "
Sep 17 19:18:30.314953 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.314752    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/87c2b26f-a1bf-48ca-b628-d6addf25c390-proxy-tls\") pod \"87c2b26f-a1bf-48ca-b628-d6addf25c390\" (UID: \"87c2b26f-a1bf-48ca-b628-d6addf25c390\") "
Sep 17 19:18:30.314953 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.314816    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87c2b26f-a1bf-48ca-b628-d6addf25c390-kserve-provision-location\") pod \"87c2b26f-a1bf-48ca-b628-d6addf25c390\" (UID: \"87c2b26f-a1bf-48ca-b628-d6addf25c390\") "
Sep 17 19:18:30.314953 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.314863    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/87c2b26f-a1bf-48ca-b628-d6addf25c390-cabundle-cert\") pod \"87c2b26f-a1bf-48ca-b628-d6addf25c390\" (UID: \"87c2b26f-a1bf-48ca-b628-d6addf25c390\") "
Sep 17 19:18:30.315127 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.315028    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87c2b26f-a1bf-48ca-b628-d6addf25c390-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "87c2b26f-a1bf-48ca-b628-d6addf25c390" (UID: "87c2b26f-a1bf-48ca-b628-d6addf25c390"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:18:30.315127 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.315105    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87c2b26f-a1bf-48ca-b628-d6addf25c390-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "87c2b26f-a1bf-48ca-b628-d6addf25c390" (UID: "87c2b26f-a1bf-48ca-b628-d6addf25c390"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 19:18:30.315336 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.315313    2573 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/87c2b26f-a1bf-48ca-b628-d6addf25c390-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:18:30.315480 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.315442    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87c2b26f-a1bf-48ca-b628-d6addf25c390-kserve-provision-location\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:18:30.315480 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.315361    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87c2b26f-a1bf-48ca-b628-d6addf25c390-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "87c2b26f-a1bf-48ca-b628-d6addf25c390" (UID: "87c2b26f-a1bf-48ca-b628-d6addf25c390"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:18:30.317478 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.317456    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87c2b26f-a1bf-48ca-b628-d6addf25c390-kube-api-access-fhr4z" (OuterVolumeSpecName: "kube-api-access-fhr4z") pod "87c2b26f-a1bf-48ca-b628-d6addf25c390" (UID: "87c2b26f-a1bf-48ca-b628-d6addf25c390"). InnerVolumeSpecName "kube-api-access-fhr4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:18:30.317478 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.317455    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87c2b26f-a1bf-48ca-b628-d6addf25c390-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "87c2b26f-a1bf-48ca-b628-d6addf25c390" (UID: "87c2b26f-a1bf-48ca-b628-d6addf25c390"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:18:30.416914 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.416861    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhr4z\" (UniqueName: \"kubernetes.io/projected/87c2b26f-a1bf-48ca-b628-d6addf25c390-kube-api-access-fhr4z\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:18:30.417097 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.416919    2573 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/87c2b26f-a1bf-48ca-b628-d6addf25c390-proxy-tls\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:18:30.417097 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.416939    2573 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/87c2b26f-a1bf-48ca-b628-d6addf25c390-cabundle-cert\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:18:30.502095 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.502066    2573 generic.go:356] "Generic (PLEG): container finished" podID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerID="54929331cc65b1661a9c69c15226587acd3d99033bcbef1c159e22304dc16605" exitCode=0
Sep 17 19:18:30.502281 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.502122    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"
Sep 17 19:18:30.502281 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.502152    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f" event={"ID":"87c2b26f-a1bf-48ca-b628-d6addf25c390","Type":"ContainerDied","Data":"54929331cc65b1661a9c69c15226587acd3d99033bcbef1c159e22304dc16605"}
Sep 17 19:18:30.502281 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.502231    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f" event={"ID":"87c2b26f-a1bf-48ca-b628-d6addf25c390","Type":"ContainerDied","Data":"cc28eb85bb7a038a885b65bf23074f63113249271c7c6e4a2a7c94d64738d05b"}
Sep 17 19:18:30.502281 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.502270    2573 scope.go:117] "RemoveContainer" containerID="4fd208b3ce16efcec9c2f678db925a580df99f8e2efbb253dcc161522c53423f"
Sep 17 19:18:30.511071 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.511052    2573 scope.go:117] "RemoveContainer" containerID="54929331cc65b1661a9c69c15226587acd3d99033bcbef1c159e22304dc16605"
Sep 17 19:18:30.519522 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.519497    2573 scope.go:117] "RemoveContainer" containerID="95bc0ce8bf6b6dfed0914c00915500136e3fa40e76b3f4fc72d03b77ed296e0e"
Sep 17 19:18:30.526956 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.526935    2573 scope.go:117] "RemoveContainer" containerID="4fd208b3ce16efcec9c2f678db925a580df99f8e2efbb253dcc161522c53423f"
Sep 17 19:18:30.527427 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:18:30.527399    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fd208b3ce16efcec9c2f678db925a580df99f8e2efbb253dcc161522c53423f\": container with ID starting with 4fd208b3ce16efcec9c2f678db925a580df99f8e2efbb253dcc161522c53423f not found: ID does not exist" containerID="4fd208b3ce16efcec9c2f678db925a580df99f8e2efbb253dcc161522c53423f"
Sep 17 19:18:30.527528 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.527442    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fd208b3ce16efcec9c2f678db925a580df99f8e2efbb253dcc161522c53423f"} err="failed to get container status \"4fd208b3ce16efcec9c2f678db925a580df99f8e2efbb253dcc161522c53423f\": rpc error: code = NotFound desc = could not find container \"4fd208b3ce16efcec9c2f678db925a580df99f8e2efbb253dcc161522c53423f\": container with ID starting with 4fd208b3ce16efcec9c2f678db925a580df99f8e2efbb253dcc161522c53423f not found: ID does not exist"
Sep 17 19:18:30.527528 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.527469    2573 scope.go:117] "RemoveContainer" containerID="54929331cc65b1661a9c69c15226587acd3d99033bcbef1c159e22304dc16605"
Sep 17 19:18:30.527795 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:18:30.527770    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54929331cc65b1661a9c69c15226587acd3d99033bcbef1c159e22304dc16605\": container with ID starting with 54929331cc65b1661a9c69c15226587acd3d99033bcbef1c159e22304dc16605 not found: ID does not exist" containerID="54929331cc65b1661a9c69c15226587acd3d99033bcbef1c159e22304dc16605"
Sep 17 19:18:30.527895 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.527817    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54929331cc65b1661a9c69c15226587acd3d99033bcbef1c159e22304dc16605"} err="failed to get container status \"54929331cc65b1661a9c69c15226587acd3d99033bcbef1c159e22304dc16605\": rpc error: code = NotFound desc = could not find container \"54929331cc65b1661a9c69c15226587acd3d99033bcbef1c159e22304dc16605\": container with ID starting with 54929331cc65b1661a9c69c15226587acd3d99033bcbef1c159e22304dc16605 not found: ID does not exist"
Sep 17 19:18:30.527895 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.527843    2573 scope.go:117] "RemoveContainer" containerID="95bc0ce8bf6b6dfed0914c00915500136e3fa40e76b3f4fc72d03b77ed296e0e"
Sep 17 19:18:30.528332 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:18:30.528314    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95bc0ce8bf6b6dfed0914c00915500136e3fa40e76b3f4fc72d03b77ed296e0e\": container with ID starting with 95bc0ce8bf6b6dfed0914c00915500136e3fa40e76b3f4fc72d03b77ed296e0e not found: ID does not exist" containerID="95bc0ce8bf6b6dfed0914c00915500136e3fa40e76b3f4fc72d03b77ed296e0e"
Sep 17 19:18:30.528409 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.528339    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95bc0ce8bf6b6dfed0914c00915500136e3fa40e76b3f4fc72d03b77ed296e0e"} err="failed to get container status \"95bc0ce8bf6b6dfed0914c00915500136e3fa40e76b3f4fc72d03b77ed296e0e\": rpc error: code = NotFound desc = could not find container \"95bc0ce8bf6b6dfed0914c00915500136e3fa40e76b3f4fc72d03b77ed296e0e\": container with ID starting with 95bc0ce8bf6b6dfed0914c00915500136e3fa40e76b3f4fc72d03b77ed296e0e not found: ID does not exist"
Sep 17 19:18:30.529483 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.529467    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"]
Sep 17 19:18:30.539452 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.539432    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-97977b6b5-6g26f"]
Sep 17 19:18:30.642025 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.641952    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"]
Sep 17 19:18:30.642295 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.642284    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerName="kube-rbac-proxy"
Sep 17 19:18:30.642336 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.642297    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerName="kube-rbac-proxy"
Sep 17 19:18:30.642336 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.642310    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerName="kserve-container"
Sep 17 19:18:30.642336 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.642315    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerName="kserve-container"
Sep 17 19:18:30.642430 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.642357    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerName="storage-initializer"
Sep 17 19:18:30.642430 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.642363    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerName="storage-initializer"
Sep 17 19:18:30.642430 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.642413    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerName="kube-rbac-proxy"
Sep 17 19:18:30.642430 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.642420    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="87c2b26f-a1bf-48ca-b628-d6addf25c390" containerName="kserve-container"
Sep 17 19:18:30.646844 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.646826    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"
Sep 17 19:18:30.649537 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.649515    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-stop-kube-rbac-proxy-sar-config\""
Sep 17 19:18:30.649893 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.649840    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-stop-predictor-serving-cert\""
Sep 17 19:18:30.656611 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.656591    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"]
Sep 17 19:18:30.820277 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.820240    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr48w\" (UniqueName: \"kubernetes.io/projected/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-kube-api-access-dr48w\") pod \"isvc-canary-stop-predictor-55656fdf77-b2rqf\" (UID: \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"
Sep 17 19:18:30.820474 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.820288    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-55656fdf77-b2rqf\" (UID: \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"
Sep 17 19:18:30.820474 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.820308    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-kserve-provision-location\") pod \"isvc-canary-stop-predictor-55656fdf77-b2rqf\" (UID: \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"
Sep 17 19:18:30.820474 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.820442    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-proxy-tls\") pod \"isvc-canary-stop-predictor-55656fdf77-b2rqf\" (UID: \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"
Sep 17 19:18:30.820633 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.820525    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-cabundle-cert\") pod \"isvc-canary-stop-predictor-55656fdf77-b2rqf\" (UID: \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"
Sep 17 19:18:30.921563 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.921480    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr48w\" (UniqueName: \"kubernetes.io/projected/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-kube-api-access-dr48w\") pod \"isvc-canary-stop-predictor-55656fdf77-b2rqf\" (UID: \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"
Sep 17 19:18:30.921563 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.921532    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-55656fdf77-b2rqf\" (UID: \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"
Sep 17 19:18:30.921785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.921571    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-kserve-provision-location\") pod \"isvc-canary-stop-predictor-55656fdf77-b2rqf\" (UID: \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"
Sep 17 19:18:30.921785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.921604    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-proxy-tls\") pod \"isvc-canary-stop-predictor-55656fdf77-b2rqf\" (UID: \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"
Sep 17 19:18:30.921785 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.921658    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-cabundle-cert\") pod \"isvc-canary-stop-predictor-55656fdf77-b2rqf\" (UID: \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"
Sep 17 19:18:30.922081 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.922056    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-kserve-provision-location\") pod \"isvc-canary-stop-predictor-55656fdf77-b2rqf\" (UID: \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"
Sep 17 19:18:30.922336 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.922314    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-cabundle-cert\") pod \"isvc-canary-stop-predictor-55656fdf77-b2rqf\" (UID: \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"
Sep 17 19:18:30.922515 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.922490    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-55656fdf77-b2rqf\" (UID: \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"
Sep 17 19:18:30.924286 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.924263    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-proxy-tls\") pod \"isvc-canary-stop-predictor-55656fdf77-b2rqf\" (UID: \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"
Sep 17 19:18:30.931809 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.931788    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr48w\" (UniqueName: \"kubernetes.io/projected/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-kube-api-access-dr48w\") pod \"isvc-canary-stop-predictor-55656fdf77-b2rqf\" (UID: \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"
Sep 17 19:18:30.957353 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:30.957329    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"
Sep 17 19:18:31.230982 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:31.230956    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"]
Sep 17 19:18:31.233143 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:18:31.233117    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc127a93a_0e5f_4e31_840c_2e5ec2a7105c.slice/crio-8d9c85c5456d077a4e3edefa09c24a4b76731dcb5c9e4ca25fdd07dccaf818d2 WatchSource:0}: Error finding container 8d9c85c5456d077a4e3edefa09c24a4b76731dcb5c9e4ca25fdd07dccaf818d2: Status 404 returned error can't find the container with id 8d9c85c5456d077a4e3edefa09c24a4b76731dcb5c9e4ca25fdd07dccaf818d2
Sep 17 19:18:31.510082 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:31.509938    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf" event={"ID":"c127a93a-0e5f-4e31-840c-2e5ec2a7105c","Type":"ContainerStarted","Data":"b811ebcda9b1cb318c0243ccc6810661e6986695a9337de03ec625823098247b"}
Sep 17 19:18:31.510082 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:31.510009    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf" event={"ID":"c127a93a-0e5f-4e31-840c-2e5ec2a7105c","Type":"ContainerStarted","Data":"8d9c85c5456d077a4e3edefa09c24a4b76731dcb5c9e4ca25fdd07dccaf818d2"}
Sep 17 19:18:32.226819 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:32.226781    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87c2b26f-a1bf-48ca-b628-d6addf25c390" path="/var/lib/kubelet/pods/87c2b26f-a1bf-48ca-b628-d6addf25c390/volumes"
Sep 17 19:18:35.237984 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:35.237954    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"
Sep 17 19:18:35.530508 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:35.530474    2573 generic.go:356] "Generic (PLEG): container finished" podID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerID="b811ebcda9b1cb318c0243ccc6810661e6986695a9337de03ec625823098247b" exitCode=0
Sep 17 19:18:35.530681 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:35.530554    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf" event={"ID":"c127a93a-0e5f-4e31-840c-2e5ec2a7105c","Type":"ContainerDied","Data":"b811ebcda9b1cb318c0243ccc6810661e6986695a9337de03ec625823098247b"}
Sep 17 19:18:36.537461 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:36.537420    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf" event={"ID":"c127a93a-0e5f-4e31-840c-2e5ec2a7105c","Type":"ContainerStarted","Data":"6f4e282ff2ef471ebb4bc350e919e3d6e146fe8b0457e35a0a2086ee8a56497e"}
Sep 17 19:18:36.537919 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:36.537494    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf" event={"ID":"c127a93a-0e5f-4e31-840c-2e5ec2a7105c","Type":"ContainerStarted","Data":"d619ee2616d4961b12441d99a9dd21acfd0d77add89fd79d434ba7725c11d507"}
Sep 17 19:18:36.537919 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:36.537679    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"
Sep 17 19:18:36.558540 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:36.558499    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf" podStartSLOduration=2.841393666 podStartE2EDuration="6.558486153s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.717092487s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:18:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:18:36.558090156 +0000 UTC m=+742.497447078" watchObservedRunningTime="2026-09-17 19:18:36.558486153 +0000 UTC m=+742.497843074"
Sep 17 19:18:37.542372 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:37.542334    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"
Sep 17 19:18:37.543591 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:37.543555    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf" podUID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 19:18:38.546048 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:38.546004    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf" podUID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 19:18:43.552702 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:43.552672    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"
Sep 17 19:18:43.553206 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:43.553177    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf" podUID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 19:18:51.051865 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:51.051831    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"]
Sep 17 19:18:51.052258 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:51.052116    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl" podUID="a81b71d6-f8f4-4920-a396-11b734d76843" containerName="kserve-container" containerID="cri-o://e1ac1c58bdf998835d0aefb451e045cea92c55552dd9918f5c70b1f9fcea94dc" gracePeriod=30
Sep 17 19:18:51.052258 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:51.052198    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl" podUID="a81b71d6-f8f4-4920-a396-11b734d76843" containerName="kube-rbac-proxy" containerID="cri-o://265d5529acd447624d719e066aa5e2c2c7069ffc2809717bf62434078d03122c" gracePeriod=30
Sep 17 19:18:51.095131 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:51.095094    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"]
Sep 17 19:18:51.095426 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:51.095393    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj" podUID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerName="kube-rbac-proxy" containerID="cri-o://846613dedfdcfe20235ae11a050d3f8a7566c8fb5726c6eac1baca0939b6b9a9" gracePeriod=30
Sep 17 19:18:51.095542 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:51.095377    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj" podUID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerName="kserve-container" containerID="cri-o://4c93139ac16b2e93f047315325bfcad2cacdc260fedefcef37a2c169680fbd0b" gracePeriod=30
Sep 17 19:18:51.604248 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:51.604209    2573 generic.go:356] "Generic (PLEG): container finished" podID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerID="846613dedfdcfe20235ae11a050d3f8a7566c8fb5726c6eac1baca0939b6b9a9" exitCode=2
Sep 17 19:18:51.604450 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:51.604285    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj" event={"ID":"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0","Type":"ContainerDied","Data":"846613dedfdcfe20235ae11a050d3f8a7566c8fb5726c6eac1baca0939b6b9a9"}
Sep 17 19:18:51.606323 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:51.606303    2573 generic.go:356] "Generic (PLEG): container finished" podID="a81b71d6-f8f4-4920-a396-11b734d76843" containerID="265d5529acd447624d719e066aa5e2c2c7069ffc2809717bf62434078d03122c" exitCode=2
Sep 17 19:18:51.606436 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:51.606366    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl" event={"ID":"a81b71d6-f8f4-4920-a396-11b734d76843","Type":"ContainerDied","Data":"265d5529acd447624d719e066aa5e2c2c7069ffc2809717bf62434078d03122c"}
Sep 17 19:18:53.124792 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:53.124752    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl" podUID="a81b71d6-f8f4-4920-a396-11b734d76843" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.26:8643/healthz\": dial tcp 10.132.0.26:8643: connect: connection refused"
Sep 17 19:18:53.553592 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:53.553550    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf" podUID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 19:18:55.232665 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.232621    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj" podUID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.27:8643/healthz\": dial tcp 10.132.0.27:8643: connect: connection refused"
Sep 17 19:18:55.236979 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.236956    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj" podUID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 19:18:55.541927 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.541902    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"
Sep 17 19:18:55.627246 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.627212    2573 generic.go:356] "Generic (PLEG): container finished" podID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerID="4c93139ac16b2e93f047315325bfcad2cacdc260fedefcef37a2c169680fbd0b" exitCode=0
Sep 17 19:18:55.627427 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.627269    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"
Sep 17 19:18:55.627427 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.627295    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj" event={"ID":"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0","Type":"ContainerDied","Data":"4c93139ac16b2e93f047315325bfcad2cacdc260fedefcef37a2c169680fbd0b"}
Sep 17 19:18:55.627427 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.627359    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj" event={"ID":"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0","Type":"ContainerDied","Data":"aa2348629bead77de14bbc8b0af717954f6ee114f5c513cd5c862bec276c6a70"}
Sep 17 19:18:55.627427 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.627387    2573 scope.go:117] "RemoveContainer" containerID="846613dedfdcfe20235ae11a050d3f8a7566c8fb5726c6eac1baca0939b6b9a9"
Sep 17 19:18:55.632184 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.632159    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-proxy-tls\") pod \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\" (UID: \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\") "
Sep 17 19:18:55.632291 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.632195    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhvsz\" (UniqueName: \"kubernetes.io/projected/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-kube-api-access-vhvsz\") pod \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\" (UID: \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\") "
Sep 17 19:18:55.632291 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.632224    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-cabundle-cert\") pod \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\" (UID: \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\") "
Sep 17 19:18:55.632404 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.632349    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-kube-rbac-proxy-sar-config\") pod \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\" (UID: \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\") "
Sep 17 19:18:55.632454 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.632404    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-kserve-provision-location\") pod \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\" (UID: \"1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0\") "
Sep 17 19:18:55.632666 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.632640    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" (UID: "1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:18:55.632767 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.632672    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" (UID: "1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:18:55.632767 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.632722    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" (UID: "1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 19:18:55.634368 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.634351    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" (UID: "1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:18:55.634825 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.634791    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-kube-api-access-vhvsz" (OuterVolumeSpecName: "kube-api-access-vhvsz") pod "1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" (UID: "1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0"). InnerVolumeSpecName "kube-api-access-vhvsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:18:55.636724 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.636703    2573 scope.go:117] "RemoveContainer" containerID="4c93139ac16b2e93f047315325bfcad2cacdc260fedefcef37a2c169680fbd0b"
Sep 17 19:18:55.649259 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.649244    2573 scope.go:117] "RemoveContainer" containerID="dddde20fd9e3d4eb0dc63f4d09f2fd7049e02f2e211d62b8eaed5a723706aaba"
Sep 17 19:18:55.656430 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.656413    2573 scope.go:117] "RemoveContainer" containerID="846613dedfdcfe20235ae11a050d3f8a7566c8fb5726c6eac1baca0939b6b9a9"
Sep 17 19:18:55.656704 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:18:55.656683    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"846613dedfdcfe20235ae11a050d3f8a7566c8fb5726c6eac1baca0939b6b9a9\": container with ID starting with 846613dedfdcfe20235ae11a050d3f8a7566c8fb5726c6eac1baca0939b6b9a9 not found: ID does not exist" containerID="846613dedfdcfe20235ae11a050d3f8a7566c8fb5726c6eac1baca0939b6b9a9"
Sep 17 19:18:55.656756 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.656711    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"846613dedfdcfe20235ae11a050d3f8a7566c8fb5726c6eac1baca0939b6b9a9"} err="failed to get container status \"846613dedfdcfe20235ae11a050d3f8a7566c8fb5726c6eac1baca0939b6b9a9\": rpc error: code = NotFound desc = could not find container \"846613dedfdcfe20235ae11a050d3f8a7566c8fb5726c6eac1baca0939b6b9a9\": container with ID starting with 846613dedfdcfe20235ae11a050d3f8a7566c8fb5726c6eac1baca0939b6b9a9 not found: ID does not exist"
Sep 17 19:18:55.656756 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.656728    2573 scope.go:117] "RemoveContainer" containerID="4c93139ac16b2e93f047315325bfcad2cacdc260fedefcef37a2c169680fbd0b"
Sep 17 19:18:55.656994 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:18:55.656974    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c93139ac16b2e93f047315325bfcad2cacdc260fedefcef37a2c169680fbd0b\": container with ID starting with 4c93139ac16b2e93f047315325bfcad2cacdc260fedefcef37a2c169680fbd0b not found: ID does not exist" containerID="4c93139ac16b2e93f047315325bfcad2cacdc260fedefcef37a2c169680fbd0b"
Sep 17 19:18:55.657051 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.657000    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c93139ac16b2e93f047315325bfcad2cacdc260fedefcef37a2c169680fbd0b"} err="failed to get container status \"4c93139ac16b2e93f047315325bfcad2cacdc260fedefcef37a2c169680fbd0b\": rpc error: code = NotFound desc = could not find container \"4c93139ac16b2e93f047315325bfcad2cacdc260fedefcef37a2c169680fbd0b\": container with ID starting with 4c93139ac16b2e93f047315325bfcad2cacdc260fedefcef37a2c169680fbd0b not found: ID does not exist"
Sep 17 19:18:55.657051 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.657016    2573 scope.go:117] "RemoveContainer" containerID="dddde20fd9e3d4eb0dc63f4d09f2fd7049e02f2e211d62b8eaed5a723706aaba"
Sep 17 19:18:55.657256 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:18:55.657239    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dddde20fd9e3d4eb0dc63f4d09f2fd7049e02f2e211d62b8eaed5a723706aaba\": container with ID starting with dddde20fd9e3d4eb0dc63f4d09f2fd7049e02f2e211d62b8eaed5a723706aaba not found: ID does not exist" containerID="dddde20fd9e3d4eb0dc63f4d09f2fd7049e02f2e211d62b8eaed5a723706aaba"
Sep 17 19:18:55.657308 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.657266    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dddde20fd9e3d4eb0dc63f4d09f2fd7049e02f2e211d62b8eaed5a723706aaba"} err="failed to get container status \"dddde20fd9e3d4eb0dc63f4d09f2fd7049e02f2e211d62b8eaed5a723706aaba\": rpc error: code = NotFound desc = could not find container \"dddde20fd9e3d4eb0dc63f4d09f2fd7049e02f2e211d62b8eaed5a723706aaba\": container with ID starting with dddde20fd9e3d4eb0dc63f4d09f2fd7049e02f2e211d62b8eaed5a723706aaba not found: ID does not exist"
Sep 17 19:18:55.733750 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.733683    2573 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-proxy-tls\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:18:55.733750 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.733707    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhvsz\" (UniqueName: \"kubernetes.io/projected/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-kube-api-access-vhvsz\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:18:55.733750 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.733717    2573 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-cabundle-cert\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:18:55.733750 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.733726    2573 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:18:55.733750 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.733734    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0-kserve-provision-location\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:18:55.952631 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.952602    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"]
Sep 17 19:18:55.956088 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.956065    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-e3e91-predictor-644d595965-b78lj"]
Sep 17 19:18:55.988701 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:55.988653    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:18:56.035805 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.035772    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a81b71d6-f8f4-4920-a396-11b734d76843-cabundle-cert\") pod \"a81b71d6-f8f4-4920-a396-11b734d76843\" (UID: \"a81b71d6-f8f4-4920-a396-11b734d76843\") "
Sep 17 19:18:56.035992 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.035807    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a81b71d6-f8f4-4920-a396-11b734d76843-kube-rbac-proxy-sar-config\") pod \"a81b71d6-f8f4-4920-a396-11b734d76843\" (UID: \"a81b71d6-f8f4-4920-a396-11b734d76843\") "
Sep 17 19:18:56.035992 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.035855    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jc2lq\" (UniqueName: \"kubernetes.io/projected/a81b71d6-f8f4-4920-a396-11b734d76843-kube-api-access-jc2lq\") pod \"a81b71d6-f8f4-4920-a396-11b734d76843\" (UID: \"a81b71d6-f8f4-4920-a396-11b734d76843\") "
Sep 17 19:18:56.035992 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.035901    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a81b71d6-f8f4-4920-a396-11b734d76843-kserve-provision-location\") pod \"a81b71d6-f8f4-4920-a396-11b734d76843\" (UID: \"a81b71d6-f8f4-4920-a396-11b734d76843\") "
Sep 17 19:18:56.036143 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.036023    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a81b71d6-f8f4-4920-a396-11b734d76843-proxy-tls\") pod \"a81b71d6-f8f4-4920-a396-11b734d76843\" (UID: \"a81b71d6-f8f4-4920-a396-11b734d76843\") "
Sep 17 19:18:56.036196 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.036174    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a81b71d6-f8f4-4920-a396-11b734d76843-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "a81b71d6-f8f4-4920-a396-11b734d76843" (UID: "a81b71d6-f8f4-4920-a396-11b734d76843"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 19:18:56.036256 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.036215    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a81b71d6-f8f4-4920-a396-11b734d76843-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "a81b71d6-f8f4-4920-a396-11b734d76843" (UID: "a81b71d6-f8f4-4920-a396-11b734d76843"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:18:56.036311 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.036242    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a81b71d6-f8f4-4920-a396-11b734d76843-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "a81b71d6-f8f4-4920-a396-11b734d76843" (UID: "a81b71d6-f8f4-4920-a396-11b734d76843"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:18:56.036378 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.036362    2573 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a81b71d6-f8f4-4920-a396-11b734d76843-cabundle-cert\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:18:56.036420 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.036380    2573 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a81b71d6-f8f4-4920-a396-11b734d76843-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:18:56.036420 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.036389    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a81b71d6-f8f4-4920-a396-11b734d76843-kserve-provision-location\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:18:56.038157 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.038140    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a81b71d6-f8f4-4920-a396-11b734d76843-kube-api-access-jc2lq" (OuterVolumeSpecName: "kube-api-access-jc2lq") pod "a81b71d6-f8f4-4920-a396-11b734d76843" (UID: "a81b71d6-f8f4-4920-a396-11b734d76843"). InnerVolumeSpecName "kube-api-access-jc2lq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:18:56.038235 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.038210    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a81b71d6-f8f4-4920-a396-11b734d76843-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a81b71d6-f8f4-4920-a396-11b734d76843" (UID: "a81b71d6-f8f4-4920-a396-11b734d76843"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:18:56.137377 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.137342    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jc2lq\" (UniqueName: \"kubernetes.io/projected/a81b71d6-f8f4-4920-a396-11b734d76843-kube-api-access-jc2lq\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:18:56.137377 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.137371    2573 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a81b71d6-f8f4-4920-a396-11b734d76843-proxy-tls\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:18:56.224644 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.224612    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" path="/var/lib/kubelet/pods/1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0/volumes"
Sep 17 19:18:56.634141 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.634050    2573 generic.go:356] "Generic (PLEG): container finished" podID="a81b71d6-f8f4-4920-a396-11b734d76843" containerID="e1ac1c58bdf998835d0aefb451e045cea92c55552dd9918f5c70b1f9fcea94dc" exitCode=0
Sep 17 19:18:56.634141 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.634106    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"
Sep 17 19:18:56.634141 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.634132    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl" event={"ID":"a81b71d6-f8f4-4920-a396-11b734d76843","Type":"ContainerDied","Data":"e1ac1c58bdf998835d0aefb451e045cea92c55552dd9918f5c70b1f9fcea94dc"}
Sep 17 19:18:56.634696 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.634193    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl" event={"ID":"a81b71d6-f8f4-4920-a396-11b734d76843","Type":"ContainerDied","Data":"4efcb2c7710b93f3ab079a690ddffadd11abbfda807a4377314baea0bea2721b"}
Sep 17 19:18:56.634696 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.634219    2573 scope.go:117] "RemoveContainer" containerID="265d5529acd447624d719e066aa5e2c2c7069ffc2809717bf62434078d03122c"
Sep 17 19:18:56.642396 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.642373    2573 scope.go:117] "RemoveContainer" containerID="e1ac1c58bdf998835d0aefb451e045cea92c55552dd9918f5c70b1f9fcea94dc"
Sep 17 19:18:56.649933 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.649908    2573 scope.go:117] "RemoveContainer" containerID="a72435b4b1fdead77454357fc639dfe6d4ece1ca363269f31dfbb2992915cad0"
Sep 17 19:18:56.652342 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.652321    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"]
Sep 17 19:18:56.656116 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.656097    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-e3e91-predictor-85678795b4-x4dkl"]
Sep 17 19:18:56.658118 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.658104    2573 scope.go:117] "RemoveContainer" containerID="265d5529acd447624d719e066aa5e2c2c7069ffc2809717bf62434078d03122c"
Sep 17 19:18:56.658364 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:18:56.658344    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"265d5529acd447624d719e066aa5e2c2c7069ffc2809717bf62434078d03122c\": container with ID starting with 265d5529acd447624d719e066aa5e2c2c7069ffc2809717bf62434078d03122c not found: ID does not exist" containerID="265d5529acd447624d719e066aa5e2c2c7069ffc2809717bf62434078d03122c"
Sep 17 19:18:56.658418 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.658374    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"265d5529acd447624d719e066aa5e2c2c7069ffc2809717bf62434078d03122c"} err="failed to get container status \"265d5529acd447624d719e066aa5e2c2c7069ffc2809717bf62434078d03122c\": rpc error: code = NotFound desc = could not find container \"265d5529acd447624d719e066aa5e2c2c7069ffc2809717bf62434078d03122c\": container with ID starting with 265d5529acd447624d719e066aa5e2c2c7069ffc2809717bf62434078d03122c not found: ID does not exist"
Sep 17 19:18:56.658418 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.658395    2573 scope.go:117] "RemoveContainer" containerID="e1ac1c58bdf998835d0aefb451e045cea92c55552dd9918f5c70b1f9fcea94dc"
Sep 17 19:18:56.658602 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:18:56.658583    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1ac1c58bdf998835d0aefb451e045cea92c55552dd9918f5c70b1f9fcea94dc\": container with ID starting with e1ac1c58bdf998835d0aefb451e045cea92c55552dd9918f5c70b1f9fcea94dc not found: ID does not exist" containerID="e1ac1c58bdf998835d0aefb451e045cea92c55552dd9918f5c70b1f9fcea94dc"
Sep 17 19:18:56.658639 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.658610    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1ac1c58bdf998835d0aefb451e045cea92c55552dd9918f5c70b1f9fcea94dc"} err="failed to get container status \"e1ac1c58bdf998835d0aefb451e045cea92c55552dd9918f5c70b1f9fcea94dc\": rpc error: code = NotFound desc = could not find container \"e1ac1c58bdf998835d0aefb451e045cea92c55552dd9918f5c70b1f9fcea94dc\": container with ID starting with e1ac1c58bdf998835d0aefb451e045cea92c55552dd9918f5c70b1f9fcea94dc not found: ID does not exist"
Sep 17 19:18:56.658639 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.658626    2573 scope.go:117] "RemoveContainer" containerID="a72435b4b1fdead77454357fc639dfe6d4ece1ca363269f31dfbb2992915cad0"
Sep 17 19:18:56.658857 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:18:56.658839    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a72435b4b1fdead77454357fc639dfe6d4ece1ca363269f31dfbb2992915cad0\": container with ID starting with a72435b4b1fdead77454357fc639dfe6d4ece1ca363269f31dfbb2992915cad0 not found: ID does not exist" containerID="a72435b4b1fdead77454357fc639dfe6d4ece1ca363269f31dfbb2992915cad0"
Sep 17 19:18:56.658937 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:56.658865    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a72435b4b1fdead77454357fc639dfe6d4ece1ca363269f31dfbb2992915cad0"} err="failed to get container status \"a72435b4b1fdead77454357fc639dfe6d4ece1ca363269f31dfbb2992915cad0\": rpc error: code = NotFound desc = could not find container \"a72435b4b1fdead77454357fc639dfe6d4ece1ca363269f31dfbb2992915cad0\": container with ID starting with a72435b4b1fdead77454357fc639dfe6d4ece1ca363269f31dfbb2992915cad0 not found: ID does not exist"
Sep 17 19:18:58.226459 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:18:58.226424    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a81b71d6-f8f4-4920-a396-11b734d76843" path="/var/lib/kubelet/pods/a81b71d6-f8f4-4920-a396-11b734d76843/volumes"
Sep 17 19:19:03.553422 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:19:03.553384    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf" podUID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 19:19:13.553101 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:19:13.553065    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf" podUID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 19:19:23.553956 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:19:23.553917    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf" podUID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 19:19:33.553795 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:19:33.553706    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf" podUID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 19:19:43.553232 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:19:43.553193    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf" podUID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 19:19:53.554026 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:19:53.553996    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"
Sep 17 19:20:10.643475 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:10.643439    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"]
Sep 17 19:20:10.643937 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:10.643672    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf" podUID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerName="kserve-container" containerID="cri-o://d619ee2616d4961b12441d99a9dd21acfd0d77add89fd79d434ba7725c11d507" gracePeriod=30
Sep 17 19:20:10.643937 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:10.643717    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf" podUID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerName="kube-rbac-proxy" containerID="cri-o://6f4e282ff2ef471ebb4bc350e919e3d6e146fe8b0457e35a0a2086ee8a56497e" gracePeriod=30
Sep 17 19:20:10.938707 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:10.938671    2573 generic.go:356] "Generic (PLEG): container finished" podID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerID="6f4e282ff2ef471ebb4bc350e919e3d6e146fe8b0457e35a0a2086ee8a56497e" exitCode=2
Sep 17 19:20:10.938867 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:10.938745    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf" event={"ID":"c127a93a-0e5f-4e31-840c-2e5ec2a7105c","Type":"ContainerDied","Data":"6f4e282ff2ef471ebb4bc350e919e3d6e146fe8b0457e35a0a2086ee8a56497e"}
Sep 17 19:20:13.547267 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:13.547221    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf" podUID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.28:8643/healthz\": dial tcp 10.132.0.28:8643: connect: connection refused"
Sep 17 19:20:13.554078 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:13.554053    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf" podUID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 19:20:15.495531 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.495504    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"
Sep 17 19:20:15.599861 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.599778    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-cabundle-cert\") pod \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\" (UID: \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\") "
Sep 17 19:20:15.599861 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.599825    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-kserve-provision-location\") pod \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\" (UID: \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\") "
Sep 17 19:20:15.600094 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.599873    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-proxy-tls\") pod \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\" (UID: \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\") "
Sep 17 19:20:15.600094 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.599932    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dr48w\" (UniqueName: \"kubernetes.io/projected/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-kube-api-access-dr48w\") pod \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\" (UID: \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\") "
Sep 17 19:20:15.600094 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.599971    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-kube-rbac-proxy-sar-config\") pod \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\" (UID: \"c127a93a-0e5f-4e31-840c-2e5ec2a7105c\") "
Sep 17 19:20:15.600215 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.600181    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "c127a93a-0e5f-4e31-840c-2e5ec2a7105c" (UID: "c127a93a-0e5f-4e31-840c-2e5ec2a7105c"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:20:15.600251 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.600225    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "c127a93a-0e5f-4e31-840c-2e5ec2a7105c" (UID: "c127a93a-0e5f-4e31-840c-2e5ec2a7105c"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 19:20:15.600416 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.600390    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "c127a93a-0e5f-4e31-840c-2e5ec2a7105c" (UID: "c127a93a-0e5f-4e31-840c-2e5ec2a7105c"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:20:15.602154 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.602132    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-kube-api-access-dr48w" (OuterVolumeSpecName: "kube-api-access-dr48w") pod "c127a93a-0e5f-4e31-840c-2e5ec2a7105c" (UID: "c127a93a-0e5f-4e31-840c-2e5ec2a7105c"). InnerVolumeSpecName "kube-api-access-dr48w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:20:15.602256 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.602161    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c127a93a-0e5f-4e31-840c-2e5ec2a7105c" (UID: "c127a93a-0e5f-4e31-840c-2e5ec2a7105c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:20:15.701059 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.701032    2573 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-proxy-tls\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:20:15.701059 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.701056    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dr48w\" (UniqueName: \"kubernetes.io/projected/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-kube-api-access-dr48w\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:20:15.701059 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.701065    2573 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:20:15.701262 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.701074    2573 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-cabundle-cert\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:20:15.701262 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.701083    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c127a93a-0e5f-4e31-840c-2e5ec2a7105c-kserve-provision-location\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:20:15.961549 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.961519    2573 generic.go:356] "Generic (PLEG): container finished" podID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerID="d619ee2616d4961b12441d99a9dd21acfd0d77add89fd79d434ba7725c11d507" exitCode=0
Sep 17 19:20:15.961726 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.961575    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"
Sep 17 19:20:15.961726 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.961578    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf" event={"ID":"c127a93a-0e5f-4e31-840c-2e5ec2a7105c","Type":"ContainerDied","Data":"d619ee2616d4961b12441d99a9dd21acfd0d77add89fd79d434ba7725c11d507"}
Sep 17 19:20:15.961726 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.961699    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf" event={"ID":"c127a93a-0e5f-4e31-840c-2e5ec2a7105c","Type":"ContainerDied","Data":"8d9c85c5456d077a4e3edefa09c24a4b76731dcb5c9e4ca25fdd07dccaf818d2"}
Sep 17 19:20:15.961726 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.961724    2573 scope.go:117] "RemoveContainer" containerID="6f4e282ff2ef471ebb4bc350e919e3d6e146fe8b0457e35a0a2086ee8a56497e"
Sep 17 19:20:15.975088 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.975068    2573 scope.go:117] "RemoveContainer" containerID="d619ee2616d4961b12441d99a9dd21acfd0d77add89fd79d434ba7725c11d507"
Sep 17 19:20:15.982459 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.982441    2573 scope.go:117] "RemoveContainer" containerID="b811ebcda9b1cb318c0243ccc6810661e6986695a9337de03ec625823098247b"
Sep 17 19:20:15.986669 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.986647    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"]
Sep 17 19:20:15.990159 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.990138    2573 scope.go:117] "RemoveContainer" containerID="6f4e282ff2ef471ebb4bc350e919e3d6e146fe8b0457e35a0a2086ee8a56497e"
Sep 17 19:20:15.990410 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:20:15.990386    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f4e282ff2ef471ebb4bc350e919e3d6e146fe8b0457e35a0a2086ee8a56497e\": container with ID starting with 6f4e282ff2ef471ebb4bc350e919e3d6e146fe8b0457e35a0a2086ee8a56497e not found: ID does not exist" containerID="6f4e282ff2ef471ebb4bc350e919e3d6e146fe8b0457e35a0a2086ee8a56497e"
Sep 17 19:20:15.990523 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.990419    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f4e282ff2ef471ebb4bc350e919e3d6e146fe8b0457e35a0a2086ee8a56497e"} err="failed to get container status \"6f4e282ff2ef471ebb4bc350e919e3d6e146fe8b0457e35a0a2086ee8a56497e\": rpc error: code = NotFound desc = could not find container \"6f4e282ff2ef471ebb4bc350e919e3d6e146fe8b0457e35a0a2086ee8a56497e\": container with ID starting with 6f4e282ff2ef471ebb4bc350e919e3d6e146fe8b0457e35a0a2086ee8a56497e not found: ID does not exist"
Sep 17 19:20:15.990523 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.990441    2573 scope.go:117] "RemoveContainer" containerID="d619ee2616d4961b12441d99a9dd21acfd0d77add89fd79d434ba7725c11d507"
Sep 17 19:20:15.990694 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:20:15.990675    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d619ee2616d4961b12441d99a9dd21acfd0d77add89fd79d434ba7725c11d507\": container with ID starting with d619ee2616d4961b12441d99a9dd21acfd0d77add89fd79d434ba7725c11d507 not found: ID does not exist" containerID="d619ee2616d4961b12441d99a9dd21acfd0d77add89fd79d434ba7725c11d507"
Sep 17 19:20:15.990769 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.990702    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d619ee2616d4961b12441d99a9dd21acfd0d77add89fd79d434ba7725c11d507"} err="failed to get container status \"d619ee2616d4961b12441d99a9dd21acfd0d77add89fd79d434ba7725c11d507\": rpc error: code = NotFound desc = could not find container \"d619ee2616d4961b12441d99a9dd21acfd0d77add89fd79d434ba7725c11d507\": container with ID starting with d619ee2616d4961b12441d99a9dd21acfd0d77add89fd79d434ba7725c11d507 not found: ID does not exist"
Sep 17 19:20:15.990769 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.990733    2573 scope.go:117] "RemoveContainer" containerID="b811ebcda9b1cb318c0243ccc6810661e6986695a9337de03ec625823098247b"
Sep 17 19:20:15.991286 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:20:15.991158    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b811ebcda9b1cb318c0243ccc6810661e6986695a9337de03ec625823098247b\": container with ID starting with b811ebcda9b1cb318c0243ccc6810661e6986695a9337de03ec625823098247b not found: ID does not exist" containerID="b811ebcda9b1cb318c0243ccc6810661e6986695a9337de03ec625823098247b"
Sep 17 19:20:15.991286 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.991233    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b811ebcda9b1cb318c0243ccc6810661e6986695a9337de03ec625823098247b"} err="failed to get container status \"b811ebcda9b1cb318c0243ccc6810661e6986695a9337de03ec625823098247b\": rpc error: code = NotFound desc = could not find container \"b811ebcda9b1cb318c0243ccc6810661e6986695a9337de03ec625823098247b\": container with ID starting with b811ebcda9b1cb318c0243ccc6810661e6986695a9337de03ec625823098247b not found: ID does not exist"
Sep 17 19:20:15.993112 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:15.993093    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-55656fdf77-b2rqf"]
Sep 17 19:20:16.224849 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:20:16.224761    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" path="/var/lib/kubelet/pods/c127a93a-0e5f-4e31-840c-2e5ec2a7105c/volumes"
Sep 17 19:21:16.202026 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:21:16.202000    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbxgv_93bb0a24-3334-4d1f-a905-6f50ccd815ce/ovn-acl-logging/0.log"
Sep 17 19:21:16.202536 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:21:16.202517    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbxgv_93bb0a24-3334-4d1f-a905-6f50ccd815ce/ovn-acl-logging/0.log"
Sep 17 19:25:43.739343 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739308    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"]
Sep 17 19:25:43.739754 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739640    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a81b71d6-f8f4-4920-a396-11b734d76843" containerName="kube-rbac-proxy"
Sep 17 19:25:43.739754 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739652    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a81b71d6-f8f4-4920-a396-11b734d76843" containerName="kube-rbac-proxy"
Sep 17 19:25:43.739754 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739664    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerName="kube-rbac-proxy"
Sep 17 19:25:43.739754 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739670    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerName="kube-rbac-proxy"
Sep 17 19:25:43.739754 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739683    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerName="kserve-container"
Sep 17 19:25:43.739754 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739692    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerName="kserve-container"
Sep 17 19:25:43.739754 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739703    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a81b71d6-f8f4-4920-a396-11b734d76843" containerName="storage-initializer"
Sep 17 19:25:43.739754 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739709    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a81b71d6-f8f4-4920-a396-11b734d76843" containerName="storage-initializer"
Sep 17 19:25:43.739754 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739714    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a81b71d6-f8f4-4920-a396-11b734d76843" containerName="kserve-container"
Sep 17 19:25:43.739754 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739719    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a81b71d6-f8f4-4920-a396-11b734d76843" containerName="kserve-container"
Sep 17 19:25:43.739754 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739725    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerName="storage-initializer"
Sep 17 19:25:43.739754 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739730    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerName="storage-initializer"
Sep 17 19:25:43.739754 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739735    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerName="kube-rbac-proxy"
Sep 17 19:25:43.739754 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739739    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerName="kube-rbac-proxy"
Sep 17 19:25:43.739754 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739750    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerName="kserve-container"
Sep 17 19:25:43.739754 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739758    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerName="kserve-container"
Sep 17 19:25:43.740273 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739770    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerName="storage-initializer"
Sep 17 19:25:43.740273 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739776    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerName="storage-initializer"
Sep 17 19:25:43.740273 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739819    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a81b71d6-f8f4-4920-a396-11b734d76843" containerName="kube-rbac-proxy"
Sep 17 19:25:43.740273 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739828    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a81b71d6-f8f4-4920-a396-11b734d76843" containerName="kserve-container"
Sep 17 19:25:43.740273 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739837    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerName="kserve-container"
Sep 17 19:25:43.740273 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739848    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerName="kserve-container"
Sep 17 19:25:43.740273 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739856    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c127a93a-0e5f-4e31-840c-2e5ec2a7105c" containerName="kube-rbac-proxy"
Sep 17 19:25:43.740273 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.739863    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1db3813d-cd81-4e39-a1f0-81a0d0e2d7d0" containerName="kube-rbac-proxy"
Sep 17 19:25:43.743194 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.743178    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"
Sep 17 19:25:43.745926 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.745873    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 17 19:25:43.746072 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.745938    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-create-kube-rbac-proxy-sar-config\""
Sep 17 19:25:43.746072 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.746022    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Sep 17 19:25:43.746072 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.746044    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 17 19:25:43.746072 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.746025    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vpx7x\""
Sep 17 19:25:43.746302 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.746023    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-create-predictor-serving-cert\""
Sep 17 19:25:43.747612 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.747595    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 17 19:25:43.752788 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.752764    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"]
Sep 17 19:25:43.836281 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.836242    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/14cce15c-8792-4da1-bd9d-9333aa09000c-cabundle-cert\") pod \"isvc-canary-create-predictor-7c7f45c769-s6bdf\" (UID: \"14cce15c-8792-4da1-bd9d-9333aa09000c\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"
Sep 17 19:25:43.836472 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.836296    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsv75\" (UniqueName: \"kubernetes.io/projected/14cce15c-8792-4da1-bd9d-9333aa09000c-kube-api-access-lsv75\") pod \"isvc-canary-create-predictor-7c7f45c769-s6bdf\" (UID: \"14cce15c-8792-4da1-bd9d-9333aa09000c\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"
Sep 17 19:25:43.836472 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.836360    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/14cce15c-8792-4da1-bd9d-9333aa09000c-kserve-provision-location\") pod \"isvc-canary-create-predictor-7c7f45c769-s6bdf\" (UID: \"14cce15c-8792-4da1-bd9d-9333aa09000c\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"
Sep 17 19:25:43.836472 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.836387    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/14cce15c-8792-4da1-bd9d-9333aa09000c-proxy-tls\") pod \"isvc-canary-create-predictor-7c7f45c769-s6bdf\" (UID: \"14cce15c-8792-4da1-bd9d-9333aa09000c\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"
Sep 17 19:25:43.836625 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.836487    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/14cce15c-8792-4da1-bd9d-9333aa09000c-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-7c7f45c769-s6bdf\" (UID: \"14cce15c-8792-4da1-bd9d-9333aa09000c\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"
Sep 17 19:25:43.937858 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.937802    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsv75\" (UniqueName: \"kubernetes.io/projected/14cce15c-8792-4da1-bd9d-9333aa09000c-kube-api-access-lsv75\") pod \"isvc-canary-create-predictor-7c7f45c769-s6bdf\" (UID: \"14cce15c-8792-4da1-bd9d-9333aa09000c\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"
Sep 17 19:25:43.938079 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.937871    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/14cce15c-8792-4da1-bd9d-9333aa09000c-kserve-provision-location\") pod \"isvc-canary-create-predictor-7c7f45c769-s6bdf\" (UID: \"14cce15c-8792-4da1-bd9d-9333aa09000c\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"
Sep 17 19:25:43.938079 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.937929    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/14cce15c-8792-4da1-bd9d-9333aa09000c-proxy-tls\") pod \"isvc-canary-create-predictor-7c7f45c769-s6bdf\" (UID: \"14cce15c-8792-4da1-bd9d-9333aa09000c\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"
Sep 17 19:25:43.938079 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.937986    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/14cce15c-8792-4da1-bd9d-9333aa09000c-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-7c7f45c769-s6bdf\" (UID: \"14cce15c-8792-4da1-bd9d-9333aa09000c\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"
Sep 17 19:25:43.938079 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.938026    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/14cce15c-8792-4da1-bd9d-9333aa09000c-cabundle-cert\") pod \"isvc-canary-create-predictor-7c7f45c769-s6bdf\" (UID: \"14cce15c-8792-4da1-bd9d-9333aa09000c\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"
Sep 17 19:25:43.938308 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.938283    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/14cce15c-8792-4da1-bd9d-9333aa09000c-kserve-provision-location\") pod \"isvc-canary-create-predictor-7c7f45c769-s6bdf\" (UID: \"14cce15c-8792-4da1-bd9d-9333aa09000c\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"
Sep 17 19:25:43.938642 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.938619    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/14cce15c-8792-4da1-bd9d-9333aa09000c-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-7c7f45c769-s6bdf\" (UID: \"14cce15c-8792-4da1-bd9d-9333aa09000c\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"
Sep 17 19:25:43.938732 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.938647    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/14cce15c-8792-4da1-bd9d-9333aa09000c-cabundle-cert\") pod \"isvc-canary-create-predictor-7c7f45c769-s6bdf\" (UID: \"14cce15c-8792-4da1-bd9d-9333aa09000c\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"
Sep 17 19:25:43.940566 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.940547    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/14cce15c-8792-4da1-bd9d-9333aa09000c-proxy-tls\") pod \"isvc-canary-create-predictor-7c7f45c769-s6bdf\" (UID: \"14cce15c-8792-4da1-bd9d-9333aa09000c\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"
Sep 17 19:25:43.946703 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:43.946681    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsv75\" (UniqueName: \"kubernetes.io/projected/14cce15c-8792-4da1-bd9d-9333aa09000c-kube-api-access-lsv75\") pod \"isvc-canary-create-predictor-7c7f45c769-s6bdf\" (UID: \"14cce15c-8792-4da1-bd9d-9333aa09000c\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"
Sep 17 19:25:44.054362 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:44.054269    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"
Sep 17 19:25:44.328918 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:44.328874    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"]
Sep 17 19:25:44.331475 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:25:44.331448    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14cce15c_8792_4da1_bd9d_9333aa09000c.slice/crio-aa3470996fe09447a31c75974d0f6062194ab149f19121ba2a3eb89f1a6b635c WatchSource:0}: Error finding container aa3470996fe09447a31c75974d0f6062194ab149f19121ba2a3eb89f1a6b635c: Status 404 returned error can't find the container with id aa3470996fe09447a31c75974d0f6062194ab149f19121ba2a3eb89f1a6b635c
Sep 17 19:25:45.256411 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:45.256379    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf" event={"ID":"14cce15c-8792-4da1-bd9d-9333aa09000c","Type":"ContainerStarted","Data":"a67cddd4916279ac93e8acad3e65767834396a38f2f03c346d337956e2f9b13a"}
Sep 17 19:25:45.256783 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:45.256439    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf" event={"ID":"14cce15c-8792-4da1-bd9d-9333aa09000c","Type":"ContainerStarted","Data":"aa3470996fe09447a31c75974d0f6062194ab149f19121ba2a3eb89f1a6b635c"}
Sep 17 19:25:49.273406 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:49.273370    2573 generic.go:356] "Generic (PLEG): container finished" podID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerID="a67cddd4916279ac93e8acad3e65767834396a38f2f03c346d337956e2f9b13a" exitCode=0
Sep 17 19:25:49.273769 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:49.273442    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf" event={"ID":"14cce15c-8792-4da1-bd9d-9333aa09000c","Type":"ContainerDied","Data":"a67cddd4916279ac93e8acad3e65767834396a38f2f03c346d337956e2f9b13a"}
Sep 17 19:25:50.280412 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:50.280379    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf" event={"ID":"14cce15c-8792-4da1-bd9d-9333aa09000c","Type":"ContainerStarted","Data":"a1b258e0d6cad4e75809dddc1d78e43a64073b0178fcf2477c591136c7614af6"}
Sep 17 19:25:50.280824 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:50.280446    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf" event={"ID":"14cce15c-8792-4da1-bd9d-9333aa09000c","Type":"ContainerStarted","Data":"9849f02707531ba7c28ce9a0764423a13c2b36041de1581e82940ce6ab4a2004"}
Sep 17 19:25:50.280824 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:50.280734    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"
Sep 17 19:25:50.300922 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:50.300857    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf" podStartSLOduration=3.396001735 podStartE2EDuration="7.300843066s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.904841331s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:25:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:25:50.300726597 +0000 UTC m=+1176.240083520" watchObservedRunningTime="2026-09-17 19:25:50.300843066 +0000 UTC m=+1176.240199987"
Sep 17 19:25:51.285116 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:51.285082    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"
Sep 17 19:25:51.286376 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:51.286350    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf" podUID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 19:25:52.289137 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:52.289100    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf" podUID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 19:25:57.293648 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:57.293613    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"
Sep 17 19:25:57.294280 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:25:57.294255    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf" podUID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 19:26:07.294320 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:26:07.294278    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf" podUID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 19:26:16.231527 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:26:16.231496    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbxgv_93bb0a24-3334-4d1f-a905-6f50ccd815ce/ovn-acl-logging/0.log"
Sep 17 19:26:16.232280 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:26:16.232258    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbxgv_93bb0a24-3334-4d1f-a905-6f50ccd815ce/ovn-acl-logging/0.log"
Sep 17 19:26:17.295046 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:26:17.294997    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf" podUID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 19:26:27.294580 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:26:27.294539    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf" podUID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 19:26:37.294593 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:26:37.294548    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf" podUID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 19:26:47.294515 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:26:47.294463    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf" podUID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 19:26:57.294384 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:26:57.294297    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf" podUID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 19:27:07.295106 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:07.295076    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"
Sep 17 19:27:13.828795 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:13.828764    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"]
Sep 17 19:27:13.829204 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:13.829060    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf" podUID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerName="kserve-container" containerID="cri-o://9849f02707531ba7c28ce9a0764423a13c2b36041de1581e82940ce6ab4a2004" gracePeriod=30
Sep 17 19:27:13.829204 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:13.829139    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf" podUID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerName="kube-rbac-proxy" containerID="cri-o://a1b258e0d6cad4e75809dddc1d78e43a64073b0178fcf2477c591136c7614af6" gracePeriod=30
Sep 17 19:27:14.633491 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:14.633458    2573 generic.go:356] "Generic (PLEG): container finished" podID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerID="a1b258e0d6cad4e75809dddc1d78e43a64073b0178fcf2477c591136c7614af6" exitCode=2
Sep 17 19:27:14.633660 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:14.633500    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf" event={"ID":"14cce15c-8792-4da1-bd9d-9333aa09000c","Type":"ContainerDied","Data":"a1b258e0d6cad4e75809dddc1d78e43a64073b0178fcf2477c591136c7614af6"}
Sep 17 19:27:17.289954 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:17.289875    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf" podUID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.29:8643/healthz\": dial tcp 10.132.0.29:8643: connect: connection refused"
Sep 17 19:27:17.294196 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:17.294166    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf" podUID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 19:27:18.651960 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:18.651925    2573 generic.go:356] "Generic (PLEG): container finished" podID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerID="9849f02707531ba7c28ce9a0764423a13c2b36041de1581e82940ce6ab4a2004" exitCode=0
Sep 17 19:27:18.652299 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:18.651995    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf" event={"ID":"14cce15c-8792-4da1-bd9d-9333aa09000c","Type":"ContainerDied","Data":"9849f02707531ba7c28ce9a0764423a13c2b36041de1581e82940ce6ab4a2004"}
Sep 17 19:27:18.669646 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:18.669620    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"
Sep 17 19:27:18.831589 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:18.831512    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/14cce15c-8792-4da1-bd9d-9333aa09000c-kube-rbac-proxy-sar-config\") pod \"14cce15c-8792-4da1-bd9d-9333aa09000c\" (UID: \"14cce15c-8792-4da1-bd9d-9333aa09000c\") "
Sep 17 19:27:18.831589 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:18.831577    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/14cce15c-8792-4da1-bd9d-9333aa09000c-cabundle-cert\") pod \"14cce15c-8792-4da1-bd9d-9333aa09000c\" (UID: \"14cce15c-8792-4da1-bd9d-9333aa09000c\") "
Sep 17 19:27:18.831815 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:18.831610    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/14cce15c-8792-4da1-bd9d-9333aa09000c-proxy-tls\") pod \"14cce15c-8792-4da1-bd9d-9333aa09000c\" (UID: \"14cce15c-8792-4da1-bd9d-9333aa09000c\") "
Sep 17 19:27:18.831815 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:18.831637    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/14cce15c-8792-4da1-bd9d-9333aa09000c-kserve-provision-location\") pod \"14cce15c-8792-4da1-bd9d-9333aa09000c\" (UID: \"14cce15c-8792-4da1-bd9d-9333aa09000c\") "
Sep 17 19:27:18.831815 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:18.831667    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsv75\" (UniqueName: \"kubernetes.io/projected/14cce15c-8792-4da1-bd9d-9333aa09000c-kube-api-access-lsv75\") pod \"14cce15c-8792-4da1-bd9d-9333aa09000c\" (UID: \"14cce15c-8792-4da1-bd9d-9333aa09000c\") "
Sep 17 19:27:18.832008 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:18.831894    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14cce15c-8792-4da1-bd9d-9333aa09000c-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "14cce15c-8792-4da1-bd9d-9333aa09000c" (UID: "14cce15c-8792-4da1-bd9d-9333aa09000c"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:27:18.832008 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:18.831952    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14cce15c-8792-4da1-bd9d-9333aa09000c-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "14cce15c-8792-4da1-bd9d-9333aa09000c" (UID: "14cce15c-8792-4da1-bd9d-9333aa09000c"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 19:27:18.832008 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:18.831960    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14cce15c-8792-4da1-bd9d-9333aa09000c-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "14cce15c-8792-4da1-bd9d-9333aa09000c" (UID: "14cce15c-8792-4da1-bd9d-9333aa09000c"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:27:18.833950 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:18.833916    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14cce15c-8792-4da1-bd9d-9333aa09000c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "14cce15c-8792-4da1-bd9d-9333aa09000c" (UID: "14cce15c-8792-4da1-bd9d-9333aa09000c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:27:18.834070 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:18.834026    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14cce15c-8792-4da1-bd9d-9333aa09000c-kube-api-access-lsv75" (OuterVolumeSpecName: "kube-api-access-lsv75") pod "14cce15c-8792-4da1-bd9d-9333aa09000c" (UID: "14cce15c-8792-4da1-bd9d-9333aa09000c"). InnerVolumeSpecName "kube-api-access-lsv75". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:27:18.932383 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:18.932346    2573 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/14cce15c-8792-4da1-bd9d-9333aa09000c-cabundle-cert\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:27:18.932383 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:18.932379    2573 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/14cce15c-8792-4da1-bd9d-9333aa09000c-proxy-tls\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:27:18.932383 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:18.932390    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/14cce15c-8792-4da1-bd9d-9333aa09000c-kserve-provision-location\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:27:18.932649 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:18.932401    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsv75\" (UniqueName: \"kubernetes.io/projected/14cce15c-8792-4da1-bd9d-9333aa09000c-kube-api-access-lsv75\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:27:18.932649 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:18.932410    2573 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/14cce15c-8792-4da1-bd9d-9333aa09000c-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:27:19.658412 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:19.658381    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"
Sep 17 19:27:19.658412 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:19.658389    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf" event={"ID":"14cce15c-8792-4da1-bd9d-9333aa09000c","Type":"ContainerDied","Data":"aa3470996fe09447a31c75974d0f6062194ab149f19121ba2a3eb89f1a6b635c"}
Sep 17 19:27:19.658908 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:19.658452    2573 scope.go:117] "RemoveContainer" containerID="a1b258e0d6cad4e75809dddc1d78e43a64073b0178fcf2477c591136c7614af6"
Sep 17 19:27:19.667147 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:19.667130    2573 scope.go:117] "RemoveContainer" containerID="9849f02707531ba7c28ce9a0764423a13c2b36041de1581e82940ce6ab4a2004"
Sep 17 19:27:19.674488 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:19.674471    2573 scope.go:117] "RemoveContainer" containerID="a67cddd4916279ac93e8acad3e65767834396a38f2f03c346d337956e2f9b13a"
Sep 17 19:27:19.681484 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:19.681461    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"]
Sep 17 19:27:19.683738 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:19.683717    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-7c7f45c769-s6bdf"]
Sep 17 19:27:20.224803 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:27:20.224771    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14cce15c-8792-4da1-bd9d-9333aa09000c" path="/var/lib/kubelet/pods/14cce15c-8792-4da1-bd9d-9333aa09000c/volumes"
Sep 17 19:31:16.258146 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:31:16.258118    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbxgv_93bb0a24-3334-4d1f-a905-6f50ccd815ce/ovn-acl-logging/0.log"
Sep 17 19:31:16.260125 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:31:16.260102    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbxgv_93bb0a24-3334-4d1f-a905-6f50ccd815ce/ovn-acl-logging/0.log"
Sep 17 19:32:30.305142 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:30.305104    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q7fhm/must-gather-pdpz6"]
Sep 17 19:32:30.307638 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:30.305466    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerName="storage-initializer"
Sep 17 19:32:30.307638 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:30.305479    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerName="storage-initializer"
Sep 17 19:32:30.307638 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:30.305486    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerName="kube-rbac-proxy"
Sep 17 19:32:30.307638 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:30.305492    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerName="kube-rbac-proxy"
Sep 17 19:32:30.307638 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:30.305508    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerName="kserve-container"
Sep 17 19:32:30.307638 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:30.305513    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerName="kserve-container"
Sep 17 19:32:30.307638 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:30.305569    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerName="kube-rbac-proxy"
Sep 17 19:32:30.307638 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:30.305579    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="14cce15c-8792-4da1-bd9d-9333aa09000c" containerName="kserve-container"
Sep 17 19:32:30.308678 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:30.308658    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q7fhm/must-gather-pdpz6"
Sep 17 19:32:30.311382 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:30.311352    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q7fhm\"/\"openshift-service-ca.crt\""
Sep 17 19:32:30.311502 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:30.311440    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q7fhm\"/\"kube-root-ca.crt\""
Sep 17 19:32:30.319291 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:30.319268    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q7fhm/must-gather-pdpz6"]
Sep 17 19:32:30.390054 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:30.390018    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxpcd\" (UniqueName: \"kubernetes.io/projected/c6ecce3e-43ac-4bc7-90e4-d19d058278a1-kube-api-access-fxpcd\") pod \"must-gather-pdpz6\" (UID: \"c6ecce3e-43ac-4bc7-90e4-d19d058278a1\") " pod="openshift-must-gather-q7fhm/must-gather-pdpz6"
Sep 17 19:32:30.390239 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:30.390089    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c6ecce3e-43ac-4bc7-90e4-d19d058278a1-must-gather-output\") pod \"must-gather-pdpz6\" (UID: \"c6ecce3e-43ac-4bc7-90e4-d19d058278a1\") " pod="openshift-must-gather-q7fhm/must-gather-pdpz6"
Sep 17 19:32:30.490850 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:30.490817    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxpcd\" (UniqueName: \"kubernetes.io/projected/c6ecce3e-43ac-4bc7-90e4-d19d058278a1-kube-api-access-fxpcd\") pod \"must-gather-pdpz6\" (UID: \"c6ecce3e-43ac-4bc7-90e4-d19d058278a1\") " pod="openshift-must-gather-q7fhm/must-gather-pdpz6"
Sep 17 19:32:30.491054 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:30.490898    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c6ecce3e-43ac-4bc7-90e4-d19d058278a1-must-gather-output\") pod \"must-gather-pdpz6\" (UID: \"c6ecce3e-43ac-4bc7-90e4-d19d058278a1\") " pod="openshift-must-gather-q7fhm/must-gather-pdpz6"
Sep 17 19:32:30.491200 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:30.491186    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c6ecce3e-43ac-4bc7-90e4-d19d058278a1-must-gather-output\") pod \"must-gather-pdpz6\" (UID: \"c6ecce3e-43ac-4bc7-90e4-d19d058278a1\") " pod="openshift-must-gather-q7fhm/must-gather-pdpz6"
Sep 17 19:32:30.498930 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:30.498901    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxpcd\" (UniqueName: \"kubernetes.io/projected/c6ecce3e-43ac-4bc7-90e4-d19d058278a1-kube-api-access-fxpcd\") pod \"must-gather-pdpz6\" (UID: \"c6ecce3e-43ac-4bc7-90e4-d19d058278a1\") " pod="openshift-must-gather-q7fhm/must-gather-pdpz6"
Sep 17 19:32:30.626945 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:30.626857    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q7fhm/must-gather-pdpz6"
Sep 17 19:32:30.900935 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:30.900812    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q7fhm/must-gather-pdpz6"]
Sep 17 19:32:30.903608 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:32:30.903582    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6ecce3e_43ac_4bc7_90e4_d19d058278a1.slice/crio-22e86bc6f9f8101f676c4a903ff59537fa9e0efac1a230614ba8203ab35ce0d6 WatchSource:0}: Error finding container 22e86bc6f9f8101f676c4a903ff59537fa9e0efac1a230614ba8203ab35ce0d6: Status 404 returned error can't find the container with id 22e86bc6f9f8101f676c4a903ff59537fa9e0efac1a230614ba8203ab35ce0d6
Sep 17 19:32:30.905271 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:30.905254    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 19:32:31.902565 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:31.902489    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q7fhm/must-gather-pdpz6" event={"ID":"c6ecce3e-43ac-4bc7-90e4-d19d058278a1","Type":"ContainerStarted","Data":"22e86bc6f9f8101f676c4a903ff59537fa9e0efac1a230614ba8203ab35ce0d6"}
Sep 17 19:32:38.937564 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:38.937511    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q7fhm/must-gather-pdpz6" event={"ID":"c6ecce3e-43ac-4bc7-90e4-d19d058278a1","Type":"ContainerStarted","Data":"e3673a8af4a34a4f9b4148258bf7787cbf0a2d3f916df2ec447ab6a96da04b4c"}
Sep 17 19:32:38.937564 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:38.937558    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q7fhm/must-gather-pdpz6" event={"ID":"c6ecce3e-43ac-4bc7-90e4-d19d058278a1","Type":"ContainerStarted","Data":"02a6fb9b65bc331cea3b89b39303b1e30e459f068d159352c4138ff1c36ab0af"}
Sep 17 19:32:38.954040 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:32:38.953983    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q7fhm/must-gather-pdpz6" podStartSLOduration=1.785168332 podStartE2EDuration="8.953965449s" totalImagesPullingTime="7.168797117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:32:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:32:38.952490366 +0000 UTC m=+1584.891847331" watchObservedRunningTime="2026-09-17 19:32:38.953965449 +0000 UTC m=+1584.893322370"
Sep 17 19:33:01.036645 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:01.036609    2573 generic.go:356] "Generic (PLEG): container finished" podID="c6ecce3e-43ac-4bc7-90e4-d19d058278a1" containerID="02a6fb9b65bc331cea3b89b39303b1e30e459f068d159352c4138ff1c36ab0af" exitCode=0
Sep 17 19:33:01.037121 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:01.036680    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q7fhm/must-gather-pdpz6" event={"ID":"c6ecce3e-43ac-4bc7-90e4-d19d058278a1","Type":"ContainerDied","Data":"02a6fb9b65bc331cea3b89b39303b1e30e459f068d159352c4138ff1c36ab0af"}
Sep 17 19:33:01.037121 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:01.037034    2573 scope.go:117] "RemoveContainer" containerID="02a6fb9b65bc331cea3b89b39303b1e30e459f068d159352c4138ff1c36ab0af"
Sep 17 19:33:01.191979 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:01.191946    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-q7fhm_must-gather-pdpz6_c6ecce3e-43ac-4bc7-90e4-d19d058278a1/gather/0.log"
Sep 17 19:33:01.784083 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:01.784047    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n9b8n/must-gather-4l5ql"]
Sep 17 19:33:01.787378 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:01.787353    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n9b8n/must-gather-4l5ql"
Sep 17 19:33:01.789966 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:01.789947    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n9b8n\"/\"openshift-service-ca.crt\""
Sep 17 19:33:01.791078 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:01.791047    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n9b8n\"/\"default-dockercfg-qplkf\""
Sep 17 19:33:01.791195 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:01.791075    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n9b8n\"/\"kube-root-ca.crt\""
Sep 17 19:33:01.797933 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:01.797903    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n9b8n/must-gather-4l5ql"]
Sep 17 19:33:01.875970 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:01.875911    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0e2dcd92-e31c-48dc-accf-983ae8b65578-must-gather-output\") pod \"must-gather-4l5ql\" (UID: \"0e2dcd92-e31c-48dc-accf-983ae8b65578\") " pod="openshift-must-gather-n9b8n/must-gather-4l5ql"
Sep 17 19:33:01.876187 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:01.876015    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxjld\" (UniqueName: \"kubernetes.io/projected/0e2dcd92-e31c-48dc-accf-983ae8b65578-kube-api-access-hxjld\") pod \"must-gather-4l5ql\" (UID: \"0e2dcd92-e31c-48dc-accf-983ae8b65578\") " pod="openshift-must-gather-n9b8n/must-gather-4l5ql"
Sep 17 19:33:01.976964 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:01.976923    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0e2dcd92-e31c-48dc-accf-983ae8b65578-must-gather-output\") pod \"must-gather-4l5ql\" (UID: \"0e2dcd92-e31c-48dc-accf-983ae8b65578\") " pod="openshift-must-gather-n9b8n/must-gather-4l5ql"
Sep 17 19:33:01.977145 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:01.977002    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxjld\" (UniqueName: \"kubernetes.io/projected/0e2dcd92-e31c-48dc-accf-983ae8b65578-kube-api-access-hxjld\") pod \"must-gather-4l5ql\" (UID: \"0e2dcd92-e31c-48dc-accf-983ae8b65578\") " pod="openshift-must-gather-n9b8n/must-gather-4l5ql"
Sep 17 19:33:01.977189 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:01.977150    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0e2dcd92-e31c-48dc-accf-983ae8b65578-must-gather-output\") pod \"must-gather-4l5ql\" (UID: \"0e2dcd92-e31c-48dc-accf-983ae8b65578\") " pod="openshift-must-gather-n9b8n/must-gather-4l5ql"
Sep 17 19:33:01.984895 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:01.984859    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxjld\" (UniqueName: \"kubernetes.io/projected/0e2dcd92-e31c-48dc-accf-983ae8b65578-kube-api-access-hxjld\") pod \"must-gather-4l5ql\" (UID: \"0e2dcd92-e31c-48dc-accf-983ae8b65578\") " pod="openshift-must-gather-n9b8n/must-gather-4l5ql"
Sep 17 19:33:02.100424 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:02.100321    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n9b8n/must-gather-4l5ql"
Sep 17 19:33:02.375001 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:02.374949    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n9b8n/must-gather-4l5ql"]
Sep 17 19:33:02.377294 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:33:02.377267    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e2dcd92_e31c_48dc_accf_983ae8b65578.slice/crio-106009b5d8e0f27fb3c459f28c0c8f3eb10ebc8abcab617fc77b23c7dabffc90 WatchSource:0}: Error finding container 106009b5d8e0f27fb3c459f28c0c8f3eb10ebc8abcab617fc77b23c7dabffc90: Status 404 returned error can't find the container with id 106009b5d8e0f27fb3c459f28c0c8f3eb10ebc8abcab617fc77b23c7dabffc90
Sep 17 19:33:03.047452 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:03.047415    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n9b8n/must-gather-4l5ql" event={"ID":"0e2dcd92-e31c-48dc-accf-983ae8b65578","Type":"ContainerStarted","Data":"106009b5d8e0f27fb3c459f28c0c8f3eb10ebc8abcab617fc77b23c7dabffc90"}
Sep 17 19:33:04.056012 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:04.055972    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n9b8n/must-gather-4l5ql" event={"ID":"0e2dcd92-e31c-48dc-accf-983ae8b65578","Type":"ContainerStarted","Data":"82798ac95db9c7531df14de049882964c71159281541ffa7ea927fef761757ac"}
Sep 17 19:33:04.056636 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:04.056593    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n9b8n/must-gather-4l5ql" event={"ID":"0e2dcd92-e31c-48dc-accf-983ae8b65578","Type":"ContainerStarted","Data":"27f48f77d59d6142717d525955be669fac09d0cde543acd511b78f5d711ff0f6"}
Sep 17 19:33:04.073555 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:04.073487    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n9b8n/must-gather-4l5ql" podStartSLOduration=2.268744005 podStartE2EDuration="3.073462583s" totalImagesPullingTime="804.718578ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:33:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:33:04.07330001 +0000 UTC m=+1610.012656932" watchObservedRunningTime="2026-09-17 19:33:04.073462583 +0000 UTC m=+1610.012819505"
Sep 17 19:33:04.673238 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:04.673207    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6sp4v_273ee390-dd66-4cfa-b503-c9d1983d5e0a/global-pull-secret-syncer/0.log"
Sep 17 19:33:04.831229 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:04.831183    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6f5gw_71d0cb8b-edaf-4832-a653-81ddd6c84cca/konnectivity-agent/0.log"
Sep 17 19:33:04.919104 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:04.919071    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-84.ec2.internal_650f74a4f22bb301be07e776d42e3b65/haproxy/0.log"
Sep 17 19:33:06.618655 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:06.618616    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-q7fhm/must-gather-pdpz6"]
Sep 17 19:33:06.619184 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:06.618909    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-q7fhm/must-gather-pdpz6" podUID="c6ecce3e-43ac-4bc7-90e4-d19d058278a1" containerName="copy" containerID="cri-o://e3673a8af4a34a4f9b4148258bf7787cbf0a2d3f916df2ec447ab6a96da04b4c" gracePeriod=2
Sep 17 19:33:06.623983 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:06.623922    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-q7fhm/must-gather-pdpz6"]
Sep 17 19:33:06.968639 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:06.968546    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-q7fhm_must-gather-pdpz6_c6ecce3e-43ac-4bc7-90e4-d19d058278a1/copy/0.log"
Sep 17 19:33:06.972406 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:06.972143    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q7fhm/must-gather-pdpz6"
Sep 17 19:33:06.974701 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:33:06.974649    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-pdpz6\" is forbidden: User \"system:node:ip-10-0-138-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-q7fhm\": no relationship found between node 'ip-10-0-138-84.ec2.internal' and this object" podUID="c6ecce3e-43ac-4bc7-90e4-d19d058278a1" pod="openshift-must-gather-q7fhm/must-gather-pdpz6"
Sep 17 19:33:07.033388 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:07.029392    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxpcd\" (UniqueName: \"kubernetes.io/projected/c6ecce3e-43ac-4bc7-90e4-d19d058278a1-kube-api-access-fxpcd\") pod \"c6ecce3e-43ac-4bc7-90e4-d19d058278a1\" (UID: \"c6ecce3e-43ac-4bc7-90e4-d19d058278a1\") "
Sep 17 19:33:07.033388 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:07.029451    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c6ecce3e-43ac-4bc7-90e4-d19d058278a1-must-gather-output\") pod \"c6ecce3e-43ac-4bc7-90e4-d19d058278a1\" (UID: \"c6ecce3e-43ac-4bc7-90e4-d19d058278a1\") "
Sep 17 19:33:07.033388 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:07.031643    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6ecce3e-43ac-4bc7-90e4-d19d058278a1-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "c6ecce3e-43ac-4bc7-90e4-d19d058278a1" (UID: "c6ecce3e-43ac-4bc7-90e4-d19d058278a1"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 19:33:07.035510 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:07.035471    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6ecce3e-43ac-4bc7-90e4-d19d058278a1-kube-api-access-fxpcd" (OuterVolumeSpecName: "kube-api-access-fxpcd") pod "c6ecce3e-43ac-4bc7-90e4-d19d058278a1" (UID: "c6ecce3e-43ac-4bc7-90e4-d19d058278a1"). InnerVolumeSpecName "kube-api-access-fxpcd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:33:07.073358 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:07.073324    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-q7fhm_must-gather-pdpz6_c6ecce3e-43ac-4bc7-90e4-d19d058278a1/copy/0.log"
Sep 17 19:33:07.073923 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:07.073873    2573 generic.go:356] "Generic (PLEG): container finished" podID="c6ecce3e-43ac-4bc7-90e4-d19d058278a1" containerID="e3673a8af4a34a4f9b4148258bf7787cbf0a2d3f916df2ec447ab6a96da04b4c" exitCode=143
Sep 17 19:33:07.074131 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:07.074042    2573 scope.go:117] "RemoveContainer" containerID="e3673a8af4a34a4f9b4148258bf7787cbf0a2d3f916df2ec447ab6a96da04b4c"
Sep 17 19:33:07.074131 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:07.074102    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q7fhm/must-gather-pdpz6"
Sep 17 19:33:07.076678 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:33:07.076640    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-pdpz6\" is forbidden: User \"system:node:ip-10-0-138-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-q7fhm\": no relationship found between node 'ip-10-0-138-84.ec2.internal' and this object" podUID="c6ecce3e-43ac-4bc7-90e4-d19d058278a1" pod="openshift-must-gather-q7fhm/must-gather-pdpz6"
Sep 17 19:33:07.095983 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:33:07.093669    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-pdpz6\" is forbidden: User \"system:node:ip-10-0-138-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-q7fhm\": no relationship found between node 'ip-10-0-138-84.ec2.internal' and this object" podUID="c6ecce3e-43ac-4bc7-90e4-d19d058278a1" pod="openshift-must-gather-q7fhm/must-gather-pdpz6"
Sep 17 19:33:07.102376 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:07.098486    2573 scope.go:117] "RemoveContainer" containerID="02a6fb9b65bc331cea3b89b39303b1e30e459f068d159352c4138ff1c36ab0af"
Sep 17 19:33:07.131299 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:07.131258    2573 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c6ecce3e-43ac-4bc7-90e4-d19d058278a1-must-gather-output\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:33:07.131524 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:07.131508    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxpcd\" (UniqueName: \"kubernetes.io/projected/c6ecce3e-43ac-4bc7-90e4-d19d058278a1-kube-api-access-fxpcd\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 17 19:33:07.135236 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:07.135210    2573 scope.go:117] "RemoveContainer" containerID="e3673a8af4a34a4f9b4148258bf7787cbf0a2d3f916df2ec447ab6a96da04b4c"
Sep 17 19:33:07.135786 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:33:07.135759    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3673a8af4a34a4f9b4148258bf7787cbf0a2d3f916df2ec447ab6a96da04b4c\": container with ID starting with e3673a8af4a34a4f9b4148258bf7787cbf0a2d3f916df2ec447ab6a96da04b4c not found: ID does not exist" containerID="e3673a8af4a34a4f9b4148258bf7787cbf0a2d3f916df2ec447ab6a96da04b4c"
Sep 17 19:33:07.135967 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:07.135940    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3673a8af4a34a4f9b4148258bf7787cbf0a2d3f916df2ec447ab6a96da04b4c"} err="failed to get container status \"e3673a8af4a34a4f9b4148258bf7787cbf0a2d3f916df2ec447ab6a96da04b4c\": rpc error: code = NotFound desc = could not find container \"e3673a8af4a34a4f9b4148258bf7787cbf0a2d3f916df2ec447ab6a96da04b4c\": container with ID starting with e3673a8af4a34a4f9b4148258bf7787cbf0a2d3f916df2ec447ab6a96da04b4c not found: ID does not exist"
Sep 17 19:33:07.136086 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:07.136074    2573 scope.go:117] "RemoveContainer" containerID="02a6fb9b65bc331cea3b89b39303b1e30e459f068d159352c4138ff1c36ab0af"
Sep 17 19:33:07.136513 ip-10-0-138-84 kubenswrapper[2573]: E0917 19:33:07.136492    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02a6fb9b65bc331cea3b89b39303b1e30e459f068d159352c4138ff1c36ab0af\": container with ID starting with 02a6fb9b65bc331cea3b89b39303b1e30e459f068d159352c4138ff1c36ab0af not found: ID does not exist" containerID="02a6fb9b65bc331cea3b89b39303b1e30e459f068d159352c4138ff1c36ab0af"
Sep 17 19:33:07.136642 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:07.136622    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02a6fb9b65bc331cea3b89b39303b1e30e459f068d159352c4138ff1c36ab0af"} err="failed to get container status \"02a6fb9b65bc331cea3b89b39303b1e30e459f068d159352c4138ff1c36ab0af\": rpc error: code = NotFound desc = could not find container \"02a6fb9b65bc331cea3b89b39303b1e30e459f068d159352c4138ff1c36ab0af\": container with ID starting with 02a6fb9b65bc331cea3b89b39303b1e30e459f068d159352c4138ff1c36ab0af not found: ID does not exist"
Sep 17 19:33:08.229549 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:08.229504    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6ecce3e-43ac-4bc7-90e4-d19d058278a1" path="/var/lib/kubelet/pods/c6ecce3e-43ac-4bc7-90e4-d19d058278a1/volumes"
Sep 17 19:33:08.748833 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:08.748799    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_235e15f4-3dfa-40fe-9c9e-155a50fcc3ad/alertmanager/0.log"
Sep 17 19:33:08.783492 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:08.783460    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_235e15f4-3dfa-40fe-9c9e-155a50fcc3ad/config-reloader/0.log"
Sep 17 19:33:08.818653 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:08.818623    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_235e15f4-3dfa-40fe-9c9e-155a50fcc3ad/kube-rbac-proxy-web/0.log"
Sep 17 19:33:08.851186 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:08.851162    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_235e15f4-3dfa-40fe-9c9e-155a50fcc3ad/kube-rbac-proxy/0.log"
Sep 17 19:33:08.886626 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:08.886568    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_235e15f4-3dfa-40fe-9c9e-155a50fcc3ad/kube-rbac-proxy-metric/0.log"
Sep 17 19:33:08.916420 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:08.916383    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_235e15f4-3dfa-40fe-9c9e-155a50fcc3ad/prom-label-proxy/0.log"
Sep 17 19:33:08.946293 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:08.946244    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_235e15f4-3dfa-40fe-9c9e-155a50fcc3ad/init-config-reloader/0.log"
Sep 17 19:33:09.034202 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:09.034115    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-mvsxr_8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d/kube-state-metrics/0.log"
Sep 17 19:33:09.066449 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:09.066352    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-mvsxr_8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d/kube-rbac-proxy-main/0.log"
Sep 17 19:33:09.099219 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:09.099073    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-mvsxr_8ec5ed87-0c2c-4ec6-89ca-2785e3104f6d/kube-rbac-proxy-self/0.log"
Sep 17 19:33:09.161094 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:09.161018    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-rwb54_dcc12a90-74bc-431f-ae89-32e0e3f5aceb/monitoring-plugin/0.log"
Sep 17 19:33:09.375505 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:09.375431    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4fnj_3a694491-cfec-4880-99e2-48884ae3931d/node-exporter/0.log"
Sep 17 19:33:09.405452 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:09.405405    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4fnj_3a694491-cfec-4880-99e2-48884ae3931d/kube-rbac-proxy/0.log"
Sep 17 19:33:09.430312 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:09.430286    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4fnj_3a694491-cfec-4880-99e2-48884ae3931d/init-textfile/0.log"
Sep 17 19:33:09.460383 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:09.460350    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-m4rfp_4fa7d1b2-3da3-4d27-8170-5f86beef62cb/kube-rbac-proxy-main/0.log"
Sep 17 19:33:09.487975 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:09.487944    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-m4rfp_4fa7d1b2-3da3-4d27-8170-5f86beef62cb/kube-rbac-proxy-self/0.log"
Sep 17 19:33:09.511826 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:09.511794    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-m4rfp_4fa7d1b2-3da3-4d27-8170-5f86beef62cb/openshift-state-metrics/0.log"
Sep 17 19:33:09.558325 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:09.558297    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06f8c1fb-a990-4775-b5e4-6f7efeb20eeb/prometheus/0.log"
Sep 17 19:33:09.586105 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:09.586074    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06f8c1fb-a990-4775-b5e4-6f7efeb20eeb/config-reloader/0.log"
Sep 17 19:33:09.612164 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:09.612130    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06f8c1fb-a990-4775-b5e4-6f7efeb20eeb/thanos-sidecar/0.log"
Sep 17 19:33:09.641821 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:09.641742    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06f8c1fb-a990-4775-b5e4-6f7efeb20eeb/kube-rbac-proxy-web/0.log"
Sep 17 19:33:09.673513 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:09.673488    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06f8c1fb-a990-4775-b5e4-6f7efeb20eeb/kube-rbac-proxy/0.log"
Sep 17 19:33:09.700803 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:09.700772    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06f8c1fb-a990-4775-b5e4-6f7efeb20eeb/kube-rbac-proxy-thanos/0.log"
Sep 17 19:33:09.727925 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:09.727900    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06f8c1fb-a990-4775-b5e4-6f7efeb20eeb/init-config-reloader/0.log"
Sep 17 19:33:09.764037 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:09.763990    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-6kh6m_23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250/prometheus-operator/0.log"
Sep 17 19:33:09.788457 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:09.788423    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-6kh6m_23a9e4c7-5f3a-4cf5-937d-e4dc74cb5250/kube-rbac-proxy/0.log"
Sep 17 19:33:09.819672 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:09.819626    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-67jzf_e519fed0-84a5-460c-8bc8-9400230c7a78/prometheus-operator-admission-webhook/0.log"
Sep 17 19:33:11.471826 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:11.471784    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-ltlpr_4e54aa88-d09c-481b-b8c8-2f3edc3a2752/networking-console-plugin/0.log"
Sep 17 19:33:13.058992 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.058946    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-w58tj_1cbf7088-792c-472e-b3a2-cf096e8cdbd3/volume-data-source-validator/0.log"
Sep 17 19:33:13.223830 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.223790    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2"]
Sep 17 19:33:13.224155 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.224141    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6ecce3e-43ac-4bc7-90e4-d19d058278a1" containerName="copy"
Sep 17 19:33:13.224214 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.224157    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6ecce3e-43ac-4bc7-90e4-d19d058278a1" containerName="copy"
Sep 17 19:33:13.224214 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.224168    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6ecce3e-43ac-4bc7-90e4-d19d058278a1" containerName="gather"
Sep 17 19:33:13.224214 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.224173    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6ecce3e-43ac-4bc7-90e4-d19d058278a1" containerName="gather"
Sep 17 19:33:13.224325 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.224235    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6ecce3e-43ac-4bc7-90e4-d19d058278a1" containerName="gather"
Sep 17 19:33:13.224325 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.224247    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6ecce3e-43ac-4bc7-90e4-d19d058278a1" containerName="copy"
Sep 17 19:33:13.229723 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.229693    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2"
Sep 17 19:33:13.239779 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.239742    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2"]
Sep 17 19:33:13.292709 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.292672    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69a9b5ca-b9cc-4a68-a638-9ba7a6e79974-lib-modules\") pod \"perf-node-gather-daemonset-rp9d2\" (UID: \"69a9b5ca-b9cc-4a68-a638-9ba7a6e79974\") " pod="openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2"
Sep 17 19:33:13.293047 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.293021    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/69a9b5ca-b9cc-4a68-a638-9ba7a6e79974-podres\") pod \"perf-node-gather-daemonset-rp9d2\" (UID: \"69a9b5ca-b9cc-4a68-a638-9ba7a6e79974\") " pod="openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2"
Sep 17 19:33:13.293188 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.293174    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69a9b5ca-b9cc-4a68-a638-9ba7a6e79974-sys\") pod \"perf-node-gather-daemonset-rp9d2\" (UID: \"69a9b5ca-b9cc-4a68-a638-9ba7a6e79974\") " pod="openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2"
Sep 17 19:33:13.293314 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.293298    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc6bv\" (UniqueName: \"kubernetes.io/projected/69a9b5ca-b9cc-4a68-a638-9ba7a6e79974-kube-api-access-gc6bv\") pod \"perf-node-gather-daemonset-rp9d2\" (UID: \"69a9b5ca-b9cc-4a68-a638-9ba7a6e79974\") " pod="openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2"
Sep 17 19:33:13.293464 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.293449    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/69a9b5ca-b9cc-4a68-a638-9ba7a6e79974-proc\") pod \"perf-node-gather-daemonset-rp9d2\" (UID: \"69a9b5ca-b9cc-4a68-a638-9ba7a6e79974\") " pod="openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2"
Sep 17 19:33:13.394773 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.394672    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69a9b5ca-b9cc-4a68-a638-9ba7a6e79974-lib-modules\") pod \"perf-node-gather-daemonset-rp9d2\" (UID: \"69a9b5ca-b9cc-4a68-a638-9ba7a6e79974\") " pod="openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2"
Sep 17 19:33:13.394773 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.394730    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/69a9b5ca-b9cc-4a68-a638-9ba7a6e79974-podres\") pod \"perf-node-gather-daemonset-rp9d2\" (UID: \"69a9b5ca-b9cc-4a68-a638-9ba7a6e79974\") " pod="openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2"
Sep 17 19:33:13.394773 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.394755    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69a9b5ca-b9cc-4a68-a638-9ba7a6e79974-sys\") pod \"perf-node-gather-daemonset-rp9d2\" (UID: \"69a9b5ca-b9cc-4a68-a638-9ba7a6e79974\") " pod="openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2"
Sep 17 19:33:13.395106 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.394787    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc6bv\" (UniqueName: \"kubernetes.io/projected/69a9b5ca-b9cc-4a68-a638-9ba7a6e79974-kube-api-access-gc6bv\") pod \"perf-node-gather-daemonset-rp9d2\" (UID: \"69a9b5ca-b9cc-4a68-a638-9ba7a6e79974\") " pod="openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2"
Sep 17 19:33:13.395106 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.394834    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/69a9b5ca-b9cc-4a68-a638-9ba7a6e79974-proc\") pod \"perf-node-gather-daemonset-rp9d2\" (UID: \"69a9b5ca-b9cc-4a68-a638-9ba7a6e79974\") " pod="openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2"
Sep 17 19:33:13.395106 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.394893    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69a9b5ca-b9cc-4a68-a638-9ba7a6e79974-sys\") pod \"perf-node-gather-daemonset-rp9d2\" (UID: \"69a9b5ca-b9cc-4a68-a638-9ba7a6e79974\") " pod="openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2"
Sep 17 19:33:13.395106 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.394941    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69a9b5ca-b9cc-4a68-a638-9ba7a6e79974-lib-modules\") pod \"perf-node-gather-daemonset-rp9d2\" (UID: \"69a9b5ca-b9cc-4a68-a638-9ba7a6e79974\") " pod="openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2"
Sep 17 19:33:13.395106 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.394963    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/69a9b5ca-b9cc-4a68-a638-9ba7a6e79974-proc\") pod \"perf-node-gather-daemonset-rp9d2\" (UID: \"69a9b5ca-b9cc-4a68-a638-9ba7a6e79974\") " pod="openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2"
Sep 17 19:33:13.395106 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.395006    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/69a9b5ca-b9cc-4a68-a638-9ba7a6e79974-podres\") pod \"perf-node-gather-daemonset-rp9d2\" (UID: \"69a9b5ca-b9cc-4a68-a638-9ba7a6e79974\") " pod="openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2"
Sep 17 19:33:13.404010 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.403977    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc6bv\" (UniqueName: \"kubernetes.io/projected/69a9b5ca-b9cc-4a68-a638-9ba7a6e79974-kube-api-access-gc6bv\") pod \"perf-node-gather-daemonset-rp9d2\" (UID: \"69a9b5ca-b9cc-4a68-a638-9ba7a6e79974\") " pod="openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2"
Sep 17 19:33:13.542238 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.542187    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2"
Sep 17 19:33:13.832912 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:13.832801    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2"]
Sep 17 19:33:13.837421 ip-10-0-138-84 kubenswrapper[2573]: W0917 19:33:13.837392    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod69a9b5ca_b9cc_4a68_a638_9ba7a6e79974.slice/crio-91ace00eefd73c3805ee21277f15e19e0e2e716f64b087f422771bea38f053fb WatchSource:0}: Error finding container 91ace00eefd73c3805ee21277f15e19e0e2e716f64b087f422771bea38f053fb: Status 404 returned error can't find the container with id 91ace00eefd73c3805ee21277f15e19e0e2e716f64b087f422771bea38f053fb
Sep 17 19:33:14.110679 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:14.110597    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x6b8k_0a637dc8-de44-4812-b512-b17407738093/dns/0.log"
Sep 17 19:33:14.126278 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:14.126243    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2" event={"ID":"69a9b5ca-b9cc-4a68-a638-9ba7a6e79974","Type":"ContainerStarted","Data":"9d482bf1fec0e86b1fc971ea7c41fe13df518f66c326351da637523f7ee032be"}
Sep 17 19:33:14.126448 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:14.126297    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2" event={"ID":"69a9b5ca-b9cc-4a68-a638-9ba7a6e79974","Type":"ContainerStarted","Data":"91ace00eefd73c3805ee21277f15e19e0e2e716f64b087f422771bea38f053fb"}
Sep 17 19:33:14.126448 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:14.126328    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2"
Sep 17 19:33:14.131486 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:14.131456    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x6b8k_0a637dc8-de44-4812-b512-b17407738093/kube-rbac-proxy/0.log"
Sep 17 19:33:14.143445 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:14.143396    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2" podStartSLOduration=1.143378477 podStartE2EDuration="1.143378477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:33:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:33:14.141852545 +0000 UTC m=+1620.081209461" watchObservedRunningTime="2026-09-17 19:33:14.143378477 +0000 UTC m=+1620.082735398"
Sep 17 19:33:14.155681 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:14.155649    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6cnk9_c4cc155d-43c9-4590-964c-a6564c0ca4e2/dns-node-resolver/0.log"
Sep 17 19:33:14.762003 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:14.761955    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h5vqv_c545dfa9-0c6e-4493-8f12-cd63c012cb53/node-ca/0.log"
Sep 17 19:33:15.882082 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:15.882051    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7jdjw_3fb9b16c-03f2-4f40-abc6-c4ce643dbf1c/serve-healthcheck-canary/0.log"
Sep 17 19:33:16.337092 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:16.337062    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g429k_cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d/kube-rbac-proxy/0.log"
Sep 17 19:33:16.359701 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:16.359677    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g429k_cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d/exporter/0.log"
Sep 17 19:33:16.381646 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:16.381599    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g429k_cec7d6f3-d29d-401f-b6c8-162ce5dd2c2d/extractor/0.log"
Sep 17 19:33:19.118245 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:19.118210    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-b52z2_f1bbfa72-ec62-4b43-8315-caebd3dc5b9f/s3-init/0.log"
Sep 17 19:33:19.135205 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:19.135183    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-b52z2_f1bbfa72-ec62-4b43-8315-caebd3dc5b9f/download-hf-model/0.log"
Sep 17 19:33:20.141345 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:20.141316    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n9b8n/perf-node-gather-daemonset-rp9d2"
Sep 17 19:33:24.891776 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:24.891739    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5vtc4_0e0e5f4d-981b-487c-a961-f7b0039e78cd/kube-multus/0.log"
Sep 17 19:33:25.097368 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:25.097332    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sx5k8_4169f431-6727-4b3e-a060-a59d9924854e/kube-multus-additional-cni-plugins/0.log"
Sep 17 19:33:25.124828 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:25.124805    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sx5k8_4169f431-6727-4b3e-a060-a59d9924854e/egress-router-binary-copy/0.log"
Sep 17 19:33:25.148446 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:25.148422    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sx5k8_4169f431-6727-4b3e-a060-a59d9924854e/cni-plugins/0.log"
Sep 17 19:33:25.171727 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:25.171700    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sx5k8_4169f431-6727-4b3e-a060-a59d9924854e/bond-cni-plugin/0.log"
Sep 17 19:33:25.193781 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:25.193757    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sx5k8_4169f431-6727-4b3e-a060-a59d9924854e/routeoverride-cni/0.log"
Sep 17 19:33:25.216535 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:25.216506    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sx5k8_4169f431-6727-4b3e-a060-a59d9924854e/whereabouts-cni-bincopy/0.log"
Sep 17 19:33:25.240435 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:25.240404    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sx5k8_4169f431-6727-4b3e-a060-a59d9924854e/whereabouts-cni/0.log"
Sep 17 19:33:25.545755 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:25.545718    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fxwkw_b7c8049f-7c97-4d5f-8279-ea12aba931cc/network-metrics-daemon/0.log"
Sep 17 19:33:25.566098 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:25.566055    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fxwkw_b7c8049f-7c97-4d5f-8279-ea12aba931cc/kube-rbac-proxy/0.log"
Sep 17 19:33:26.793470 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:26.793435    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbxgv_93bb0a24-3334-4d1f-a905-6f50ccd815ce/ovn-controller/0.log"
Sep 17 19:33:26.811801 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:26.811776    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbxgv_93bb0a24-3334-4d1f-a905-6f50ccd815ce/ovn-acl-logging/0.log"
Sep 17 19:33:26.811801 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:26.811783    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbxgv_93bb0a24-3334-4d1f-a905-6f50ccd815ce/ovn-acl-logging/1.log"
Sep 17 19:33:26.834591 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:26.834559    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbxgv_93bb0a24-3334-4d1f-a905-6f50ccd815ce/kube-rbac-proxy-node/0.log"
Sep 17 19:33:26.944999 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:26.944967    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbxgv_93bb0a24-3334-4d1f-a905-6f50ccd815ce/kube-rbac-proxy-ovn-metrics/0.log"
Sep 17 19:33:27.035241 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:27.035209    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbxgv_93bb0a24-3334-4d1f-a905-6f50ccd815ce/northd/0.log"
Sep 17 19:33:27.081068 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:27.080961    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbxgv_93bb0a24-3334-4d1f-a905-6f50ccd815ce/nbdb/0.log"
Sep 17 19:33:27.105425 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:27.105393    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbxgv_93bb0a24-3334-4d1f-a905-6f50ccd815ce/sbdb/0.log"
Sep 17 19:33:27.152623 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:27.152584    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbxgv_93bb0a24-3334-4d1f-a905-6f50ccd815ce/ovnkube-controller/0.log"
Sep 17 19:33:28.246047 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:28.246010    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-nw2xp_deeaf161-dbf1-4057-b88c-9881a12733d0/network-check-target-container/0.log"
Sep 17 19:33:29.176254 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:29.176224    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-4xv6q_1783fc9d-0786-47b1-b64b-bb1cd5f3cdb9/iptables-alerter/0.log"
Sep 17 19:33:29.986679 ip-10-0-138-84 kubenswrapper[2573]: I0917 19:33:29.986648    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-xsvnv_3d12801a-7163-4260-8f73-d1370505195b/tuned/0.log"